Our Experience

Process evaluation sets out to explain how interventions work – assessing the processes through which the intervention leads to the outcomes and outputs. i.e. – how the intervention works (or does not work, depending on the result). We regularly undertake process evaluations across multiple industry sectors. Our work can also identify why an intervention fails to achieve its desired effects, and help understand how to re-design it, or why an intervention works for certain groups in certain contexts, but not in others. We deploy a range of qualitative and quantitative methodologies, including process mapping, a critical element of process evaluation used to illustrate impacts of existing and revised processes.

Historic England commissioned us to undertake a process evaluation of their Everyday Heritage Grants, launched as part of their on-going Strategy for Inclusion, Diversity and Equality. Our work assessed the effectiveness and efficiency of the programme and informed the next stage of delivery. A mixed methodology included analysis of Management Information (MI) data, a process workshop, surveys, in-depth interviews and observation of project meetings.

The UK’s National Measurement System (NMS) has a core infrastructure of measurement laboratories to ensure there is confidence in everyday measurements, one of which is the National Physical Laboratory (NPL), who receive most of their funding for their part in the NMS. Harlow Consulting was commissioned to conduct a process evaluation of the NMS focusing on the role played by NPL. We deployed a qualitative approach, with depth interviews and round tables, supplemented by a desk-based evidence assessment. Our report highlighted key considerations for NPL to consider in the planning and management of their work on the NMS at the start of a new five-year cycle.

In the wake of the pandemic, Innovate UK required an assessment of its design and delivery of multiple grant funding competitions that formed their response to Covid-19 in the context of the ‘new normal’. Following an initial desk-based review of relevant intelligence, logic model and observations, fieldwork included three quantitative surveys targeting grant applicants, assessors and monitoring officers, supplemented with qualitative depth interviews and desk-based data/document review. Quantitative survey data analysis included statistical testing, comparison of the three different respondent types and extensive cross-tabulation of data. Three interim reports presented findings at regular intervals, with the final report presented to the Board and accompanied by a comprehensive data dashboard.

"The economics and insights team found working with Harlow Consulting an effective partnership. Harlow Consulting was able to challenge us when necessary and ensure we were asking the right questions and also ensure a robust approach to the process evaluation. Harlow Consulting delivered the programme of work in a timely manner and were flexible as the programme was being delivered in the type of outputs/reports produced. Jennifer was excellent in presenting the results to our executive team. The process evaluation is being used as part of the evidence base that is being built up to support Innovate UK’s lessons learnt during the pandemic. The pandemic showed Innovate UK’s agility to adjust processes to meet customer needs, and this evidence is helping to fine tune processes in the longer term."

Geeta Nathan, Deputy Director of Start-Up Ecosystem – Innovate UK

Case Studies