Centre for Health Policy, School of Public Health, Faculty of Health Sciences, University of the Witwatersrand, 27 St Andrews Rd Parktown, Private Bag X3 Wits, Johannesburg, 2050, South Africa.
The George Institute for Global Health, Sydney, New South Wales, Australia.
BMC Public Health. 2019 Jul 16;19(1):953. doi: 10.1186/s12889-019-7261-8.
Process evaluation is increasingly recognized as an important component of effective implementation research and yet, there has been surprisingly little work to understand what constitutes best practice. Researchers use different methodologies describing causal pathways and understanding barriers and facilitators to implementation of interventions in diverse contexts and settings. We report on challenges and lessons learned from undertaking process evaluation of seven hypertension intervention trials funded through the Global Alliance of Chronic Diseases (GACD).
Preliminary data collected from the GACD hypertension teams in 2015 were used to inform a template for data collection. Case study themes included: (1) description of the intervention, (2) objectives of the process evaluation, (3) methods including theoretical basis, (4) main findings of the study and the process evaluation, (5) implications for the project, policy and research practice and (6) lessons for future process evaluations. The information was summarized and reported descriptively and narratively and key lessons were identified.
The case studies were from low- and middle-income countries and Indigenous communities in Canada. They were implementation research projects with intervention arm. Six theoretical approaches were used but most comprised of mixed-methods approaches. Each of the process evaluations generated findings on whether interventions were implemented with fidelity, the extent of capacity building, contextual factors and the extent to which relationships between researchers and community impacted on intervention implementation. The most important learning was that although process evaluation is time consuming, it enhances understanding of factors affecting implementation of complex interventions. The research highlighted the need to initiate process evaluations early on in the project, to help guide design of the intervention; and the importance of effective communication between researchers responsible for trial implementation, process evaluation and outcome evaluation.
This research demonstrates the important role of process evaluation in understanding implementation process of complex interventions. This can help to highlight a broad range of system requirements such as new policies and capacity building to support implementation. Process evaluation is crucial in understanding contextual factors that may impact intervention implementation which is important in considering whether or not the intervention can be translated to other contexts.
过程评估越来越被认为是有效实施研究的一个重要组成部分,但令人惊讶的是,几乎没有什么工作来了解什么是最佳实践。研究人员在不同的背景和环境下使用不同的方法来描述因果关系,并了解干预措施实施的障碍和促进因素。我们报告了通过全球慢性病联盟(GACD)资助的 7 项高血压干预试验进行过程评估所面临的挑战和经验教训。
2015 年,从 GACD 高血压团队收集的初步数据被用于为数据收集模板提供信息。案例研究主题包括:(1)干预措施的描述,(2)过程评估的目标,(3)方法,包括理论基础,(4)研究和过程评估的主要发现,(5)对项目、政策和研究实践的影响,以及(6)对未来过程评估的教训。信息被总结和描述性地报告,并确定了关键教训。
这些案例研究来自中低收入国家和加拿大的土著社区。它们是具有干预措施的实施研究项目。使用了六种理论方法,但大多数都包含混合方法方法。每一项过程评估都产生了关于干预措施是否以保真度实施、能力建设的程度、背景因素以及研究人员和社区之间的关系对干预措施实施的影响程度的发现。最重要的教训是,尽管过程评估耗时,但它增强了对影响复杂干预措施实施的因素的理解。研究强调了在项目早期启动过程评估的必要性,以帮助指导干预措施的设计;以及负责试验实施、过程评估和结果评估的研究人员之间进行有效沟通的重要性。
这项研究表明,过程评估在理解复杂干预措施实施过程中的重要作用。这有助于突出广泛的系统需求,例如新政策和能力建设,以支持实施。过程评估对于理解可能影响干预措施实施的背景因素至关重要,这对于考虑干预措施是否可以推广到其他环境非常重要。