Akiba Christopher F, Powell Byron J, Pence Brian W, Muessig Kate, Golin Carol E, Go Vivian
RTI International, Research Triangle Park, NC, USA.
Center for Mental Health Services Research, Brown School, Washington University in St. Louis, St. Louis, MO, USA.
Implement Sci Commun. 2022 Oct 29;3(1):117. doi: 10.1186/s43058-022-00365-4.
Fidelity measurement of implementation strategies is underdeveloped and underreported, and the level of reporting is decreasing over time. Failing to properly measure the factors that affect the delivery of an implementation strategy may obscure the link between a strategy and its outcomes. Barriers to assessing and reporting implementation strategy fidelity among researchers are not well understood. The aims of this qualitative study were to identify barriers to fidelity measurement and pragmatic pathways towards improvement.
We conducted in-depth interviews among researchers conducting implementation trials. We utilized a theory-informed interview approach to elicit the barriers and possible solutions to implementation strategy fidelity assessment and reporting. Reflexive-thematic analysis guided coding and memo-writing to determine key themes regarding barriers and solutions.
Twenty-two implementation researchers were interviewed. Participants agreed that implementation strategy fidelity was an essential element of implementation trials and that its assessment and reporting should improve. Key thematic barriers focused on (1) a current lack of validated fidelity tools with the need to assess fidelity in the short term, (2) the complex nature of some implementation strategies, (3) conceptual complications when assessing fidelity within mechanisms-focused implementation research, and (4) structural issues related to funding and publishing. Researchers also suggested pragmatic solutions to overcome each barrier. Respondents reported using specification and tracking data in the short term until validated tools become available. Participants suggested that researchers with strategy-specific content expertise lead the way in identifying core components and setting fidelity requirements for them. Addressing the third barrier, participants provided examples of what pragmatic prospective and retrospective fidelity assessments might look like along a mechanistic pathway. Finally, researchers described approaches to minimize costs of data collection, as well as more structural accountability like adopting and enforcing reporting guidelines or changing the structure of funding opportunities.
We propose short- and long-term priorities for improving the assessment and reporting of implementation strategy fidelity and the quality of implementation research.
A better understanding of the barriers to implementation strategy fidelity assessment may pave the way towards pragmatic solutions.
实施策略的保真度测量尚不完善且报道不足,并且随着时间的推移,报道水平在下降。未能正确测量影响实施策略交付的因素可能会模糊策略与其结果之间的联系。研究人员在评估和报告实施策略保真度方面存在的障碍尚未得到充分理解。这项定性研究的目的是确定保真度测量的障碍以及改进的实用途径。
我们对进行实施试验的研究人员进行了深入访谈。我们采用基于理论的访谈方法,以引出实施策略保真度评估和报告的障碍及可能的解决方案。反思性主题分析指导编码和撰写备忘录,以确定有关障碍和解决方案的关键主题。
采访了22名实施研究人员。参与者一致认为,实施策略保真度是实施试验的一个基本要素,其评估和报告应该得到改进。关键的主题障碍集中在:(1)目前缺乏经过验证的保真度工具,且需要在短期内评估保真度;(2)一些实施策略的复杂性;(3)在以机制为重点的实施研究中评估保真度时的概念复杂性;(4)与资金和出版相关的结构性问题。研究人员还提出了克服每个障碍的实用解决方案。受访者报告称,在短期使用规范和跟踪数据,直到有经过验证的工具可用。参与者建议,具有特定策略内容专业知识的研究人员应率先确定核心组成部分并为其设定保真度要求。针对第三个障碍,参与者提供了沿着机制途径进行实用的前瞻性和回顾性保真度评估可能是什么样的示例。最后,研究人员描述了尽量减少数据收集成本的方法,以及更多的结构性问责制,如采用和执行报告指南或改变资金机会的结构。
我们提出了改进实施策略保真度评估和报告以及实施研究质量的短期和长期优先事项。
更好地理解实施策略保真度评估的障碍可能为实用解决方案铺平道路。