Kwan Bethany M, McGinnes Hannah L, Ory Marcia G, Estabrooks Paul A, Waxmonsky Jeanette A, Glasgow Russell E
Department of Family Medicine and the Adult and Child Consortium of Health Outcomes Research and Delivery Science, University of Colorado Anschutz Medical Campus, Aurora, CO, United States.
Center for Population Health and Aging, Texas A&M University, College Station, TX, United States.
Front Public Health. 2019 Nov 22;7:345. doi: 10.3389/fpubh.2019.00345. eCollection 2019.
The RE-AIM framework has been widely used in health research but it is unclear the extent to which this framework is also used for planning and evaluating health-related programs in clinical and community settings. Our objective was to evaluate how RE-AIM is used in the "real-world" and identify opportunities for improving use outside of research contexts. We used purposive and snowball sampling to identify clinical and community health programs that used RE-AIM for planning and/or evaluation. Recruitment methods included surveys with email follow-up to funders, implementers, and RE-AIM working group members. We identified 17 programs and conducted structured in-depth interviews with key informants ( = 18). Across RE-AIM dimensions, respondents described motivations, uses, and measures; rated understandability and usefulness; discussed benefits and challenges, strategies to overcome challenges, and resources used. We used descriptive statistics for quantitative ratings, and content analysis for qualitative data. Program content areas included chronic disease management and prevention, healthy aging, mental health, or multiple, often behavioral health-related topics. During planning, most programs considered reach ( = 9), adoption ( = 11), and implementation ( = 12) while effectiveness ( = 7) and maintenance ( = 6) were considered less frequently. In contrast, most programs evaluated all RE-AIM dimensions, ranging from 13 programs assessing maintenance to 15 programs assessing implementation and effectiveness. On five-point scales, all RE-AIM dimensions were rated as easy to understand (Overall = 4.7 ± 0.5), but obtaining data was rated as somewhat challenging (Overall = 3.4 ± 0.9). Implementation was the most frequently used dimension to inform program design ( = 4.7 ± 0.6) relative to the other dimensions (3.0-3.9). All dimensions were considered similarly important for decision-making (average = 4.1 ± 1.4), with the exception of maintenance ( = 3.4 ± 1.7). Qualitative corresponded to the quantitative findings in that RE-AIM was reported to be a practical, easy to understand, and well-established implementation science framework. Challenges included understanding differences among RE-AIM dimensions and data acquisition. Valuable resources included the RE-AIM website and collaborating with an expert. RE-AIM is an efficient framework for planning and evaluation of clinical and community-based projects. It provides structure to systematically evaluate health program impact. Programs found planning for and assessing maintenance difficult, providing opportunities for further refinement.
RE-AIM框架已在健康研究中广泛应用,但尚不清楚该框架在临床和社区环境中用于规划和评估与健康相关项目的程度。我们的目标是评估RE-AIM在“现实世界”中的使用情况,并确定在研究背景之外改进其使用的机会。我们采用目的抽样和滚雪球抽样的方法,确定使用RE-AIM进行规划和/或评估的临床和社区健康项目。招募方法包括对资助者、实施者和RE-AIM工作组成员进行电子邮件跟进的调查。我们确定了17个项目,并对关键信息提供者(n = 18)进行了结构化深入访谈。在RE-AIM的各个维度上,受访者描述了动机、用途和措施;对可理解性和有用性进行了评分;讨论了益处和挑战、克服挑战的策略以及使用的资源。我们对定量评分使用描述性统计,对定性数据使用内容分析。项目内容领域包括慢性病管理与预防、健康老龄化、心理健康,或多个通常与行为健康相关的主题。在规划过程中,大多数项目考虑了覆盖范围(n = 9)、采用情况(n = 11)和实施情况(n = 12),而有效性(n = 7)和维持情况(n = 6)的考虑频率较低。相比之下,大多数项目评估了RE-AIM的所有维度,从评估维持情况的13个项目到评估实施情况和有效性的15个项目不等。在五分制量表上,所有RE-AIM维度的评分均为易于理解(总体均值 = 4.7±0.5),但获取数据的评分被认为有点具有挑战性(总体均值 = 3.4±0.9)。相对于其他维度(3.0 - 3.9),实施是用于为项目设计提供信息的最常用维度(均值 = 4.7±0.6)。除维持情况(均值 = 3.4±1.7)外,所有维度在决策中被认为同样重要(平均均值 = 4.1±1.4)。定性结果与定量结果一致,即RE-AIM据报道是一个实用、易于理解且成熟的实施科学框架。挑战包括理解RE-AIM维度之间的差异和数据获取。有价值的资源包括RE-AIM网站以及与专家合作。RE-AIM是用于规划和评估临床及社区项目的有效框架。它为系统评估健康项目影响提供了结构。各项目发现规划和评估维持情况存在困难,这为进一步完善提供了机会。