Lee Chih-Yuan S, August Gerald J, Realmuto George M, Horowitz Jason L, Bloomquist Michael L, Klimes-Dougan Bonnie
Division of Child and Adolescent Psychiatry, University of Minnesota Medical School, F256/2B West, 2450 Riverside Avenue, Minneapolis, MN 55454, USA.
Prev Sci. 2008 Sep;9(3):215-29. doi: 10.1007/s11121-008-0097-6. Epub 2008 Jul 22.
The present study examined the feasibility of an innovative technology designed to assess implementation fidelity of the Early Risers conduct problems prevention program across 27 geographically dispersed school sites. A multidimensional construct of fidelity was used to assess the quantity of services provided (exposure), the degree to which program strategies conformed to the manual (adherence), and how well implementers delivered the program (quality of delivery). The measurement technology featured a fidelity monitoring system that required (a) weekly reporting on a web-based documentation system to assess program exposure and adherence, and (b) five annually administered telephone interviews with a technical assistant to assess quality of program implementation. The results showed that the fidelity monitoring system was feasible, with all sites achieving 100% compliance in completion of their required on-line reporting and on average over 80% of the required teleconference interviews. User feedback indicated satisfaction with the web-based program. The system was successful in measuring multiple indices of fidelity. The strengths and limitations of measuring fidelity at a distance with web-based and teleconferencing technologies are discussed.
本研究检验了一项创新技术的可行性，该技术旨在评估“早起者行为问题预防计划”在27个地理位置分散的学校场所的实施保真度。采用了一个多维度的保真度结构来评估所提供服务的数量（接触度）、项目策略符合手册的程度（依从性）以及实施者执行项目的情况（实施质量）。测量技术采用了一个保真度监测系统，该系统要求：（a）每周在基于网络的文档系统上报告，以评估项目接触度和依从性；（b）每年与一名技术助理进行五次电话访谈，以评估项目实施质量。结果表明，保真度监测系统是可行的，所有场所都100%完成了所需的在线报告，并且平均超过80%完成了所需的电话会议访谈。用户反馈表明对基于网络的项目感到满意。该系统成功地测量了多个保真度指标。讨论了使用基于网络和电话会议技术远程测量保真度的优点和局限性。
