Hurtubise Karen, Phoenix Michelle, Camden Chantal, Gauthier Raphaëlle, Stratford Paul, Dostie Rosalie, Beaudoin Audrée Jeanne, Maltais Désirée, Berbari Jade, Gaboury Isabelle
School of Rehabilitation Sciences, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada.
Faculté de Médicine et Sciences de la Santé, Université de Sherbrooke, Sherbrooke, Québec, Canada.
Int J Telerehabil. 2024 Jun 28;16(1):e6603. doi: 10.5195/ijt.2024.6603. eCollection 2024.
This multi-methods study describes the development of a pediatric rehabilitation telehealth intervention fidelity checklist, estimates its inter-rater reliability, and documents raters' implementation experience. A literature scan and expert consultation identified eighteen key behaviors and categorized them into three subdomains, measured using a 5-point measurement system. To estimate the checklist's inter-rater reliability, three raters scored 33 video recordings. A Shrout and Fleiss Class 1,1 intraclass correlation (ICC)) and 95% confidence intervals (CI) calculated ICCs = 0.5 (CI: 0, 0.9) for both the Therapist and the Parent-Therapists subdomains, and the Parent subdomain an ICC = 0.3 (CI: 0, 0.8). In the implementation surveys, raters reported high levels of satisfaction (100%), ease of use (84% to 88%), and confidence in their video ratings (87% to 100%). Changes in procedures and scoring were recommended. Capturing raters' implementation experiences is crucial in the early evaluation of the fidelity checklists for telehealth.
这项多方法研究描述了儿科康复远程医疗干预保真度检查表的开发过程，估计了其评分者间信度，并记录了评分者的实施经验。通过文献检索和专家咨询确定了18项关键行为，并将其分为三个子领域，采用5分制测量系统进行测量。为了估计检查表的评分者间信度，三名评分者对33段视频记录进行了评分。对于治疗师和家长-治疗师子领域，Shrout和Fleiss的1,1类内相关系数（ICC）以及95%置信区间（CI）计算得出ICC = 0.5（CI：0，0.9），而家长子领域的ICC = 0.3（CI：0，0.8）。在实施调查中，评分者报告了较高的满意度（100%）、易用性（84%至88%）以及对视频评分的信心（87%至100%）。建议对程序和评分进行修改。在远程医疗保真度检查表的早期评估中，获取评分者的实施经验至关重要。
