Smith Jane Ellen, Gianini Loren M, Garner Bryan R, Malek Karen L, Godley Susan H
Department of Psychology, University of New Mexico, Albuquerque, NM.
Yale University School of Medicine, Psychiatry, New Haven, CT.
J Child Adolesc Subst Abuse. 2014 Jan 1;23(3):185-199. doi: 10.1080/1067828X.2012.729258.
This study evaluated a process for training raters to reliably rate clinicians delivering the Adolescent Community Reinforcement Approach (A-CRA) in a national dissemination project. The unique A-CRA coding system uses specific behavioral anchors throughout its 73 procedure components. Five randomly-selected raters each rated "passing" and "not passing" examples of the 19 A-CRA procedures. Ninety-four percent of the final ICCs were at least 'good' (≥.60) and 66.7% were 'excellent' (≥.75), and 95% of the ratings exceeded the 60% or better agreement threshold between raters and the gold standard. Raters can be trained to provide reliable A-CRA feedback for large-scale dissemination projects.
本研究评估了一种在全国性推广项目中培训评分者以可靠地对实施青少年社区强化法(A-CRA)的临床医生进行评分的流程。独特的A-CRA编码系统在其73个程序组件中都使用了特定的行为锚定。五名随机挑选的评分者分别对19项A-CRA程序的“通过”和“未通过”示例进行评分。最终组内相关系数(ICC)的94%至少为“良好”(≥0.60),66.7%为“优秀”(≥0.75),并且95%的评分超过了评分者与金标准之间60%或更高的一致性阈值。可以对评分者进行培训,以便为大规模推广项目提供可靠的A-CRA反馈。