Dr. Margolies, Dr. Humensky, Dr. Covell, and. Dr. Dixon are with the Department of Psychiatry, Columbia University, New York. They are also with the New York State Psychiatric Institute, New York, where all the other authors except Mr. Baker are affiliated. Mr. Baker is a consultant based in Washington, D.C.
Psychiatr Serv. 2017 Sep 1;68(9):975-978. doi: 10.1176/appi.ps.201600264. Epub 2017 Apr 17.
Fidelity assessments help ensure that evidence-based practices are implemented properly. Although assessments are typically conducted by independent raters, some programs have implemented self-assessments because of resource constraints. Self-assessments were compared with independent assessments of programs implementing individual placement and support supported employment.
Eleven community-based outpatient programs in New York State completed both self- and independent assessments. Intraclass correlation coefficients and paired t tests were used to compare scores from self- and independent assessments.
For both assessment methods, mean scores for all programs were within the range of fair fidelity. Self- and independent assessment total scores were not significantly different; however, significant differences were found on some scale items in this small sample.
Self-assessment may be valid for examining a program's overall functioning and useful when resource constraints prevent independent assessment. Independent assessors may be able to identify nuances, particularly on individual assessment items, that can point to areas for program improvement.
保真度评估有助于确保实施循证实践的正确性。尽管评估通常由独立的评估者进行，但由于资源限制，一些项目已经实施了自我评估。本文比较了实施个体安置和支持性就业的项目的自我评估和独立评估。
纽约州 11 个社区门诊项目同时完成了自我评估和独立评估。使用组内相关系数和配对 t 检验比较了自我评估和独立评估的分数。
对于两种评估方法，所有项目的平均分数都在保真度的合理范围内。自我评估和独立评估的总分没有显著差异；然而，在这个小样本中，在一些量表项目上发现了显著差异。
自我评估可能是评估项目整体功能的有效方法，在资源限制妨碍独立评估时很有用。独立评估者可能能够识别细微差别，特别是在个别评估项目上，这可以指出项目改进的领域。
