León F R, Quiroz G, Brazzoduro A
Population Council, El Olivar de San Isidro, Lima, Peru.
Stud Fam Plann. 1994 May-Jun;25(3):184-90.
Evaluators of family planning programs have begun to use simulated client ratings to assess the quality of services. However, little is known about the reliability of such ratings when they are used to assess individual provider performance. This study examined the reliability of quality-of-care ratings in a Peruvian community-based distribution program by using pairs of concealed observers--a simulated client and a companion. Average interrater agreement, measured by intraclass correlation, was .50, indicating that ratings are not reliable enough for the evaluation of a single provider by a single rater. The study results suggest that checklist-item scores referring to specific provider behaviors will be more reliable and useful than ratings.
计划生育项目的评估人员已开始使用模拟客户评分来评估服务质量。然而，当这些评分用于评估个体提供者的表现时，其可靠性却鲜为人知。本研究通过使用一对隐蔽观察者——一名模拟客户和一名同伴，检验了秘鲁社区分发项目中护理质量评分的可靠性。通过组内相关系数测量的平均评分者间一致性为0.50，这表明评分对于单个评分者评估单个提供者而言可靠性不足。研究结果表明，涉及特定提供者行为的检查表项目得分将比评分更可靠且更有用。
