Bartko J J, Carpenter W T
J Nerv Ment Dis. 1976 Nov;163(5):307-17. doi: 10.1097/00005053-197611000-00003.
This paper reviews the most frequently used and misused reliability measures appearing in the mental health literature. We illustrate the various types of data sets on which reliability is assessed (i.e., two raters, more than two raters, and varying numbers of raters with dichotomous, polychotomous, and quantitative data). Reliability statistics appropriate for each data format are presented, and their pros and cons illustrated. Inadequancies of some methods are highlighted. The meaning of different levels of reliability obtained with various statistics is discussed. This critique is intended for the reading professional and the investigator who has an occasional need for reliability assessment. Statistical expertise is not required and theoretical material is referenced for the interested reader. Necessary formulas for computations are presented in the appendices. A summary table of some suitable reliability measures is presented.
本文回顾了心理健康文献中最常用和滥用的可靠性测量方法。我们举例说明了用于评估可靠性的各种类型的数据集（即两名评估者、两名以上评估者以及不同数量评估者的二分、多分和定量数据）。介绍了适用于每种数据格式的可靠性统计方法，并说明了其优缺点。强调了一些方法的不足之处。讨论了通过各种统计方法获得的不同可靠性水平的含义。本评论面向有可靠性评估需求的专业读者和研究人员。不需要统计学专业知识，感兴趣的读者可参考理论材料。附录中给出了计算所需的公式。还列出了一些合适的可靠性测量方法的汇总表。
