Vanbelle Sophie
Department of Methodology & Statistics, CAPHRI School for Public Health and Primary Care, Maastricht University, P.O. Box 616, 6200 MD, Maastricht, The Netherlands.
Psychometrika. 2016 Jun;81(2):399-410. doi: 10.1007/s11336-014-9439-4. Epub 2014 Dec 17.
Reliability and agreement studies are of paramount importance. They do contribute to the quality of studies by providing information about the amount of error inherent to any diagnosis, score or measurement. Guidelines for reporting reliability and agreement studies were recently provided. While the use of the kappa-like family is advised for categorical and ordinal scales, no further guideline in the choice of a weighting scheme is given. In the present paper, a new simple and practical interpretation of the linear- and quadratic-weighted kappa coefficients is given. This will help researchers in motivating their choice of a weighting scheme.
可靠性和一致性研究至关重要。它们通过提供有关任何诊断、评分或测量中固有误差量的信息，确实有助于提高研究质量。最近提供了报告可靠性和一致性研究的指南。虽然对于分类和有序量表建议使用类kappa族，但在加权方案的选择上没有给出进一步的指导。在本文中，对线性加权和二次加权kappa系数给出了一种新的简单实用的解释。这将有助于研究人员说明其对加权方案的选择动机。
