McKenzie D P, Mackinnon A J, Péladeau N, Onghena P, Bruce P C, Clarke D M, Harrigan S, McGorry P D
Department of Psychological Medicine, Monash University, Victoria, Australia.
J Psychiatr Res. 1996 Nov-Dec;30(6):483-92. doi: 10.1016/s0022-3956(96)00033-7.
Researchers comparing diagnostic systems or screening tests frequently need to compare indices of agreement such as the kappa coefficient. While asymptotic methods exist for comparing kappas derived from independent samples, no satisfactory approach exists for comparing kappas derived from the same or related samples. Resampling methods for comparing kappa coefficients obtained from the same sample are presented. Easily undertaken using readily available software, these methods are illustrated by application to a small sample of psychiatric data, as well as to several thousand samples of simulated data. An acceptable type I error rate was exhibited. Resampling techniques-easily implemented and making few assumptions-deserve wider application in psychiatric research.
比较诊断系统或筛查测试的研究人员经常需要比较一致性指标，如kappa系数。虽然存在用于比较来自独立样本的kappa系数的渐近方法，但对于比较来自相同或相关样本的kappa系数，尚无令人满意的方法。本文提出了用于比较从同一样本获得的kappa系数的重采样方法。这些方法使用现成的软件很容易实施，并通过应用于一小部分精神科数据样本以及数千个模拟数据样本进行了说明。结果显示了可接受的I型错误率。重采样技术易于实施且假设较少，值得在精神科研究中更广泛地应用。
