Haber Michael, Gao Jingjing, Barnhart Huiman X
Department of Biostatistics, Rollins School of Public Health, Emory University, Atlanta, Georgia 30322, USA.
J Biopharm Stat. 2007;17(4):757-66. doi: 10.1080/10543400701329547.
We propose a new approach to evaluating agreement between two observers making binary observations on a set of subjects. This approach compares the probability of disagreement (or discordance) between the observers to the probability of disagreement between replicated observations made by the same observer on the same subject. We consider two situations: (1) a symmetric assessment of agreement between two observers, and (2) an assessment of the agreement of a new observer with an imperfect "gold standard". We develop a nonparametric method for estimation of the new agreement coefficients when observers make replicated readings on each subject. The reliability of the estimation method is examined via a simulation study. Data from a study aimed at determining the validity of diagnosis of breast cancer based on mammograms is used to illustrate the new concepts and methods.
我们提出了一种新方法，用于评估对一组受试者进行二元观测的两位观察者之间的一致性。该方法将观察者之间的不一致（或不和谐）概率与同一观察者对同一受试者进行重复观测时的不一致概率进行比较。我们考虑两种情况：（1）对两位观察者之间的一致性进行对称评估；（2）评估新观察者与不完善的“金标准”之间的一致性。当观察者对每个受试者进行重复读数时，我们开发了一种非参数方法来估计新的一致性系数。通过模拟研究检验了估计方法的可靠性。一项旨在基于乳房X线照片确定乳腺癌诊断有效性的研究数据被用于说明新概念和方法。
