Jafarzadeh S Reza, Johnson Wesley O, Gardner Ian A
Department of Medicine and Epidemiology, University of California, Davis, CA, U.S.A.
Department of Statistics, University of California, Irvine, CA, U.S.A.
Stat Med. 2016 Mar 15;35(6):859-76. doi: 10.1002/sim.6745. Epub 2015 Sep 28.
The area under the receiver operating characteristic (ROC) curve (AUC) is used as a performance metric for quantitative tests. Although multiple biomarkers may be available for diagnostic or screening purposes, diagnostic accuracy is often assessed individually rather than in combination. In this paper, we consider the interesting problem of combining multiple biomarkers for use in a single diagnostic criterion with the goal of improving the diagnostic accuracy above that of an individual biomarker. The diagnostic criterion created from multiple biomarkers is based on the predictive probability of disease, conditional on given multiple biomarker outcomes. If the computed predictive probability exceeds a specified cutoff, the corresponding subject is allocated as 'diseased'. This defines a standard diagnostic criterion that has its own ROC curve, namely, the combined ROC (cROC). The AUC metric for cROC, namely, the combined AUC (cAUC), is used to compare the predictive criterion based on multiple biomarkers to one based on fewer biomarkers. A multivariate random-effects model is proposed for modeling multiple normally distributed dependent scores. Bayesian methods for estimating ROC curves and corresponding (marginal) AUCs are developed when a perfect reference standard is not available. In addition, cAUCs are computed to compare the accuracy of different combinations of biomarkers for diagnosis. The methods are evaluated using simulations and are applied to data for Johne's disease (paratuberculosis) in cattle.
接受者操作特征(ROC)曲线下面积(AUC)被用作定量测试的性能指标。尽管可能有多种生物标志物可用于诊断或筛查目的,但诊断准确性通常是单独评估而非联合评估。在本文中,我们考虑了将多种生物标志物组合用于单一诊断标准这一有趣的问题,目标是将诊断准确性提高到高于单个生物标志物的水平。由多种生物标志物创建的诊断标准基于疾病的预测概率,以给定的多种生物标志物结果为条件。如果计算出的预测概率超过指定的临界值,则将相应的个体判定为“患病”。这定义了一个具有自身ROC曲线的标准诊断标准,即联合ROC(cROC)。cROC的AUC指标,即联合AUC(cAUC),用于比较基于多种生物标志物的预测标准与基于较少生物标志物的预测标准。提出了一种多变量随机效应模型来对多个正态分布的相关得分进行建模。当没有完美的参考标准时,开发了用于估计ROC曲线和相应(边际)AUC的贝叶斯方法。此外,计算cAUC以比较不同生物标志物组合用于诊断的准确性。使用模拟对这些方法进行评估,并将其应用于牛副结核病(约内氏病)的数据。