• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

对比两种用于ordinal ratings 的 ROC 分析框架。

Contrasting two frameworks for ROC analysis of ordinal ratings.

机构信息

Biostatistics and Biomathematics, Fred Hutchinson Cancer Research Center, Seattle, Washington 98109, USA.

出版信息

Med Decis Making. 2010 Jul-Aug;30(4):484-98. doi: 10.1177/0272989X09357477. Epub 2010 Feb 10.

DOI:10.1177/0272989X09357477
PMID:20147599
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC2905510/
Abstract

BACKGROUND

Statistical evaluation of medical imaging tests used for diagnostic and prognostic purposes often employs receiver operating characteristic (ROC) curves. Two methods for ROC analysis are popular. The ordinal regression method is the standard approach used when evaluating tests with ordinal values. The direct ROC modeling method is a more recently developed approach, motivated by applications to tests with continuous values.

OBJECTIVE

The authors compare the methods in terms of model formulations, interpretations of estimated parameters, the ranges of scientific questions that can be addressed with them, their computational algorithms, and the efficiencies with which they use data.

RESULTS

The authors show that a strong relationship exists between the methods by demonstrating that they fit the same models when only a single test is evaluated. The ordinal regression models are typically alternative parameterizations of the direct ROC models and vice versa. The direct method has two major advantages over the ordinal regression method: 1) estimated parameters relate directly to ROC curves, facilitating interpretations of covariate effects on ROC performance, and 2) comparisons between tests can be done directly in this framework. Comparisons can be made while accommodating covariate effects and even between tests that have values on different scales, such as between a continuous biomarker test and an ordinal valued imaging test. The ordinal regression method provides slightly more precise parameter estimates from data in our simulated data models.

CONCLUSION

Although the ordinal regression method is slightly more efficient, the direct ROC modeling method has important advantages in regard to interpretation, and it offers a framework to address a broader range of scientific questions, including the facility to compare tests.

摘要

背景

用于诊断和预后目的的医学成像测试的统计评估通常采用接收器操作特征 (ROC) 曲线。ROC 分析有两种流行方法。当评估具有有序值的测试时,有序回归方法是标准方法。直接 ROC 建模方法是一种最近开发的方法,其动机是应用于具有连续值的测试。

目的

作者从模型公式、估计参数的解释、可以用它们解决的科学问题范围、计算算法以及数据使用效率等方面比较了这两种方法。

结果

作者通过证明当仅评估单个测试时,它们拟合相同的模型,证明了这两种方法之间存在很强的关系。有序回归模型通常是直接 ROC 模型的替代参数化,反之亦然。与有序回归方法相比,直接方法有两个主要优势:1)估计参数直接与 ROC 曲线相关,便于解释协变量对 ROC 性能的影响,以及 2)可以在此框架内直接进行测试之间的比较。可以在容纳协变量效应的情况下进行比较,甚至可以在具有不同尺度的测试之间进行比较,例如在连续生物标志物测试和有序值成像测试之间进行比较。在我们的模拟数据模型中,有序回归方法从数据中提供了略微更精确的参数估计。

结论

尽管有序回归方法的效率略高,但直接 ROC 建模方法在解释方面具有重要优势,并且它提供了一个框架来解决更广泛的科学问题,包括比较测试的能力。

相似文献

1
Contrasting two frameworks for ROC analysis of ordinal ratings.对比两种用于ordinal ratings 的 ROC 分析框架。
Med Decis Making. 2010 Jul-Aug;30(4):484-98. doi: 10.1177/0272989X09357477. Epub 2010 Feb 10.
2
Use of likelihood ratios for comparisons of binary diagnostic tests: underlying ROC curves.使用似然比进行二项诊断测试的比较:ROC 曲线的基础。
Med Phys. 2010 Nov;37(11):5821-30. doi: 10.1118/1.3503849.
3
ROC area discrimination (ROCAD) curve: a new method of evaluating the discriminating ability of ordinal scales.ROC面积判别(ROCAD)曲线:一种评估有序量表判别能力的新方法。
J Clin Epidemiol. 2008 Oct;61(10):997-1003.e1. doi: 10.1016/j.jclinepi.2007.11.016. Epub 2008 Jun 9.
4
Unified Least Squares Methods for the Evaluation of Diagnostic Tests With the Gold Standard.用于金标准诊断试验评估的统一最小二乘法
Cancer Inform. 2017 Feb 3;16:1176935116686063. doi: 10.1177/1176935116686063. eCollection 2017.
5
ROC curve regression analysis: the use of ordinal regression models for diagnostic test assessment.ROC曲线回归分析:使用有序回归模型进行诊断试验评估。
Environ Health Perspect. 1994 Nov;102 Suppl 8(Suppl 8):73-8. doi: 10.1289/ehp.94102s873.
6
Estimating transformations for evaluating diagnostic tests with covariate adjustment.估计变换以进行具有协变量调整的诊断测试评估。
Stat Methods Med Res. 2023 Jul;32(7):1403-1419. doi: 10.1177/09622802231176030. Epub 2023 Jun 6.
7
Receiver operating characteristic (ROC) curve for medical researchers.医学研究者的受试者工作特征 (ROC) 曲线。
Indian Pediatr. 2011 Apr;48(4):277-87. doi: 10.1007/s13312-011-0055-4.
8
Smooth non-parametric receiver operating characteristic (ROC) curves for continuous diagnostic tests.连续诊断试验的平滑非参数接收者操作特征(ROC)曲线。
Stat Med. 1997 Oct 15;16(19):2143-56. doi: 10.1002/(sici)1097-0258(19971015)16:19<2143::aid-sim655>3.0.co;2-3.
9
Small area estimation of receiver operating characteristic curves for ordinal data under stochastic ordering.随机排序下有序数据的接收器操作特性曲线的小区域估计
Stat Med. 2020 May 15;39(10):1514-1528. doi: 10.1002/sim.8493. Epub 2020 Feb 3.
10
Semiparametric estimation of the relationship between ROC operating points and the test-result scale: application to the proper binormal model.ROC 工作点与检测结果尺度之间关系的半参数估计:在恰当的双正态模型中的应用。
Acad Radiol. 2011 Dec;18(12):1537-48. doi: 10.1016/j.acra.2011.08.003.

引用本文的文献

1
Framingham and American College of Cardiology/American Heart Association Pooled Cohort Equations, High-Sensitivity Troponin T, and N-Terminal Pro-Brain-Type Natriuretic Peptide for Predicting Atherosclerotic Cardiovascular Events Across the Spectrum of Kidney Dysfunction.弗雷明汉和美国心脏病学会/美国心脏协会 pooled cohort 方程、高敏肌钙蛋白 T 和 N 端脑利钠肽前体在预测肾功能不全谱中的动脉粥样硬化性心血管事件。
J Am Heart Assoc. 2022 Jun 7;11(11):e024913. doi: 10.1161/JAHA.121.024913. Epub 2022 May 27.
2
Model-Based ROC Curve: Examining the Effect of Case Mix and Model Calibration on the ROC Plot.基于模型的 ROC 曲线:检验病例组合和模型校准对 ROC 图的影响。
Med Decis Making. 2022 May;42(4):487-499. doi: 10.1177/0272989X211050909. Epub 2021 Oct 16.
3
More Accurate Oral Cancer Screening with Fewer Salivary Biomarkers.利用更少的唾液生物标志物进行更准确的口腔癌筛查。
Biomark Cancer. 2017 Oct 17;9:1179299X17732007. doi: 10.1177/1179299X17732007. eCollection 2017.
4
Unified Least Squares Methods for the Evaluation of Diagnostic Tests With the Gold Standard.用于金标准诊断试验评估的统一最小二乘法
Cancer Inform. 2017 Feb 3;16:1176935116686063. doi: 10.1177/1176935116686063. eCollection 2017.
5
Validation of the Framingham general cardiovascular risk score in a multiethnic Asian population: a retrospective cohort study.弗雷明汉一般心血管疾病风险评分在多民族亚洲人群中的验证:一项回顾性队列研究。
BMJ Open. 2015 May 19;5(5):e007324. doi: 10.1136/bmjopen-2014-007324.
6
Estimating the receiver operating characteristic curve in studies that match controls to cases on covariates.在匹配对照病例协变量的研究中估计接收者操作特征曲线。
Acad Radiol. 2013 Jul;20(7):863-73. doi: 10.1016/j.acra.2013.03.004. Epub 2013 Apr 17.

本文引用的文献

1
Adjusting for covariate effects on classification accuracy using the covariate-adjusted receiver operating characteristic curve.使用协变量调整后的受试者工作特征曲线来调整协变量对分类准确性的影响。
Biometrika. 2009 Jun;96(2):371-382. doi: 10.1093/biomet/asp002. Epub 2009 Apr 1.
2
Estimation and Comparison of Receiver Operating Characteristic Curves.接收器操作特性曲线的估计与比较
Stata J. 2009 Mar 1;9(1):1.
3
Accommodating Covariates in ROC Analysis.在ROC分析中纳入协变量。
Stata J. 2009 Jan 1;9(1):17-39.
4
Pivotal evaluation of the accuracy of a biomarker used for classification or prediction: standards for study design.用于分类或预测的生物标志物准确性的关键评估:研究设计标准
J Natl Cancer Inst. 2008 Oct 15;100(20):1432-8. doi: 10.1093/jnci/djn326. Epub 2008 Oct 7.
5
Adjusting for covariates in studies of diagnostic, screening, or prognostic markers: an old concept in a new setting.在诊断、筛查或预后标志物研究中对协变量进行调整:新背景下的一个旧概念。
Am J Epidemiol. 2008 Jul 1;168(1):89-97. doi: 10.1093/aje/kwn099. Epub 2008 May 13.
6
Assessing accuracy of mammography in the presence of verification bias and intrareader correlation.在存在验证偏倚和阅片者内相关性的情况下评估乳腺X线摄影的准确性。
Biometrics. 2005 Mar;61(1):259-68. doi: 10.1111/j.0006-341X.2005.031139.x.
7
Accuracy of screening mammography interpretation by characteristics of radiologists.根据放射科医生的特征评估乳腺钼靶筛查解读的准确性。
J Natl Cancer Inst. 2004 Dec 15;96(24):1840-50. doi: 10.1093/jnci/djh333.
8
The analysis of placement values for evaluating discriminatory measures.用于评估歧视性措施的安置值分析。
Biometrics. 2004 Jun;60(2):528-35. doi: 10.1111/j.0006-341X.2004.00200.x.
9
Distribution-free ROC analysis using binary regression techniques.使用二元回归技术的无分布ROC分析。
Biostatistics. 2002 Sep;3(3):421-32. doi: 10.1093/biostatistics/3.3.421.
10
Does training in the Breast Imaging Reporting and Data System (BI-RADS) improve biopsy recommendations or feature analysis agreement with experienced breast imagers at mammography?乳腺影像报告和数据系统(BI-RADS)培训能否改善活检建议或与经验丰富的乳腺影像诊断医师在乳腺钼靶检查中的特征分析一致性?
Radiology. 2002 Sep;224(3):871-80. doi: 10.1148/radiol.2243011626.