• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

使用相对效用曲线评估风险预测。

Using relative utility curves to evaluate risk prediction.

作者信息

Baker Stuart G, Cook Nancy R, Vickers Andrew, Kramer Barnett S

机构信息

National Cancer Institute, Bethesda, USA.

出版信息

J R Stat Soc Ser A Stat Soc. 2009 Oct 1;172(4):729-748. doi: 10.1111/j.1467-985X.2009.00592.x.

DOI:10.1111/j.1467-985X.2009.00592.x
PMID:20069131
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC2804257/
Abstract

Because many medical decisions are based on risk prediction models constructed from medical history and results of tests, the evaluation of these prediction models is important. This paper makes five contributions to this evaluation: (1) the relative utility curve which gauges the potential for better prediction in terms of utilities, without the need for a reference level for one utility, while providing a sensitivity analysis for missipecification of utilities, (2) the relevant region, which is the set of values of prediction performance consistent with the recommended treatment status in the absence of prediction (3) the test threshold, which is the minimum number of tests that would be traded for a true positive in order for the expected utility to be non-negative, (4) the evaluation of two-stage predictions that reduce test costs, and (5) connections among various measures of prediction performance. An application involving the risk of cardiovascular disease is discussed.

摘要

由于许多医疗决策是基于从病史和检查结果构建的风险预测模型,因此对这些预测模型的评估很重要。本文对这种评估做出了五项贡献:(1)相对效用曲线,它在效用方面衡量更好预测的潜力,无需一个效用的参考水平,同时为效用误设提供敏感性分析;(2)相关区域,它是在没有预测时与推荐治疗状态一致的预测性能值的集合;(3)测试阈值,即为使预期效用为非负,换取一个真阳性而愿意进行的最少测试次数;(4)对降低测试成本的两阶段预测的评估;(5)各种预测性能度量之间的联系。文中讨论了一个涉及心血管疾病风险的应用。

相似文献

1
Using relative utility curves to evaluate risk prediction.使用相对效用曲线评估风险预测。
J R Stat Soc Ser A Stat Soc. 2009 Oct 1;172(4):729-748. doi: 10.1111/j.1467-985X.2009.00592.x.
2
Evaluating Risk Prediction with Data Collection Costs: Novel Estimation of Test Tradeoff Curves.评估数据收集成本下的风险预测:测试权衡曲线的新估计方法。
Med Decis Making. 2024 Jan;44(1):53-63. doi: 10.1177/0272989X231208673. Epub 2023 Nov 22.
3
Putting risk prediction in perspective: relative utility curves.正确看待风险预测:相对效用曲线。
J Natl Cancer Inst. 2009 Nov 18;101(22):1538-42. doi: 10.1093/jnci/djp353. Epub 2009 Oct 20.
4
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.在流行地区,服用抗叶酸抗疟药物的人群中,叶酸补充剂与疟疾易感性和严重程度的关系。
Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217.
5
[Standard technical specifications for methacholine chloride (Methacholine) bronchial challenge test (2023)].[氯化乙酰甲胆碱支气管激发试验标准技术规范(2023年)]
Zhonghua Jie He He Hu Xi Za Zhi. 2024 Feb 12;47(2):101-119. doi: 10.3760/cma.j.cn112147-20231019-00247.
6
Comparison of Two Modern Survival Prediction Tools, SORG-MLA and METSSS, in Patients With Symptomatic Long-bone Metastases Who Underwent Local Treatment With Surgery Followed by Radiotherapy and With Radiotherapy Alone.两种现代生存预测工具 SORG-MLA 和 METSSS 在接受手术联合放疗和单纯放疗治疗有症状长骨转移患者中的比较。
Clin Orthop Relat Res. 2024 Dec 1;482(12):2193-2208. doi: 10.1097/CORR.0000000000003185. Epub 2024 Jul 23.
7
Evaluating a new marker for risk prediction using the test tradeoff: an update.使用检验权衡评估一种用于风险预测的新标志物:最新进展
Int J Biostat. 2012 Mar 22;8(1):/j/ijb.2012.8.issue-1/1557-4679.1395/1557-4679.1395.xml. doi: 10.1515/1557-4679.1395.
8
Does the Presence of Missing Data Affect the Performance of the SORG Machine-learning Algorithm for Patients With Spinal Metastasis? Development of an Internet Application Algorithm.缺失数据的存在是否会影响 SORG 机器学习算法在脊柱转移瘤患者中的性能?开发一种互联网应用算法。
Clin Orthop Relat Res. 2024 Jan 1;482(1):143-157. doi: 10.1097/CORR.0000000000002706. Epub 2023 Jun 12.
9
Are Current Survival Prediction Tools Useful When Treating Subsequent Skeletal-related Events From Bone Metastases?当前的生存预测工具在治疗骨转移后的骨骼相关事件时有用吗?
Clin Orthop Relat Res. 2024 Sep 1;482(9):1710-1721. doi: 10.1097/CORR.0000000000003030. Epub 2024 Mar 22.
10
Polysomnography in patients with obstructive sleep apnea: an evidence-based analysis.阻塞性睡眠呼吸暂停患者的多导睡眠图:一项基于证据的分析。
Ont Health Technol Assess Ser. 2006;6(13):1-38. Epub 2006 Jun 1.

引用本文的文献

1
Evaluating clinical utility of multi-category outcome risk prediction models.评估多类别结局风险预测模型的临床效用。
medRxiv. 2025 Apr 28:2025.04.26.25326499. doi: 10.1101/2025.04.26.25326499.
2
Risk-based evaluation of machine learning-based classification methods used for medical devices.用于医疗设备的基于机器学习的分类方法的基于风险的评估。
BMC Med Inform Decis Mak. 2025 Mar 11;25(1):126. doi: 10.1186/s12911-025-02909-9.
3
Evaluating Risk Prediction with Data Collection Costs: Novel Estimation of Test Tradeoff Curves.评估数据收集成本下的风险预测:测试权衡曲线的新估计方法。

本文引用的文献

1
The Skill Plot: a graphical technique for evaluating continuous diagnostic tests.技能图:一种评估连续诊断测试的图形技术。
Biometrics. 2008 Mar;64(1):250-6; discussion 256-61. doi: 10.1111/j.1541-0420.2007.00781_1.x.
2
The numerical measure of the success of predictions.预测成功的数值度量。
Science. 1884 Nov 14;4(93):453-4. doi: 10.1126/science.ns-4.93.453-a.
3
The need for reorientation toward cost-effective prediction: comments on 'Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond' by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929).
Med Decis Making. 2024 Jan;44(1):53-63. doi: 10.1177/0272989X231208673. Epub 2023 Nov 22.
4
Decision curve analysis: confidence intervals and hypothesis testing for net benefit.决策曲线分析:净效益的置信区间与假设检验
Diagn Progn Res. 2023 Jun 6;7(1):11. doi: 10.1186/s41512-023-00148-y.
5
APLUS: A Python library for usefulness simulations of machine learning models in healthcare.APLUS:一个用于在医疗保健中模拟机器学习模型有用性的 Python 库。
J Biomed Inform. 2023 Mar;139:104319. doi: 10.1016/j.jbi.2023.104319. Epub 2023 Feb 13.
6
A simple framework to identify optimal cost-effective risk thresholds for a single screen: Comparison to Decision Curve Analysis.一种用于确定单一筛查最佳成本效益风险阈值的简单框架:与决策曲线分析的比较。
J R Stat Soc Ser A Stat Soc. 2021 Jul;184(3):887-903. doi: 10.1111/rssa.12680. Epub 2021 Mar 23.
7
Commentary: Artificial Intelligence and Statistics: Just the Old Wine in New Wineskins?评论:人工智能与统计学:不过是新瓶装旧酒?
Front Digit Health. 2022 May 20;4:923944. doi: 10.3389/fdgth.2022.923944. eCollection 2022.
8
Is My Clinical Prediction Model Clinically Useful? A Primer on Decision Curve Analysis.我的临床预测模型是否具有临床实用性?决策曲线分析入门。
Acta Neurochir Suppl. 2022;134:115-118. doi: 10.1007/978-3-030-85292-4_15.
9
Longitudinal validation of an electronic health record delirium prediction model applied at admission in COVID-19 patients.电子病历谵妄预测模型在 COVID-19 患者入院时的纵向验证。
Gen Hosp Psychiatry. 2022 Jan-Feb;74:9-17. doi: 10.1016/j.genhosppsych.2021.10.005. Epub 2021 Nov 2.
10
Recalibration Methods for Improved Clinical Utility of Risk Scores.风险评分临床实用性改进的再校准方法。
Med Decis Making. 2022 May;42(4):500-512. doi: 10.1177/0272989X211044697. Epub 2021 Oct 4.
重新定位以实现具有成本效益的预测的必要性:对M. J. 彭西纳等人发表于《医学统计学》(DOI: 10.1002/sim.2929)的《评估新标志物的额外预测能力:从ROC曲线下面积到重新分类及其他》的评论
Stat Med. 2008 Jan 30;27(2):199-206. doi: 10.1002/sim.2995.
4
Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond.评估新标志物的附加预测能力:从ROC曲线下面积到重新分类及其他。
Stat Med. 2008 Jan 30;27(2):157-72; discussion 207-12. doi: 10.1002/sim.2929.
5
Evaluating the predictiveness of a continuous marker.评估连续标志物的预测性。
Biometrics. 2007 Dec;63(4):1181-8. doi: 10.1111/j.1541-0420.2007.00814.x. Epub 2007 May 8.
6
Use and misuse of the receiver operating characteristic curve in risk prediction.风险预测中受试者工作特征曲线的应用与误用
Circulation. 2007 Feb 20;115(7):928-35. doi: 10.1161/CIRCULATIONAHA.106.672402.
7
Decision curve analysis: a novel method for evaluating prediction models.决策曲线分析:一种评估预测模型的新方法。
Med Decis Making. 2006 Nov-Dec;26(6):565-74. doi: 10.1177/0272989X06295361.
8
On criteria for evaluating models of absolute risk.论绝对风险模型的评估标准。
Biostatistics. 2005 Apr;6(2):227-39. doi: 10.1093/biostatistics/kxi005.
9
A randomized trial of low-dose aspirin in the primary prevention of cardiovascular disease in women.低剂量阿司匹林用于女性心血管疾病一级预防的随机试验。
N Engl J Med. 2005 Mar 31;352(13):1293-304. doi: 10.1056/NEJMoa050613. Epub 2005 Mar 7.
10
Prediction of cancer outcome with microarrays: a multiple random validation strategy.利用微阵列预测癌症预后:一种多重随机验证策略。
Lancet. 2005;365(9458):488-92. doi: 10.1016/S0140-6736(05)17866-0.