• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

别被误导了:临床预测模型外部验证的 3 大误区。

Don't be misled: 3 misconceptions about external validation of clinical prediction models.

机构信息

Department of General Practice and Nursing Science, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands.

Department of General Practice and Nursing Science, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, 3584CX, Utrecht, The Netherlands.

出版信息

J Clin Epidemiol. 2024 Aug;172:111387. doi: 10.1016/j.jclinepi.2024.111387. Epub 2024 May 8.

DOI:10.1016/j.jclinepi.2024.111387
PMID:38729274
Abstract

Clinical prediction models provide risks of health outcomes that can inform patients and support medical decisions. However, most models never make it to actual implementation in practice. A commonly heard reason for this lack of implementation is that prediction models are often not externally validated. While we generally encourage external validation, we argue that an external validation is often neither sufficient nor required as an essential step before implementation. As such, any available external validation should not be perceived as a license for model implementation. We clarify this argument by discussing 3 common misconceptions about external validation. We argue that there is not one type of recommended validation design, not always a necessity for external validation, and sometimes a need for multiple external validations. The insights from this paper can help readers to consider, design, interpret, and appreciate external validation studies.

摘要

临床预测模型可提供健康结果的风险,从而为患者提供信息并支持医疗决策。然而,大多数模型从未真正在实践中得到实施。这种缺乏实施的常见原因是预测模型通常未经外部验证。虽然我们通常鼓励进行外部验证,但我们认为,在实施之前,外部验证通常既不充分也不必要,不是一个必要的步骤。因此,任何可用的外部验证都不应被视为模型实施的许可证。我们通过讨论关于外部验证的 3 个常见误解来澄清这一论点。我们认为,不存在一种推荐的验证设计,外部验证并非总是必要的,有时还需要多次外部验证。本文的观点可以帮助读者考虑、设计、解释和欣赏外部验证研究。

相似文献

1
Don't be misled: 3 misconceptions about external validation of clinical prediction models.别被误导了:临床预测模型外部验证的 3 大误区。
J Clin Epidemiol. 2024 Aug;172:111387. doi: 10.1016/j.jclinepi.2024.111387. Epub 2024 May 8.
2
Availability and reporting quality of external validations of machine-learning prediction models with orthopedic surgical outcomes: a systematic review.机器学习预测模型在骨科手术结局中的外部验证的可用性和报告质量:系统评价。
Acta Orthop. 2021 Aug;92(4):385-393. doi: 10.1080/17453674.2021.1910448. Epub 2021 Apr 18.
3
A new framework to enhance the interpretation of external validation studies of clinical prediction models.一种增强临床预测模型外部验证研究解释的新框架。
J Clin Epidemiol. 2015 Mar;68(3):279-89. doi: 10.1016/j.jclinepi.2014.06.018. Epub 2014 Aug 30.
4
5
Is the generalizability of a developed artificial intelligence algorithm for COVID-19 on chest CT sufficient for clinical use? Results from the International Consortium for COVID-19 Imaging AI (ICOVAI).开发用于 COVID-19 胸部 CT 的人工智能算法的可推广性是否足以用于临床?来自 COVID-19 成像人工智能国际联合会(ICOVAI)的结果。
Eur Radiol. 2023 Jun;33(6):4249-4258. doi: 10.1007/s00330-022-09303-3. Epub 2023 Jan 18.
6
Prognostic models for newly-diagnosed chronic lymphocytic leukaemia in adults: a systematic review and meta-analysis.成人新诊断慢性淋巴细胞白血病的预后模型:一项系统评价和荟萃分析。
Cochrane Database Syst Rev. 2020 Jul 31;7(7):CD012022. doi: 10.1002/14651858.CD012022.pub2.
7
Establishment and validation of an interactive artificial intelligence platform to predict postoperative ambulatory status for patients with metastatic spinal disease: a multicenter analysis.建立和验证交互式人工智能平台,以预测转移性脊柱疾病患者的术后活动状态:一项多中心分析。
Int J Surg. 2024 May 1;110(5):2738-2756. doi: 10.1097/JS9.0000000000001169.
8
Real-Time Clinical Decision Support Based on Recurrent Neural Networks for In-Hospital Acute Kidney Injury: External Validation and Model Interpretation.基于循环神经网络的院内急性肾损伤实时临床决策支持:外部验证与模型解读
J Med Internet Res. 2021 Apr 16;23(4):e24120. doi: 10.2196/24120.
9
Clinical Prediction Rules That Don't Hold Up-Where to Go From Here?不成立的临床预测规则——接下来何去何从?
J Orthop Sports Phys Ther. 2016 Jul;46(7):502-5. doi: 10.2519/jospt.2016.0606.
10
Can Machine Learning Methods Produce Accurate and Easy-to-use Prediction Models of 30-day Complications and Mortality After Knee or Hip Arthroplasty?机器学习方法能否准确且易于使用地预测膝关节或髋关节置换术后 30 天的并发症和死亡率?
Clin Orthop Relat Res. 2019 Feb;477(2):452-460. doi: 10.1097/CORR.0000000000000601.

引用本文的文献

1
Prediction model developed on the basis of meta-analysis in the field of medicine: a systematic survey and methodological summaries.基于医学领域荟萃分析开发的预测模型:系统综述与方法总结。
BMC Med Res Methodol. 2025 Aug 9;25(1):194. doi: 10.1186/s12874-025-02639-6.
2
Validation of the prognostic model "oncologiq palliative" for head and neck cancer patients.头颈部癌症患者“oncologiq姑息治疗”预后模型的验证
Eur Arch Otorhinolaryngol. 2025 May 24. doi: 10.1007/s00405-025-09462-1.
3
Multiparametric models for predicting major arrhythmic events in Brugada syndrome: a systematic review and critical appraisal.
预测Brugada综合征主要心律失常事件的多参数模型:系统评价与批判性评估
Europace. 2025 May 7;27(5). doi: 10.1093/europace/euaf091.
4
Machine learning-based risk predictive models for diabetic kidney disease in type 2 diabetes mellitus patients: a systematic review and meta-analysis.基于机器学习的2型糖尿病患者糖尿病肾病风险预测模型:一项系统评价和荟萃分析。
Front Endocrinol (Lausanne). 2025 Mar 3;16:1495306. doi: 10.3389/fendo.2025.1495306. eCollection 2025.
5
From Prospective Evaluation to Practice: Model-Informed Dose Optimization in Oncology.从前瞻性评估到实践:肿瘤学中基于模型的剂量优化
Drugs. 2025 Apr;85(4):487-503. doi: 10.1007/s40265-025-02152-6. Epub 2025 Feb 12.
6
External validation of AI-based scoring systems in the ICU: a systematic review and meta-analysis.重症监护病房中基于人工智能的评分系统的外部验证:一项系统评价和荟萃分析。
BMC Med Inform Decis Mak. 2025 Jan 6;25(1):5. doi: 10.1186/s12911-024-02830-7.
7
Mortality Risk Prediction Models for People With Kidney Failure: A Systematic Review.肾衰竭患者的死亡风险预测模型:一项系统评价。
JAMA Netw Open. 2025 Jan 2;8(1):e2453190. doi: 10.1001/jamanetworkopen.2024.53190.
8
Machine-learning based prediction of appendicitis for patients presenting with acute abdominal pain at the emergency department.基于机器学习对急诊科急性腹痛患者阑尾炎的预测。
World J Emerg Surg. 2024 Dec 23;19(1):40. doi: 10.1186/s13017-024-00570-7.
9
Development, validation and recalibration of a prediction model for prediabetes: an EHR and NHANES-based study.糖尿病前期预测模型的开发、验证与重新校准:一项基于电子健康记录和美国国家健康与营养检查调查的研究
BMC Med Inform Decis Mak. 2024 Dec 18;24(1):387. doi: 10.1186/s12911-024-02803-w.
10
A Systematic Review of Artificial Intelligence Models for Time-to-Event Outcome Applied in Cardiovascular Disease Risk Prediction.人工智能模型在心血管疾病风险预测中应用的时间事件结局的系统评价。
J Med Syst. 2024 Jul 19;48(1):68. doi: 10.1007/s10916-024-02087-7.