Wee Caitlin Fern, Tan Claire Jing-Wen, Yau Chun En, Teo Yao Hao, Go Rachel, Teo Yao Neng, Jyn Benjamin Kye, Syn Nicholas L, Sim Hui-Wen, Chen Jason Z, Wong Raymond C C, Yip James W, Tan Huay-Cheem, Yeo Tiong-Cheng, Chai Ping, Li Tony Y W, Yeung Wesley L, Djohan Andie H, Sia Ching-Hui
Department of Medicine, Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
Department of Cardiology, National University Heart Centre Singapore, Singapore.
AsiaIntervention. 2024 Sep 27;10(3):219-232. doi: 10.4244/AIJ-D-23-00023. eCollection 2024 Sep.
Recent studies have shown potential in introducing machine learning (ML) algorithms to predict outcomes post-percutaneous coronary intervention (PCI).
We aimed to critically appraise current ML models' effectiveness as clinical tools to predict outcomes post-PCI.
Searches of four databases were conducted for articles published from the database inception date to 29 May 2021. Studies using ML to predict outcomes post-PCI were included. For individual post-PCI outcomes, measures of diagnostic accuracy were extracted. An adapted checklist comprising existing frameworks for new risk markers, diagnostic accuracy, prognostic tools and ML was used to critically appraise the included studies along the stages of the translational pathway: development, validation, and impact. Quality of training data and methods of dealing with missing data were evaluated.
Twelve cohorts from 11 studies were included with a total of 4,943,425 patients. ML models performed with high diagnostic accuracy. However, there are concerns over the development of the ML models. Methods of dealing with missing data were problematic. Four studies did not discuss how missing data were handled. One study removed patients if any of the predictor variable data points were missing. Moreover, at the validation stage, only three studies externally validated the models presented. There could be concerns over the applicability of these models. None of the studies discussed the cost-effectiveness of implementing the models.
ML models show promise as a useful clinical adjunct to traditional risk stratification scores in predicting outcomes post-PCI. However, significant challenges need to be addressed before ML can be integrated into clinical practice.
最近的研究表明,引入机器学习(ML)算法来预测经皮冠状动脉介入治疗(PCI)后的结果具有潜力。
我们旨在严格评估当前ML模型作为预测PCI后结果的临床工具的有效性。
对四个数据库进行检索,以查找从数据库起始日期到2021年5月29日发表的文章。纳入使用ML预测PCI后结果的研究。对于个体PCI后结果,提取诊断准确性的指标。使用一个改编的清单,该清单包括新风险标志物、诊断准确性、预后工具和ML的现有框架,以沿着转化途径的各个阶段(开发、验证和影响)对纳入的研究进行严格评估。评估训练数据的质量和处理缺失数据的方法。
纳入了11项研究中的12个队列,共有4,943,425名患者。ML模型具有较高的诊断准确性。然而,人们对ML模型的开发存在担忧。处理缺失数据的方法存在问题。四项研究未讨论如何处理缺失数据。一项研究在任何预测变量数据点缺失时就将患者排除。此外,在验证阶段,只有三项研究对所提出的模型进行了外部验证。这些模型的适用性可能令人担忧。没有一项研究讨论实施这些模型的成本效益。
在预测PCI后结果方面,ML模型有望成为传统风险分层评分的有用临床辅助工具。然而,在ML能够整合到临床实践之前,需要解决重大挑战。