Shanghai Artificial Intelligence Laboratory, Shanghai, China.
Sensetime, Shanghai, China.
Int J Med Inform. 2023 Sep;177:105151. doi: 10.1016/j.ijmedinf.2023.105151. Epub 2023 Jul 11.
Accurate prediction of prognostic outcomes in patients with COVID-19 could facilitate clinical decision-making and medical resource allocation. However, little is known about the ability of machine learning (ML) to predict prognosis in COVID-19 patients.
This study aimed to systematically examine the prognostic value of ML in patients with COVID-19.
A systematic search was conducted in PubMed, Web of Science, Embase, Cochrane Library, and IEEE Xplore up to December 15, 2021. Studies predicting the prognostic outcomes of COVID-19 patients using ML were eligible for inclusion. Risk of bias was evaluated by a tailored checklist based on Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Pooled sensitivity, specificity, and area under the receiver operating curve (AUC) were calculated to evaluate model performance.
A total of 33 studies that described 35 models were eligible for inclusion, with 27 models presenting mortality, four intensive care unit (ICU) admission, and four use of ventilation. For predicting mortality, ML gave a pooled sensitivity of 0.86 (95% CI, 0.79-0.90), a specificity of 0.87 (95% CI, 0.80-0.92), and an AUC of 0.93 (95% CI, 0.90-0.95). For the prediction of ICU admission, ML had a sensitivity of 0.86 (95% CI, 0.78-0.92), a specificity of 0.81 (95% CI, 0.66-0.91), and an AUC of 0.91 (95% CI, 0.88-0.93). For the prediction of ventilation, ML had a sensitivity of 0.81 (95% CI, 0.68-0.90), a specificity of 0.78 (95% CI, 0.66-0.87), and an AUC of 0.87 (95% CI, 0.83-0.89). Meta-regression analyses indicated that algorithm, population, study design, and source of dataset influenced the pooled estimate.
This meta-analysis demonstrated the satisfactory performance of ML in predicting prognostic outcomes in patients with COVID-19, suggesting the potential value of ML to support clinical decision-making. However, improvements to methodology and validation are still necessary before its application in routine clinical practice.
准确预测 COVID-19 患者的预后结果有助于临床决策和医疗资源的分配。然而,关于机器学习(ML)预测 COVID-19 患者预后的能力知之甚少。
本研究旨在系统评估 ML 在 COVID-19 患者预后预测中的价值。
系统检索 PubMed、Web of Science、Embase、Cochrane 图书馆和 IEEE Xplore 数据库,检索时间截至 2021 年 12 月 15 日。纳入使用 ML 预测 COVID-19 患者预后结果的研究。采用基于诊断准确性研究质量评估 2 版(QUADAS-2)的定制检查表评估偏倚风险。计算合并敏感性、特异性和受试者工作特征曲线下面积(AUC)以评估模型性能。
共纳入 33 项研究,涉及 35 个模型,其中 27 个模型预测死亡率,4 个模型预测 ICU 入院,4 个模型预测呼吸机使用。对于预测死亡率,ML 的合并敏感性为 0.86(95%CI,0.79-0.90),特异性为 0.87(95%CI,0.80-0.92),AUC 为 0.93(95%CI,0.90-0.95)。对于预测 ICU 入院,ML 的敏感性为 0.86(95%CI,0.78-0.92),特异性为 0.81(95%CI,0.66-0.91),AUC 为 0.91(95%CI,0.88-0.93)。对于预测呼吸机使用,ML 的敏感性为 0.81(95%CI,0.68-0.90),特异性为 0.78(95%CI,0.66-0.87),AUC 为 0.87(95%CI,0.83-0.89)。元回归分析表明,算法、人群、研究设计和数据集来源影响合并估计值。
本荟萃分析表明,ML 在预测 COVID-19 患者预后结果方面具有良好的性能,提示 ML 具有支持临床决策的潜在价值。然而,在将其应用于常规临床实践之前,仍需要改进方法和验证。