Park Hye Yoon, Sohn Hyoju, Hong Arum, Han Soo Wan, Jang Yuna, Yoon EKyong, Kim Myeongju, Park Hye Youn
Department of Psychiatry, Seoul National University Hospital, Seoul National University College of Medicine, South Korea; Department of Psychiatry, Seoul National University College of Medicine, South Korea.
Center for Artificial Intelligence in Healthcare, Seoul National University Bundang Hospital Healthcare Innovation Park, South Korea.
Int J Med Inform. 2025 Mar;195:105747. doi: 10.1016/j.ijmedinf.2024.105747. Epub 2024 Dec 1.
The incidence of delirium in hospitalized coronavirus disease 2019 (COVID-19) patients is linked to adverse health outcomes. Predicting the occurrence and risk factors of delirium is key to preventing its sudden onset.
To explore the factors associated with delirium in hospitalized COVID-19 patients and to compare the performance of various machine learning (ML) techniques for future use in predicting delirium.
We analyzed a dataset of 1,031 cases from two healthcare centers, which included 178 variables such as demographics, clinical data, and medication information. The ML techniques used in this study were extreme gradient boosting (XGB), light gradient boosting machine (LGBM), logistic regression (LR), random forest (RF), and support vector machine (SVM).
The RF model emerged as the most effective for predicting delirium, achieving an area under the curve (AUC) of 0.923. It showed a sensitivity of 0.639, accuracy of 0.900, specificity of 0.934, positive predictive value (PPV) of 0.561, negative predictive value (NPV) of 0.952, and an F1 score of 0.597. The RF model identified key variables related to delirium, including medication type (antipsychotic, sedative, opioid), duration of hospital stay, remdesivir usage, and patient age. The reliability of the model was affirmed through calibration plots and Brier score evaluations.
This research developed and validated an RF-based ML model for predicting delirium in hospitalized COVID-19 patients. The model demonstrates superior accuracy and reliability compared to other ML methods and would possibly serve as a valuable tool for managing and anticipating delirium in COVID-19 patients, with the potential to enhance patient outcomes.
2019年冠状病毒病(COVID-19)住院患者中谵妄的发生率与不良健康结局相关。预测谵妄的发生及风险因素是预防其突然发作的关键。
探讨COVID-19住院患者谵妄的相关因素,并比较各种机器学习(ML)技术在未来预测谵妄中的性能。
我们分析了来自两个医疗中心的1031例病例的数据集,其中包括人口统计学、临床数据和用药信息等178个变量。本研究中使用的ML技术有极端梯度提升(XGB)、轻量级梯度提升机(LGBM)、逻辑回归(LR)、随机森林(RF)和支持向量机(SVM)。
RF模型在预测谵妄方面最为有效,曲线下面积(AUC)为0.923。其灵敏度为0.639,准确率为0.900,特异性为0.934,阳性预测值(PPV)为0.561,阴性预测值(NPV)为0.952,F1分数为0.597。RF模型识别出了与谵妄相关的关键变量,包括药物类型(抗精神病药、镇静剂、阿片类药物)、住院时间、瑞德西韦的使用情况和患者年龄。通过校准图和Brier评分评估证实了该模型的可靠性。
本研究开发并验证了一种基于RF的ML模型,用于预测COVID-19住院患者的谵妄。与其他ML方法相比,该模型具有更高的准确性和可靠性,可能成为管理和预测COVID-19患者谵妄的有价值工具,具有改善患者结局的潜力。