Lezama Jose L, Alterovitz Gil, Jakey Colleen E, Kraus Ana L, Kim Michael J, Borkowski Andrew A
James A. Haley Veterans' Hospital, United States Department of Veterans Affairs, Tampa, FL, United States.
Division of General Internal Medicine, Department of Internal Medicine, Morsani College of Medicine, USF Health, Tampa, FL, United States.
Front Artif Intell. 2023 Aug 2;6:1191320. doi: 10.3389/frai.2023.1191320. eCollection 2023.
In order to address a long standing challenge for internal medicine physicians we developed artificial intelligence (AI) models to identify patients at risk of increased mortality. After querying 2,425 records of patients transferred from non-intensive care units to intensive care units from the Veteran Affairs Corporate Data Warehouse (CDW), we created two datasets. The former used 22 independent variables that included "Length of Hospital Stay" and "Days to Intensive Care Transfer," and the latter lacked these two variables. Since these two variables are unknown at the time of admission, the second set is more clinically relevant. We trained 16 machine learning models using both datasets. The best-performing models were fine-tuned and evaluated. The LightGBM model achieved the best results for both datasets. The model trained with 22 variables achieved a Receiver Operating Characteristics Curve-Area Under the Curve (ROC-AUC) of 0.89 and an accuracy of 0.72, with a sensitivity of 0.97 and a specificity of 0.68. The model trained with 20 variables achieved a ROC-AUC of 0.86 and an accuracy of 0.71, with a sensitivity of 0.94 and a specificity of 0.67. The top features for the former model included "Total length of Stay," "Admit to ICU Transfer Days," and "Lymphocyte Next Lab Value." For the latter model, the top features included "Lymphocyte First Lab Value," "Hemoglobin First Lab Value," and "Hemoglobin Next Lab Value." Our clinically relevant predictive mortality model can assist providers in optimizing resource utilization when managing large caseloads, particularly during shift changes.
为应对内科医生长期面临的一项挑战,我们开发了人工智能(AI)模型来识别死亡风险增加的患者。在查询了退伍军人事务部企业数据仓库(CDW)中从非重症监护病房转入重症监护病房的2425例患者的记录后,我们创建了两个数据集。前者使用了22个独立变量,包括“住院时间”和“转入重症监护病房的天数”,后者则缺少这两个变量。由于这两个变量在入院时是未知的,所以第二组数据集在临床上更具相关性。我们使用这两个数据集训练了16个机器学习模型。对表现最佳的模型进行了微调并评估。LightGBM模型在两个数据集上均取得了最佳结果。使用22个变量训练的模型的受试者工作特征曲线下面积(ROC-AUC)为0.89,准确率为0.72,灵敏度为0.97,特异度为0.68。使用20个变量训练的模型的ROC-AUC为0.86,准确率为0.71,灵敏度为0.94,特异度为0.67。前一个模型的顶级特征包括“总住院时间”“入院至转入重症监护病房的天数”和“下一次实验室检查的淋巴细胞值”。后一个模型的顶级特征包括“首次实验室检查的淋巴细胞值”“首次实验室检查的血红蛋白值”和“下一次实验室检查的血红蛋白值”。我们具有临床相关性的预测死亡率模型可以帮助医疗服务提供者在管理大量病例时优化资源利用,尤其是在轮班期间。