Gupta Ankit, Chauhan Ruchi, G Saravanan, Shreekumar Ananth
Center for Innovation in Diagnostics, Siemens Healthcare Private Limited, Bangalore, India.
PLOS Digit Health. 2024 Aug 12;3(8):e0000569. doi: 10.1371/journal.pdig.0000569. eCollection 2024 Aug.
Prediction of sepsis using machine-learning approaches has recently gained traction. However, the lack of translation of these algorithms into clinical routine remains a major issue. Existing early sepsis detection methods are either based on the older definition of sepsis or do not accurately detect sepsis leading to the high frequency of false-positive alarms. This results in a well-known issue of clinicians' "alarm fatigue", leading to decreased responsiveness and identification, ultimately resulting in delayed clinical intervention. Hence, there is a fundamental, unmet need for a clinical decision system capable of accurate and timely sepsis diagnosis, running at the point of need. In this work, SepsisAI-a deep-learning algorithm based on long short-term memory (LSTM) networks was developed to predict the early onset of hospital-acquired sepsis in real-time for patients admitted to the ICU. The models are trained and validated with data from the PhysioNet Challenge, consisting of 40,336 patient data files from two healthcare systems: Beth Israel Deaconess Medical Center and Emory University Hospital. In the short term, the algorithm tracks frequently measured vital signs, sparsely available lab parameters, demographic features, and certain derived features for making predictions. A real-time alert system, which monitors the trajectory of the predictions, is developed on top of the deep-learning framework to minimize false alarms. On a balanced test dataset, the model achieves an AUROC, AUPRC, sensitivity, and specificity of 0.95, 0.96, 88.19%, and 96.75%, respectively at the patient level. In terms of lookahead time, the model issues a warning at a median of 6 hours (IQR 6 to 20 hours) and raises an alert at a median of 4 hours (IQR 2 to 5 hours) ahead of sepsis onset. Most importantly, the model achieves a false-alarm ratio of 3.18% for alerts, which is significantly less than other sepsis alarm systems. Additionally, on a disease prevalence-based test set, the algorithm reported similar outcomes with AUROC and AUPRC of 0.94 and 0.87, respectively, with sensitivity, and specificity of 97.05%, and 96.75%, respectively. The proposed algorithm might serve as a clinical decision support system to assist clinicians in the accurate and timely diagnosis of sepsis. With exceptionally high specificity and low false-alarm rate, this algorithm also helps mitigate the well-known issue of clinician alert fatigue arising from currently proposed sepsis alarm systems. Consequently, the algorithm partially addresses the challenges of successfully integrating machine-learning algorithms into routine clinical care.
使用机器学习方法预测脓毒症最近受到了关注。然而,这些算法未能转化为临床常规应用仍然是一个主要问题。现有的早期脓毒症检测方法要么基于脓毒症的旧定义,要么不能准确检测脓毒症,导致假阳性警报的频率很高。这就导致了临床医生“警报疲劳”这一众所周知的问题,进而导致反应性和识别能力下降,最终导致临床干预延迟。因此,迫切需要一种能够在需要时准确及时地诊断脓毒症的临床决策系统。在这项工作中,开发了SepsisAI——一种基于长短期记忆(LSTM)网络的深度学习算法,用于实时预测入住重症监护病房(ICU)患者医院获得性脓毒症的早期发作。这些模型使用来自PhysioNet挑战赛的数据进行训练和验证,该挑战赛包含来自两个医疗系统(贝斯以色列女执事医疗中心和埃默里大学医院)的40336个患者数据文件。短期内,该算法跟踪频繁测量的生命体征、稀疏可用的实验室参数、人口统计学特征和某些派生特征以进行预测。在深度学习框架之上开发了一个实时警报系统,该系统监测预测轨迹以尽量减少误报。在一个平衡的测试数据集上,该模型在患者层面的受试者工作特征曲线下面积(AUROC)、精确率均值与召回率均值曲线下面积(AUPRC)、灵敏度和特异性分别达到0.95、0.96、88.19%和96.75%。在提前预测时间方面,该模型在脓毒症发作前中位数为6小时(四分位距为6至20小时)发出警告,中位数为4小时(四分位距为2至5小时)发出警报。最重要的是,该模型警报的误报率为3.18%,明显低于其他脓毒症警报系统。此外,在基于疾病患病率的测试集上,该算法报告的结果相似,AUROC和AUPRC分别为0.94和0.87,灵敏度和特异性分别为97.05%和96.75%。所提出的算法可以作为一种临床决策支持系统,帮助临床医生准确及时地诊断脓毒症。该算法具有极高的特异性和低误报率,也有助于缓解当前脓毒症警报系统引起的临床医生警报疲劳这一众所周知的问题。因此,该算法部分解决了将机器学习算法成功整合到常规临床护理中的挑战。