Department of Research and Development, Seers Technology Co, Ltd, Pyeongtaek, Republic of Korea.
Department of Brain and Cognitive Engineering, Korea University, Seoul, Republic of Korea.
J Med Internet Res. 2023 Dec 22;25:e48244. doi: 10.2196/48244.
Cardiac arrest (CA) is the leading cause of death in critically ill patients. Clinical research has shown that early identification of CA reduces mortality. Algorithms capable of predicting CA with high sensitivity have been developed using multivariate time series data. However, these algorithms suffer from a high rate of false alarms, and their results are not clinically interpretable.
We propose an ensemble approach using multiresolution statistical features and cosine similarity-based features for the timely prediction of CA. Furthermore, this approach provides clinically interpretable results that can be adopted by clinicians.
Patients were retrospectively analyzed using data from the Medical Information Mart for Intensive Care-IV database and the eICU Collaborative Research Database. Based on the multivariate vital signs of a 24-hour time window for adults diagnosed with heart failure, we extracted multiresolution statistical and cosine similarity-based features. These features were used to construct and develop gradient boosting decision trees. Therefore, we adopted cost-sensitive learning as a solution. Then, 10-fold cross-validation was performed to check the consistency of the model performance, and the Shapley additive explanation algorithm was used to capture the overall interpretability of the proposed model. Next, external validation using the eICU Collaborative Research Database was performed to check the generalization ability.
The proposed method yielded an overall area under the receiver operating characteristic curve (AUROC) of 0.86 and area under the precision-recall curve (AUPRC) of 0.58. In terms of the timely prediction of CA, the proposed model achieved an AUROC above 0.80 for predicting CA events up to 6 hours in advance. The proposed method simultaneously improved precision and sensitivity to increase the AUPRC, which reduced the number of false alarms while maintaining high sensitivity. This result indicates that the predictive performance of the proposed model is superior to the performances of the models reported in previous studies. Next, we demonstrated the effect of feature importance on the clinical interpretability of the proposed method and inferred the effect between the non-CA and CA groups. Finally, external validation was performed using the eICU Collaborative Research Database, and an AUROC of 0.74 and AUPRC of 0.44 were obtained in a general intensive care unit population.
The proposed framework can provide clinicians with more accurate CA prediction results and reduce false alarm rates through internal and external validation. In addition, clinically interpretable prediction results can facilitate clinician understanding. Furthermore, the similarity of vital sign changes can provide insights into temporal pattern changes in CA prediction in patients with heart failure-related diagnoses. Therefore, our system is sufficiently feasible for routine clinical use. In addition, regarding the proposed CA prediction system, a clinically mature application has been developed and verified in the future digital health field.
心脏骤停(CA)是危重病患者死亡的主要原因。临床研究表明,早期识别 CA 可降低死亡率。已经使用多变量时间序列数据开发了能够高度敏感地预测 CA 的算法。然而,这些算法存在高误报率,并且其结果无法临床解释。
我们提出了一种使用多分辨率统计特征和基于余弦相似度的特征的集成方法,用于及时预测 CA。此外,该方法提供了临床可解释的结果,可供临床医生采用。
使用来自 Medical Information Mart for Intensive Care-IV 数据库和 eICU 合作研究数据库的成人心力衰竭诊断患者的数据进行回顾性分析。基于成人 24 小时时间窗的多变量生命体征,我们提取了多分辨率统计和基于余弦相似度的特征。这些特征用于构建和开发梯度提升决策树。因此,我们采用成本敏感学习作为解决方案。然后,进行 10 折交叉验证以检查模型性能的一致性,并使用 Shapley 加性解释算法捕获所提出模型的整体可解释性。接下来,使用 eICU 合作研究数据库进行外部验证,以检查泛化能力。
所提出的方法在接收器工作特征曲线(AUROC)下的总体面积为 0.86,精度-召回曲线(AUPRC)下的面积为 0.58。就 CA 的及时预测而言,所提出的模型在提前 6 小时预测 CA 事件方面的 AUROC 超过 0.80。该方法同时提高了精度和灵敏度,以提高 AUPRC,从而在保持高灵敏度的同时减少误报数量。这一结果表明,所提出模型的预测性能优于以前研究报告的模型的性能。接下来,我们展示了特征重要性对所提出方法的临床可解释性的影响,并推断了非 CA 组和 CA 组之间的影响。最后,使用 eICU 合作研究数据库进行外部验证,在一般重症监护病房人群中获得了 0.74 的 AUROC 和 0.44 的 AUPRC。
通过内部和外部验证,所提出的框架可以为临床医生提供更准确的 CA 预测结果,并降低误报率。此外,临床可解释的预测结果可以帮助临床医生理解。此外,生命体征变化的相似性可以为心力衰竭相关诊断患者的 CA 预测的时间模式变化提供见解。因此,我们的系统非常适合常规临床使用。此外,关于所提出的 CA 预测系统,已经在未来的数字健康领域开发并验证了一个临床成熟的应用程序。