Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA.
Department of Psychosocial Oncology and Palliative Care, Dana-Farber Cancer Institute, Boston, Massachusetts, USA.
J Am Med Inform Assoc. 2021 Jul 30;28(8):1660-1666. doi: 10.1093/jamia/ocab051.
Electronic health record documentation by intensive care unit (ICU) clinicians may predict patient outcomes. However, it is unclear whether physician and nursing notes differ in their ability to predict short-term ICU prognosis. We aimed to investigate and compare the ability of physician and nursing notes, written in the first 48 hours of admission, to predict ICU length of stay and mortality using 3 analytical methods.
This was a retrospective cohort study with split sampling for model training and testing. We included patients ≥18 years of age admitted to the ICU at Beth Israel Deaconess Medical Center in Boston, Massachusetts, from 2008 to 2012. Physician or nursing notes generated within the first 48 hours of admission were used with standard machine learning methods to predict outcomes.
For the primary outcome of composite score of ICU length of stay ≥7 days or in-hospital mortality, the gradient boosting model had better performance than the logistic regression and random forest models. Nursing and physician notes achieved area under the curves (AUCs) of 0.826 and 0.796, respectively, with even better predictive power when combined (AUC, 0.839).
Models using only nursing notes more accurately predicted short-term prognosis than did models using only physician notes, but in combination, the models achieved the greatest accuracy in prediction.
Our findings demonstrate that statistical models derived from text analysis in the first 48 hours of ICU admission can predict patient outcomes. Physicians' and nurses' notes are both uniquely important in mortality prediction and combining these notes can produce a better predictive model.
重症监护病房(ICU)临床医生的电子病历记录可能预测患者的预后。然而,目前尚不清楚医生和护理记录在预测短期 ICU 预后方面的能力是否存在差异。我们旨在使用 3 种分析方法,研究和比较入院后 48 小时内书写的医生和护理记录在预测 ICU 住院时间和死亡率方面的能力。
这是一项回顾性队列研究,采用拆分样本进行模型训练和测试。我们纳入了 2008 年至 2012 年期间在马萨诸塞州波士顿贝斯以色列女执事医疗中心 ICU 住院的年龄≥18 岁的患者。使用标准机器学习方法,根据入院后 48 小时内生成的医生或护理记录来预测结果。
对于 ICU 住院时间≥7 天或院内死亡率的复合评分这一主要结局,梯度提升模型的性能优于逻辑回归和随机森林模型。护理记录和医生记录的曲线下面积(AUC)分别为 0.826 和 0.796,当两者结合时,预测能力甚至更好(AUC 为 0.839)。
仅使用护理记录的模型比仅使用医生记录的模型更准确地预测短期预后,但联合使用时,这些模型在预测方面的准确性更高。
我们的研究结果表明,基于 ICU 入院后 48 小时内文本分析的统计模型可以预测患者的预后。医生和护士的记录在死亡率预测方面都具有独特的重要性,将这些记录结合起来可以产生更好的预测模型。