Zhang Meng, Guo Moning, Wang Zihao, Liu Haimin, Bai Xue, Cui Shengnan, Guo Xiaopeng, Gao Lu, Gao Lingling, Liao Aimin, Xing Bing, Wang Yi
Department of Medical Records, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100730, China; National Center for Quality Control of Medical Records, Beijing 100730, China.
Beijing Municipal Health Big Data and Policy Research Center, Beijing 100034, China; Beijing Institute of Hospital Management, Beijing 100034, China.
Injury. 2023 Mar;54(3):896-903. doi: 10.1016/j.injury.2023.01.004. Epub 2023 Jan 4.
Few studies on early functional outcomes following acute care after traumatic brain injury (TBI) are available. The aim of this study was to develop and validate a predictive model for functional outcomes at discharge for TBI patients using machine learning methods.
In this retrospective study, data from 5281 TBI patients admitted for acute care who were identified in the Beijing hospital discharge abstract database were analysed. Data from 4181 patients in 52 tertiary hospitals were used for model derivation and internal validation. Data from 1100 patients in 21 secondary hospitals were used for external validation. A poor outcome was defined as a Barthel Index (BI) score ≤ 60 at discharge. Logistic regression, XGBoost, random forest, decision tree, and back propagation neural network models were used to fit classification models. Performance was evaluated by the area under the receiver operating characteristic curve (AUC), the area under the precision-recall curve (AP), calibration plots, sensitivity/recall, specificity, positive predictive value (PPV)/precision, negative predictive value (NPV) and F1-score.
Compared to the other models, the random forest model demonstrated superior performance in internal validation (AUC of 0.856, AP of 0.786, and F1-score of 0.724) and external validation (AUC of 0.779, AP of 0.630, and F1-score of 0.604). The sensitivity/recall, specificity, PPV/precision, and NPV of the model were 71.8%, 69.2%, 52.2%, and 84.0%, respectively, in external validation. The BI score at admission, age, use of nonsurgical treatment, neurosurgery status, and modified Charlson Comorbidity Index were identified as the top 5 predictors for functional outcome at discharge.
We established a random forest model that performed well in predicting early functional outcomes following acute care after TBI. The model has utility for informing decision-making regarding patient management and discharge planning and for facilitating health care quality assessment and resource allocation for TBI treatment.
关于创伤性脑损伤(TBI)急性护理后的早期功能结局的研究较少。本研究的目的是使用机器学习方法开发并验证一个针对TBI患者出院时功能结局的预测模型。
在这项回顾性研究中,分析了北京医院出院摘要数据库中5281例因急性护理入院的TBI患者的数据。来自52家三级医院的4181例患者的数据用于模型推导和内部验证。来自21家二级医院的1100例患者的数据用于外部验证。不良结局定义为出院时Barthel指数(BI)评分≤60。使用逻辑回归、XGBoost、随机森林、决策树和反向传播神经网络模型来拟合分类模型。通过受试者工作特征曲线下面积(AUC)、精确召回率曲线下面积(AP)、校准图、灵敏度/召回率、特异性、阳性预测值(PPV)/精确率、阴性预测值(NPV)和F1分数来评估性能。
与其他模型相比,随机森林模型在内部验证(AUC为0.856,AP为0.786,F1分数为0.724)和外部验证(AUC为0.779,AP为0.630,F1分数为0.604)中表现出卓越性能!在外部验证中,该模型的灵敏度/召回率、特异性、PPV/精确率和NPV分别为71.8%、69.2%、52.2%和84.0%。入院时的BI评分、年龄、非手术治疗的使用、神经外科手术状态和改良Charlson合并症指数被确定为出院时功能结局的前5个预测因素。
我们建立了一个在预测TBI急性护理后的早期功能结局方面表现良好的随机森林模型。该模型有助于为患者管理和出院计划提供决策依据,并促进TBI治疗的医疗质量评估和资源分配。