Lin K, Xie J Q, Hu Y H, Kong G L
Department of Epidemiology and Biostatistics, Peking University School of Public Health, Beijing 100191, China; Medical Informatics Center, Peking University, Beijing 100191, China.
Medical Informatics Center, Peking University, Beijing 100191, China.
Beijing Da Xue Xue Bao Yi Xue Ban. 2018 Apr 18;50(2):239-244.
To construct an in-hospital mortality prediction model for patients with acute kidney injury (AKI) in intensive care unit (ICU) by using support vector machine (SVM), and compare it with the simplified acute physiology score II (SAPS-II) which is commonly used in the ICU.
We used Medical Information Mart for Intensive Care III (MIMIC-III) database as data source. The AKI patients in the MIMIC-III database were selected according to the 2012 Kidney Disease: Improving Global Outcomes (KDIGO) definition of AKI. We employed the same predictor variable set as used in SAPS-II to construct an SVM model. Meanwhile, we also developed a customized SAPS-II model using MIMIC-III database, and compared performances between the SVM model and the customized SAPS-II model. The performance of each model was evaluated via area under the receiver operation characteristic curve (AUROC), root mean squared error (RMSE), sensitivity, specificity, Youden's index and accuracy based on 5-fold cross-validation. The agreement of the results between the SVM model and the customized SAPS-II model was illustrated using Bland-Altman plots.
A total number of 19 044 patients with AKI were included. The observed in-hospital mortality of the AKI patients was 13.58% in MIMIC-III. The results based on the 5-fold cross validation showed that the average AUROC of the SVM model and the customized SAPS-II model was 0.86 and 0.81, respectively (The difference between the two models was statistically significant with t=13.0, P<0.001). The average RMSE of the SVM model and the customized SAPS-II model was 0.29 and 0.31, respectively (The difference was statistically significant with t=-9.6, P<0.001). The SVM model also outperformed the customized SAPS-II model in terms of sensitivity and Youden's index with significant statistical differences (P=0.002 and <0.001, respectively).The Bland-Altman plot showed that the SVM model and the customized SAPS-II model had similar mortality prediction results when the mortality of a patient was certain, but the consistency between the mortality prediction results of the two models was poor when the mortality of a patient was with high uncertainty.
Compared with the SAPS-II model, the SVM model has a better performance, especially when the mortality of a patient is with high uncertainty. The SVM model is more suitable for predicting the mortality of patients with AKI in ICU and early intervention in patients with AKI in ICU. The SVM model can effectively help ICU clinicians improve the quality of medical treatment, which has high clinical value.
运用支持向量机(SVM)构建重症监护病房(ICU)急性肾损伤(AKI)患者的院内死亡预测模型,并与ICU常用的简化急性生理学评分II(SAPS-II)进行比较。
我们将重症监护医学信息集市III(MIMIC-III)数据库作为数据源。根据2012年改善全球肾脏病预后组织(KDIGO)对AKI的定义,从MIMIC-III数据库中选取AKI患者。我们采用与SAPS-II相同的预测变量集来构建SVM模型。同时,我们还使用MIMIC-III数据库开发了一个定制的SAPS-II模型,并比较了SVM模型与定制的SAPS-II模型的性能。基于5折交叉验证,通过受试者操作特征曲线下面积(AUROC)、均方根误差(RMSE)、敏感性、特异性、约登指数和准确性来评估每个模型的性能。使用Bland-Altman图展示SVM模型与定制的SAPS-II模型结果之间的一致性。
共纳入19044例AKI患者。在MIMIC-III中,AKI患者的观察到的院内死亡率为13.58%。基于5折交叉验证的结果显示,SVM模型和定制的SAPS-II模型的平均AUROC分别为0.86和0.81(两模型之间的差异具有统计学意义,t = 13.0,P < 0.001)。SVM模型和定制的SAPS-II模型的平均RMSE分别为0.29和0.31(差异具有统计学意义,t = -9.6,P < 0.001)。SVM模型在敏感性和约登指数方面也优于定制的SAPS-II模型,具有显著的统计学差异(分别为P = 0.002和<0.001)。Bland-Altman图显示,当患者死亡率确定时,SVM模型和定制的SAPS-II模型的死亡率预测结果相似,但当患者死亡率具有高不确定性时,两模型死亡率预测结果之间的一致性较差。
与SAPS-II模型相比,SVM模型具有更好的性能,尤其是当患者死亡率具有高不确定性时。SVM模型更适合预测ICU中AKI患者的死亡率,并对ICU中AKI患者进行早期干预。SVM模型可以有效地帮助ICU临床医生提高医疗质量,具有较高的临床价值。