Liu Jun, Xu Lingxiao, Zhu Enzhao, Han Chunxia, Ai Zisheng
Department of Medical Statistics, Tongji University School of Medicine, Shanghai, China.
Front Surg. 2022 Jul 26;9:928750. doi: 10.3389/fsurg.2022.928750. eCollection 2022.
Acute kidney injury (AKI) is a common complication associated with significant morbidity and mortality in high-energy trauma patients. Given the poor efficacy of interventions after AKI development, it is important to predict AKI before its diagnosis. Therefore, this study aimed to develop models using machine learning algorithms to predict the risk of AKI in patients with femoral neck fractures.
We developed machine-learning models using the Medical Information Mart from Intensive Care (MIMIC)-IV database. AKI was predicted using 10 predictive models in three-time windows, 24, 48, and 72 h. Three optimal models were selected according to the accuracy and area under the receiver operating characteristic curve (AUROC), and the hyperparameters were adjusted using a random search algorithm. The Shapley additive explanation (SHAP) analysis was used to determine the impact and importance of each feature on the prediction. Compact models were developed using important features chosen based on their SHAP values and clinical availability. Finally, we evaluated the models using metrics such as accuracy, precision, AUROC, recall, F1 scores, and kappa values on the test set after hyperparameter tuning.
A total of 1,596 patients in MIMIC-IV were included in the final cohort, and 402 (25%) patients developed AKI after surgery. The light gradient boosting machine (LightGBM) model showed the best overall performance for predicting AKI before 24, 48, and 72 h. AUROCs were 0.929, 0.862, and 0.904. The SHAP value was used to interpret the prediction models. Renal function markers and perioperative blood transfusions are the most critical features for predicting AKI. In compact models, LightGBM still performs the best. AUROCs were 0.930, 0.859, and 0.901.
In our analysis, we discovered that LightGBM had the best metrics among all algorithms used. Our study identified the LightGBM as a solid first-choice algorithm for early AKI prediction in patients after femoral neck fracture surgery.
急性肾损伤(AKI)是高能创伤患者常见的并发症,与显著的发病率和死亡率相关。鉴于AKI发生后干预措施的疗效不佳,在诊断前预测AKI很重要。因此,本研究旨在使用机器学习算法开发模型,以预测股骨颈骨折患者发生AKI的风险。
我们使用重症监护医学信息集市(MIMIC)-IV数据库开发了机器学习模型。在三个时间窗口(24、48和72小时)使用10个预测模型预测AKI。根据准确性和受试者工作特征曲线下面积(AUROC)选择三个最优模型,并使用随机搜索算法调整超参数。使用Shapley加性解释(SHAP)分析来确定每个特征对预测的影响和重要性。使用基于SHAP值和临床可用性选择的重要特征开发紧凑模型。最后,在超参数调整后,我们使用准确性、精确性、AUROC、召回率、F1分数和kappa值等指标在测试集上评估模型。
最终队列纳入了MIMIC-IV中的1596例患者,402例(25%)患者术后发生AKI。轻梯度提升机(LightGBM)模型在预测24、48和72小时前的AKI方面总体表现最佳。AUROC分别为0.929、0.862和0.904。使用SHAP值解释预测模型。肾功能标志物和围手术期输血是预测AKI的最关键特征。在紧凑模型中,LightGBM仍然表现最佳。AUROC分别为0.930、0.859和0.901。
在我们的分析中,我们发现LightGBM在所有使用的算法中指标最佳。我们的研究确定LightGBM是股骨颈骨折手术后患者早期AKI预测的可靠首选算法。