Oei Chien Wei, Chan Yam Meng, Zhang Xiaojin, Leo Kee Hao, Yong Enming, Chong Rhan Chaen, Hong Qiantai, Zhang Li, Pan Ying, Tan Glenn Wei Leong, Mak Malcolm Han Wen
Management Information Department, Office of Clinical Epidemiology, Analytics and Knowledge, Tan Tock Seng Hospital, Singapore.
Department of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore.
J Diabetes Sci Technol. 2024 Jan 30:19322968241228606. doi: 10.1177/19322968241228606.
Diabetic foot ulcers (DFUs) are serious complications of diabetes which can lead to lower extremity amputations (LEAs). Risk prediction models can identify high-risk patients who can benefit from early intervention. Machine learning (ML) methods have shown promising utility in medical applications. Explainable modeling can help its integration and acceptance. This study aims to develop a risk prediction model using ML algorithms with explainability for LEA in DFU patients.
This study is a retrospective review of 2559 inpatient DFU episodes in a tertiary institution from 2012 to 2017. Fifty-one features including patient demographics, comorbidities, medication, wound characteristics, and laboratory results were reviewed. Outcome measures were the risk of major LEA, minor LEA and any LEA. Machine learning models were developed for each outcome, with model performance evaluated using receiver operating characteristic (ROC) curves, balanced-accuracy and F1-score. SHapley Additive exPlanations (SHAP) was applied to interpret the model for explainability.
Model performance for prediction of major, minor, and any LEA event achieved ROC of 0.820, 0.637, and 0.756, respectively, with XGBoost, XGBoost, and Gradient Boosted Trees algorithms demonstrating best results for each model, respectively. Using SHAP, key features that contributed to the predictions were identified for explainability. Total white cell (TWC) count, comorbidity score and red blood cell count contributed highest weightage to major LEA event. Total white cell, eosinophils, and necrotic eschar in the wound contributed most to any LEA event.
Machine learning algorithms performed well in predicting the risk of LEA in a patient with DFU. Explainability can help provide clinical insights and identify at-risk patients for early intervention.
糖尿病足溃疡(DFU)是糖尿病的严重并发症,可导致下肢截肢(LEA)。风险预测模型可以识别出能从早期干预中获益的高危患者。机器学习(ML)方法在医学应用中已显示出有前景的效用。可解释建模有助于其整合与接受。本研究旨在使用具有可解释性的ML算法为DFU患者开发LEA风险预测模型。
本研究是对一家三级医疗机构2012年至2017年期间2559例住院DFU病例的回顾性分析。回顾了51项特征,包括患者人口统计学、合并症、用药情况、伤口特征和实验室检查结果。结局指标为大截肢、小截肢和任何截肢的风险。针对每个结局指标开发了机器学习模型,并使用受试者工作特征(ROC)曲线、平衡准确度和F1分数评估模型性能。应用SHapley值加法解释(SHAP)来解释模型以实现可解释性。
预测大截肢、小截肢和任何截肢事件的模型性能分别达到ROC为0.820、0.637和0.756,其中XGBoost、XGBoost和梯度提升树算法分别在每个模型中显示出最佳结果。使用SHAP,为实现可解释性识别了对预测有贡献的关键特征。白细胞总数(TWC)、合并症评分和红细胞计数对大截肢事件贡献的权重最高。白细胞总数、嗜酸性粒细胞和伤口坏死焦痂对任何截肢事件贡献最大。
机器学习算法在预测DFU患者的截肢风险方面表现良好。可解释性有助于提供临床见解并识别高危患者以便进行早期干预。