Department of Pharmacy, Nanjing First Hospital, Nanjing Medical University, Nanjing, China.
School of Basic Medicine and Clinical Pharmacy, China Pharmaceutical University, Nanjing, China.
Neurol Sci. 2024 Feb;45(2):679-691. doi: 10.1007/s10072-023-07003-4. Epub 2023 Aug 25.
Despite endovascular coiling as a valid modality in treatment of aneurysmal subarachnoid hemorrhage (aSAH), there is a risk of poor prognosis. However, the clinical utility of previously proposed early prediction tools remains limited. We aimed to develop a clinically generalizable machine learning (ML) models for accurately predicting unfavorable outcomes in aSAH patients after endovascular coiling.
Functional outcomes at 6 months after endovascular coiling were assessed via the modified Rankin Scale (mRS) and unfavorable outcomes were defined as mRS 3-6. Five ML algorithms (logistic regression, random forest, support vector machine, deep neural network, and extreme gradient boosting) were used for model development. The area under precision-recall curve (AUPRC) and receiver operating characteristic curve (AUROC) was used as main indices of model evaluation. SHapley Additive exPlanations (SHAP) method was applied to interpret the best-performing ML model.
A total of 371 patients were eventually included into this study, and 85.4% of them had favorable outcomes. Among the five models, the DNN model had a better performance with AUPRC of 0.645 (AUROC of 0.905). Postoperative GCS score, size of aneurysm, and age were the top three powerful predictors. The further analysis of five random cases presented the good interpretability of the DNN model.
Interpretable clinical prediction models based on different ML algorithms have been successfully constructed and validated, which would serve as reliable tools in optimizing the treatment decision-making of aSAH. Our DNN model had better performance to predict the unfavorable outcomes at 6 months in aSAH patients compared with Yan's nomogram model.
尽管血管内夹闭术是治疗蛛网膜下腔出血(aSAH)的有效方法,但仍存在预后不良的风险。然而,以前提出的早期预测工具的临床实用性仍然有限。我们旨在开发一种可广泛应用于临床的机器学习(ML)模型,以准确预测血管内夹闭术后 aSAH 患者的不良预后。
通过改良Rankin 量表(mRS)评估血管内夹闭术后 6 个月的功能结局,将 mRS 3-6 定义为不良结局。使用五种 ML 算法(逻辑回归、随机森林、支持向量机、深度神经网络和极端梯度提升)进行模型开发。精度-召回曲线下面积(AUPRC)和接收者操作特征曲线(AUROC)被用作模型评估的主要指标。应用 SHapley Additive exPlanations(SHAP)方法解释表现最佳的 ML 模型。
共纳入 371 例患者,其中 85.4%患者预后良好。在这五种模型中,深度神经网络(DNN)模型的表现更好,AUPRC 为 0.645(AUROC 为 0.905)。术后 GCS 评分、动脉瘤大小和年龄是前三个重要的预测因素。对五个随机病例的进一步分析表明,深度神经网络模型具有良好的可解释性。
基于不同 ML 算法的可解释临床预测模型已成功构建和验证,这将成为优化 aSAH 治疗决策的可靠工具。与 Yan 的列线图模型相比,我们的深度神经网络模型在预测 aSAH 患者 6 个月不良预后方面具有更好的性能。