Department of Surgery, University of Toronto, Toronto, Ontario, Canada.
Division of Vascular Surgery, St. Michael's Hospital, Unity Health Toronto, Toronto, Ontario, Canada.
Br J Surg. 2023 Nov 9;110(12):1840-1849. doi: 10.1093/bjs/znad287.
Endovascular aneurysm repair (EVAR) for abdominal aortic aneurysm (AAA) carries important perioperative risks; however, there are no widely used outcome prediction tools. The aim of this study was to apply machine learning (ML) to develop automated algorithms that predict 1-year mortality following EVAR.
The Vascular Quality Initiative database was used to identify patients who underwent elective EVAR for infrarenal AAA between 2003 and 2023. Input features included 47 preoperative demographic/clinical variables. The primary outcome was 1-year all-cause mortality. Data were split into training (70 per cent) and test (30 per cent) sets. Using 10-fold cross-validation, 6 ML models were trained using preoperative features with logistic regression as the baseline comparator. The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was evaluated with calibration plot and Brier score.
Some 63 655 patients were included. One-year mortality occurred in 3122 (4.9 per cent) patients. The best performing prediction model for 1-year mortality was XGBoost, achieving an AUROC (95 per cent c.i.) of 0.96 (0.95-0.97). Comparatively, logistic regression had an AUROC (95 per cent c.i.) of 0.69 (0.68-0.71). The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.04. The top 3 predictive features in the algorithm were 1) unfit for open AAA repair, 2) functional status, and 3) preoperative dialysis.
In this data set, machine learning was able to predict 1-year mortality following EVAR using preoperative data and outperformed standard logistic regression models.
腹主动脉瘤(AAA)的血管内动脉瘤修复(EVAR)有重要的围手术期风险;然而,目前尚无广泛使用的预后预测工具。本研究旨在应用机器学习(ML)开发自动算法,预测 EVAR 后 1 年的死亡率。
使用血管质量倡议(Vascular Quality Initiative)数据库,确定 2003 年至 2023 年间接受肾下 AAA 选择性 EVAR 的患者。输入特征包括 47 项术前人口统计学/临床变量。主要结局是 1 年全因死亡率。数据分为训练(70%)和测试(30%)集。使用 10 倍交叉验证,使用术前特征和逻辑回归作为基线比较,训练 6 个 ML 模型。主要模型评估指标是接受者操作特征曲线下的面积(AUROC)。使用校准图和 Brier 评分评估模型稳健性。
共纳入 63655 例患者。1 年死亡率为 3122 例(4.9%)。预测 1 年死亡率的最佳模型是 XGBoost,AUROC(95%可信区间)为 0.96(0.95-0.97)。相比之下,逻辑回归的 AUROC(95%可信区间)为 0.69(0.68-0.71)。校准图显示预测和观察到的事件概率之间有良好的一致性,Brier 得分为 0.04。算法中的前 3 个预测特征是 1)不适合开放 AAA 修复,2)功能状态,3)术前透析。
在本数据集,使用术前数据,机器学习能够预测 EVAR 后 1 年的死亡率,优于标准逻辑回归模型。