Department of Surgery University of Toronto Ontario Canada.
Division of Vascular Surgery St. Michael's Hospital, Unity Health Toronto Toronto Ontario Canada.
J Am Heart Assoc. 2024 Sep 3;13(17):e035425. doi: 10.1161/JAHA.124.035425. Epub 2024 Aug 27.
Transfemoral carotid artery stenting (TFCAS) carries important perioperative risks. Outcome prediction tools may help guide clinical decision-making but remain limited. We developed machine learning algorithms that predict 1-year stroke or death following TFCAS.
The VQI (Vascular Quality Initiative) database was used to identify patients who underwent TFCAS for carotid artery stenosis between 2005 and 2024. We identified 112 features from the index hospitalization (82 preoperative [demographic/clinical], 13 intraoperative [procedural], and 17 postoperative [in-hospital course/complications]). The primary outcome was 1-year postprocedural stroke or death. The data were divided into training (70%) and test (30%) sets. Six machine learning models were trained using preoperative features with 10-fold cross-validation. The primary model evaluation metric was area under the receiver operating characteristic curve. The algorithm with the best performance was further trained using intra- and postoperative features. Model robustness was assessed using calibration plots and Brier scores. Overall, 35 214 patients underwent TFCAS during the study period and 3257 (9.2%) developed 1-year stroke or death. The best preoperative prediction model was extreme gradient boosting, achieving an area under the receiver operating characteristic curve of 0.94 (95% CI, 0.93-0.95). In comparison, logistic regression had an AUROC of 0.65 (95% CI, 0.63-0.67). The extreme gradient boosting model maintained excellent performance at the intra- and postoperative stages, with area under the receiver operating characteristic curve values of 0.94 (95% CI, 0.93-0.95) and 0.98 (95% CI, 0.97-0.99), respectively. Calibration plots showed good agreement between predicted/observed event probabilities with Brier scores of 0.11 (preoperative), 0.11 (intraoperative), and 0.09 (postoperative).
Machine learning can accurately predict 1-year stroke or death following TFCAS, performing better than logistic regression.
经股动脉颈动脉支架置入术(TFCAS)具有重要的围手术期风险。预后预测工具可能有助于指导临床决策,但仍存在局限性。我们开发了机器学习算法来预测 TFCAS 后 1 年的卒中和死亡。
使用 VQI(血管质量倡议)数据库,我们在 2005 年至 2024 年间识别出接受 TFCAS 治疗颈动脉狭窄的患者。我们从索引住院期间(82 个术前[人口统计学/临床]、13 个术中[手术过程]和 17 个术后[住院期间过程/并发症])中确定了 112 个特征。主要结局是术后 1 年的卒中和死亡。数据分为训练集(70%)和测试集(30%)。使用术前特征进行了 10 倍交叉验证,训练了 6 种机器学习模型。主要模型评估指标为接受者操作特征曲线下面积。性能最佳的算法进一步使用术中及术后特征进行训练。使用校准图和 Brier 评分评估模型的稳健性。总的来说,在研究期间,35214 例患者接受了 TFCAS 治疗,3257 例(9.2%)在 1 年内发生卒中和死亡。最佳的术前预测模型是极端梯度增强,接受者操作特征曲线下面积为 0.94(95%置信区间,0.93-0.95)。相比之下,逻辑回归的 AUROC 为 0.65(95%置信区间,0.63-0.67)。极端梯度增强模型在术中及术后阶段均保持了优异的性能,接受者操作特征曲线下面积值分别为 0.94(95%置信区间,0.93-0.95)和 0.98(95%置信区间,0.97-0.99)。校准图显示,预测/观察事件概率之间存在良好的一致性,Brier 分数分别为 0.11(术前)、0.11(术中)和 0.09(术后)。
机器学习可以准确预测 TFCAS 后 1 年的卒中和死亡,其性能优于逻辑回归。