Department of Surgery, University of North Carolina at Chapel Hill, NC, USA.
Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill, NC, USA.
Am Surg. 2023 Dec;89(12):5702-5710. doi: 10.1177/00031348231173981. Epub 2023 May 3.
Ureteral injury (UI) is a rare but devastating complication during colorectal surgery. Ureteral stents may reduce UI but carry risks themselves. Risk predictors for UI could help target the use of stents, but previous efforts have relied on logistic regression (LR), shown moderate accuracy, and used intraoperative variables. We sought to use an emerging approach in predictive analytics, machine learning, to create a model for UI.
Patients who underwent colorectal surgery were identified in the National Surgical Quality Improvement Program (NSQIP) database. Patients were split into training, validation, and test sets. The primary outcome was UI. Three machine learning approaches were tested including random forest (RF), gradient boosting (XGB), and neural networks (NN), and compared with traditional LR. Model performance was assessed using area under the curve (AUROC).
The data set included 262,923 patients, of whom 1519 (.578%) experienced UI. Of the modeling techniques, XGB performed the best, with an AUROC score of .774 (95% CI .742-.807) compared with .698 (95% CI .664-.733) for LR. Random forest and NN performed similarly with scores of .738 and .763, respectively. Type of procedure, work RVUs, indication for surgery, and mechanical bowel prep showed the strongest influence on model predictions.
Machine learning-based models significantly outperformed LR and previous models and showed high accuracy in predicting UI during colorectal surgery. With proper validation, they could be used to support decision making regarding the placement of ureteral stents preoperatively.
输尿管损伤(UI)是结直肠手术中罕见但严重的并发症。输尿管支架可减少 UI 但自身也存在风险。UI 的风险预测因子有助于确定支架的使用,但先前的研究依赖于逻辑回归(LR),准确性中等,且使用的是术中变量。我们试图使用预测分析、机器学习中的新兴方法来建立 UI 模型。
在国家外科质量改进计划(NSQIP)数据库中确定接受结直肠手术的患者。患者分为训练集、验证集和测试集。主要结局是 UI。测试了三种机器学习方法,包括随机森林(RF)、梯度提升(XGB)和神经网络(NN),并与传统 LR 进行比较。使用曲线下面积(AUROC)评估模型性能。
数据集包括 262923 名患者,其中 1519 名(0.578%)发生 UI。在建模技术中,XGB 的表现最佳,AUROC 得分为 0.774(95%CI 0.742-0.807),而 LR 为 0.698(95%CI 0.664-0.733)。RF 和 NN 的得分分别为 0.738 和 0.763,表现相当。手术类型、工作 RVU、手术指征和机械性肠道准备对模型预测的影响最大。
基于机器学习的模型显著优于 LR 和之前的模型,在预测结直肠手术中的 UI 方面具有很高的准确性。经过适当验证,它们可用于支持术前放置输尿管支架的决策。