Deng Jiawen, Moskalyk Myron, Shammas-Toma Matthew, Aoude Ahmed, Ghert Michelle, Bhatnagar Sahir, Bozzo Anthony
Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada.
Biostatistics Division, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
J Surg Oncol. 2024 Dec;130(8):1706-1716. doi: 10.1002/jso.27854. Epub 2024 Sep 11.
Oncological resection and reconstruction involving the lower extremities commonly lead to reoperations that impact patient outcomes and healthcare resources. This study aimed to develop a machine learning (ML) model to predict this reoperation risk.
This study was conducted according to TRIPOD + AI. Data from the PARITY trial was used to develop ML models to predict the 1-year reoperation risk following lower extremity oncological resection and reconstruction. Six ML algorithms were tuned and calibrated based on fivefold cross-validation. The best-performing model was identified using classification and calibration metrics.
The polynomial support vector machine (SVM) model was chosen as the best-performing model. During internal validation, the SVM exhibited an AUC-ROC of 0.73 and a Brier score of 0.17. Using an optimal threshold that balances all quadrants of the confusion matrix, the SVM exhibited a sensitivity of 0.45 and a specificity of 0.81. Using a high-sensitivity threshold, the SVM exhibited a sensitivity of 0.68 and a specificity of 0.68. Total operative time was the most important feature for reoperation risk prediction.
The models may facilitate reoperation risk stratification, allowing for better patient counseling and for physicians to implement measures that reduce surgical risks.
涉及下肢的肿瘤切除与重建手术通常会导致再次手术,这会影响患者预后及医疗资源。本研究旨在开发一种机器学习(ML)模型来预测这种再次手术风险。
本研究按照TRIPOD + AI标准进行。利用PARITY试验的数据开发ML模型,以预测下肢肿瘤切除与重建术后1年的再次手术风险。基于五折交叉验证对六种ML算法进行调整和校准。使用分类和校准指标确定性能最佳的模型。
多项式支持向量机(SVM)模型被选为性能最佳的模型。在内部验证中,SVM的AUC-ROC为0.73,Brier评分为0.17。使用平衡混淆矩阵所有象限的最佳阈值时,SVM的灵敏度为0.45,特异度为0.81。使用高灵敏度阈值时,SVM的灵敏度为0.68,特异度为0.68。总手术时间是再次手术风险预测的最重要特征。
这些模型可能有助于再次手术风险分层,从而为患者提供更好的咨询服务,并使医生能够采取措施降低手术风险。