Department of Pharmacy, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
Department of Hernia and Abdominal Wall Surgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China.
Clin Appl Thromb Hemost. 2023 Jan-Dec;29:10760296231171082. doi: 10.1177/10760296231171082.
The accuracy of current prediction tools for venous thromboembolism (VTE) events following hernia surgery remains insufficient for individualized patient management strategies. To address this issue, we have developed a machine learning (ML)-based model to dynamically predict in-hospital VTE in Chinese patients after hernia surgery.
ML models for the prediction of postoperative VTE were trained on a cohort of 11 305 adult patients with hernia from the CHAT-1 trial, which included patients across 58 institutions in China. In data processing, data imputation was conducted using random forest (RF) algorithm, and balanced sampling was done by adaptive synthetic sampling algorithm. Data were split into a training cohort (80%) and internal validation cohort (20%) prior to oversampling. Clinical features available pre-operatively and postoperatively were separately selected using the Sequence Forward Selection algorithm. Nine-candidate ML models were applied to the pre-operative and combined datasets, and their performance was evaluated using various metrics, including area under the receiver operating characteristic curve (AUROC). Model interpretations were generated using importance scores, which were calculated by transforming model features into scaled variables and representing them in radar plots.
The modeling cohort included 2856 patients, divided into 2536 cases for derivation and 320 cases for validation. Eleven pre-operative variables and 15 combined variables were explored as predictors related to in-hospital VTE. Acceptable-performing models for pre-operative data had an AUROC ≥ 0.60, including logistic regression, support vector machine with linear kernel (SVM_Linear), attentive interpretable Tabular learning (TabNet), and RF. For combined data, logistic regression, SVM_Linear, and TabNet had better performance, with an AUROC ≥ 0.65 for each model. Based on these models, 7 pre-operative predictors and 10 combined predictors were depicted in radar plots.
A ML-based approach for the identification of in-hospital VTE events after hernia surgery is feasible. TabNet showed acceptable performance, and might be useful to guide clinical decision making and VTE prevention. Further validated study will strengthen this finding.
目前用于预测疝手术后静脉血栓栓塞(VTE)事件的准确性仍然不足以支持个体化的患者管理策略。为了解决这个问题,我们开发了一种基于机器学习(ML)的模型,用于动态预测中国疝手术后住院患者的 VTE。
在 CHAT-1 试验中,对来自 58 家中国医疗机构的 11305 例成人疝患者队列进行了术后 VTE 预测的 ML 模型训练。在数据处理中,使用随机森林(RF)算法进行数据插补,使用自适应合成采样算法进行平衡采样。在过采样之前,将数据分为训练队列(80%)和内部验证队列(20%)。使用序列前向选择算法分别选择术前和术后可用的临床特征。将 9 个候选 ML 模型应用于术前和组合数据集,并使用各种指标评估其性能,包括接收者操作特征曲线下的面积(AUROC)。使用重要性得分生成模型解释,该得分通过将模型特征转换为缩放变量并在雷达图中表示来计算。
建模队列包括 2856 例患者,分为 2536 例用于推导和 320 例用于验证。探索了 11 个术前变量和 15 个组合变量作为与住院 VTE 相关的预测因子。具有 AUROC≥0.60 的可接受表现模型包括逻辑回归、带线性核的支持向量机(SVM_Linear)、专注可解释的表格学习(TabNet)和 RF。对于组合数据,逻辑回归、SVM_Linear 和 TabNet 的性能更好,每个模型的 AUROC≥0.65。基于这些模型,在雷达图中描绘了 7 个术前预测因子和 10 个组合预测因子。
基于 ML 的疝手术后住院 VTE 事件识别方法是可行的。TabNet 表现出可接受的性能,可能有助于指导临床决策和 VTE 预防。进一步的验证研究将加强这一发现。