Fu Linru, Huang Guanghua, Sun Zhijing, Zhu Lan
National Clinical Research Center for Obstetric & Gynecologic Diseases, Department of Obstetrics and Gynecology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China.
Eight-Year MD Program, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China.
Ann Transl Med. 2023 Mar 31;11(6):251. doi: 10.21037/atm-22-3648. Epub 2023 Feb 1.
Previous prediction models for postoperative stress urinary incontinence (SUI) cannot be applied to patients receiving transvaginal mesh (TVM) surgery and colpocleisis or those with preoperative subject urinary incontinence. This study aimed to develop and validate a new machine learning model and compare it to previous models.
Female patients who underwent prolapse surgeries for stage 2-4 anterior or apical prolapse between January 1, 2015, and December 31, 2019, at Peking Union Medical College Hospital were enrolled. Prolapse surgeries included native tissue repair, LeFort/colpocleisis, sacrocolpopexy, and TVM surgery. The existing models to predict postoperative SUI were externally validated. Subsequently, the dataset was randomly divided into 2 sets in a 4:1 ratio. The larger group was used to construct and internally validate models of logistic regression, random forest, and extreme gradient boosting (XGBoost), which were then externally validated. The discrimination of the prediction models was evaluated using the area under the curve, while the calibration of the models was measured using the Spiegelhalter z test, mean absolute error (MSE), and calibration curves.
Overall, 555 patients were enrolled, and 116 experienced SUI 1 year postoperatively. Previous logistic models had poor performance, with areas under the curve of 0.544 and 0.586. In the model construction, the areas under the curve were 0.595, 0.842, and 0.714 for the logistic, random forest, and XGBoost models, respectively. However, only the XGBoost model exhibited good discrimination and calibration for both internal and external validations. Body mass index (BMI), C point of pelvic organ prolapse (POP) quantification stage, age, Aa point of POP quantification stage, and TVM surgery were the 5 most important predictors of postoperative SUI in the XGBoost model.
Previous models had poor discrimination and calibration among a Chinese population. Hence, we developed and validated an XGBoost model, which performed well irrespective of the preoperative subjective urinary incontinence (preUI) and surgical methods. Further validation is still required.
既往用于预测术后压力性尿失禁(SUI)的模型不能应用于接受经阴道网片(TVM)手术和阴道封闭术的患者或术前存在主观尿失禁的患者。本研究旨在开发并验证一种新的机器学习模型,并将其与既往模型进行比较。
纳入2015年1月1日至2019年12月31日在北京协和医院接受2-4期前壁或顶端脱垂手术的女性患者。脱垂手术包括自体组织修复、LeFort/阴道封闭术、骶骨阴道固定术和TVM手术。对现有的预测术后SUI的模型进行外部验证。随后,将数据集以4:1的比例随机分为两组。较大的一组用于构建和内部验证逻辑回归、随机森林和极端梯度提升(XGBoost)模型,然后进行外部验证。使用曲线下面积评估预测模型的辨别力,使用Spiegelhalter z检验、平均绝对误差(MSE)和校准曲线测量模型的校准。
总体而言,共纳入555例患者,116例在术后1年出现SUI。既往的逻辑模型表现不佳,曲线下面积分别为0.544和0.586。在模型构建中,逻辑回归、随机森林和XGBoost模型的曲线下面积分别为0.595、0.842和0.714。然而,只有XGBoost模型在内部和外部验证中均表现出良好的辨别力和校准。体重指数(BMI)、盆腔器官脱垂(POP)量化分期的C点、年龄、POP量化分期的Aa点和TVM手术是XGBoost模型中术后SUI的5个最重要预测因素。
既往模型在中国人群中的辨别力和校准较差。因此,我们开发并验证了一种XGBoost模型,无论术前主观尿失禁(preUI)和手术方法如何,该模型均表现良好。仍需进一步验证。