Department of Epidemiology, School of Public Health, Dalian Medical University, No. 9, West Section of Lvshun South Road, Lvshunkou District, Dalian, Liaoning Province, China.
Cardiovascular and Cerebrovascular Research Institute, The Central Hospital of Dalian University of Technology, Dalian, Liaoning Province, China.
Eur J Med Res. 2024 Oct 19;29(1):505. doi: 10.1186/s40001-024-02101-1.
We aimed to develop multiple machine learning models to predict the risk of early intracranial aneurysms (IAs) rupture, evaluate and compare the performance of predictive models.
Information related to patients diagnosed with IA by CT angiography and clinicians in Central hospital of Dalian University of Technology from January 2010 to June 2022 was collected, including clinical characteristics, blood indicators and IA morphological parameters. IA with rupture or maximum growth ≥ 0.5 mm within 1 month of first diagnosis was considered unstable. The relevant factors affecting IA stability were screened and predictive models were developed based on the above three levels, including random forest (RF), support vector machine (SVM), and artificial neural network (ANN). Sensitivity, specificity, accuracy and area under curve (AUC) value were used to evaluate the predictive models.
A total of 989 IA patients were included in the study, including 561 stable patients and 428 unstable patients. For RF models, the training set showed that sensitivity, specificity, accuracy and the AUC values were 72.8-83.7%, 76.9-86.9%, 75.1-84.1% and 0.748 (0.719-0.778)-0.839 (0.814-0.864), respectively; after test set validation, the results were 71.9-78.8%, 75.0-84.0%, 73.6-81.1% and 0.734 (0.688-0.781)-0.809 (0.768-0.850), respectively. For SVM models, the training set were 66.0-80.2%, 76.5-85.5%, 71.7-82.3%, 0.712 (0.682-0.743)-0.913 (0.884-0.924), respectively; the test set were 44.2-78.3%, 63.4-84.4%, 57.9-80.9%, 0.699 (0.651-0.747)-0.806 (0.765-0.848), respectively. For ANN models, the training set were 66.8-83.0%, 75.3-82.3%, 71.6-82.1%, 0.783 (0.757-0.808)-0.897 (0.879-0.914); the test set were 63.1-76.3%, 65.5-84.0%, 64.4-80.6%, 0.680 (0.593-0.694)-0.860 (0.821-0.899). The results of variable importance showed that age, white blood cell count (WBC) and uric acid (UA) played an important role in predicting the stability of IA.
The predictive stability models of IA based on three artificial intelligence methods shows good clinical application. Age, WBC and UA played an important role in predicting the IA stability, and were potentially important predictors.
本研究旨在开发多种机器学习模型以预测颅内动脉瘤(IA)早期破裂风险,评估和比较预测模型的性能。
收集大连大学附属中山医院 2010 年 1 月至 2022 年 6 月期间通过 CT 血管造影诊断为 IA 的患者和临床医生的信息,包括临床特征、血液指标和 IA 形态学参数。IA 破裂或首次诊断后 1 个月内最大生长≥0.5mm 被认为是不稳定的。筛选影响 IA 稳定性的相关因素,并基于上述三个水平开发预测模型,包括随机森林(RF)、支持向量机(SVM)和人工神经网络(ANN)。采用敏感性、特异性、准确性和曲线下面积(AUC)值来评估预测模型。
共纳入 989 例 IA 患者,其中稳定患者 561 例,不稳定患者 428 例。对于 RF 模型,训练集的敏感性、特异性、准确性和 AUC 值分别为 72.8-83.7%、76.9-86.9%、75.1-84.1%和 0.748(0.719-0.778)-0.839(0.814-0.864);经过测试集验证,结果分别为 71.9-78.8%、75.0-84.0%、73.6-81.1%和 0.734(0.688-0.781)-0.809(0.768-0.850)。对于 SVM 模型,训练集的敏感性、特异性、准确性和 AUC 值分别为 66.0-80.2%、76.5-85.5%、71.7-82.3%和 0.712(0.682-0.743)-0.913(0.884-0.924);测试集的敏感性、特异性、准确性和 AUC 值分别为 44.2-78.3%、63.4-84.4%、57.9-80.9%和 0.699(0.651-0.747)-0.806(0.765-0.848)。对于 ANN 模型,训练集的敏感性、特异性、准确性和 AUC 值分别为 66.8-83.0%、75.3-82.3%、71.6-82.1%和 0.783(0.757-0.808)-0.897(0.879-0.914);测试集的敏感性、特异性、准确性和 AUC 值分别为 63.1-76.3%、65.5-84.0%、64.4-80.6%和 0.680(0.593-0.694)-0.860(0.821-0.899)。变量重要性结果表明,年龄、白细胞计数(WBC)和尿酸(UA)在预测 IA 稳定性方面发挥着重要作用。
基于三种人工智能方法的 IA 预测稳定性模型具有良好的临床应用价值。年龄、WBC 和 UA 在预测 IA 稳定性方面起着重要作用,是潜在的重要预测指标。