Department of Infection Control, Xi'an Hospital of Traditional Chinese Medicine, No.69 Feng Cheng 8th Road, Weiyang District, Xi'an, 710021, China.
Department of Information Consultation, Library of Xi'an Jiaotong University, No.76 Yan Ta West Road, Yanta District, Xi'an, 710061, China.
World J Urol. 2024 Aug 1;42(1):464. doi: 10.1007/s00345-024-05145-4.
Urinary tract infections (UTIs) have been one of the most common bacterial infections in clinical practice worldwide. Artificial intelligence (AI) and machine learning (ML) based algorithms have been increasingly applied in UTI case identification and prediction. However, the overall performance of AI/ML algorithms in identifying and predicting UTI has not been evaluated. The purpose of this paper is to quantitatively evaluate the application value of AI/ML in identifying and predicting UTI cases.
MEDLINE, EMBASE, Web of Science, and PubMed databases were systematically searched for articles published up to December 31, 2023. Quality Assessment of Diagnostic Accuracy Studies tool (QUADAS-2) and Prediction Model Risk of Bias Assessment Tool (PROBAST) were used to assess the risk of bias. Study characteristics and detailed algorithm information were extracted. Pooled sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) were synthesized using a bivariate mix-effects model. Meta-regression and subgroup analysis were conducted to test the source of heterogeneity.
In total, 11 studies with 14 AI/ML models were included in the final meta-analysis. The overall pooled AUC was 0.89 (95%CI 0.86-0.92). Additionally, the pooled Sen, Spe, PLR, NLR, and DOR were 0.78 (95%CI 0.71-0.84), 0.89 (95%CI 0.83-0.93), 6.99 (95%CI 4.38-11.14), 0.25 (95%CI 0.18-0.34) and 28.07 (95%CI 14.27-55.20), respectively. The results of meta-regression suggested that reference standard definitions might be the source of heterogeneity.
AI/ML algorithms appear to be promising to help clinicians detect and identify patients at high risk of UTIs. However, further studies are demanded to evaluate the application value of AI/ML more thoroughly.
尿路感染(UTI)是全球临床实践中最常见的细菌性感染之一。基于人工智能(AI)和机器学习(ML)的算法已越来越多地应用于 UTI 病例的识别和预测。然而,AI/ML 算法在识别和预测 UTI 方面的整体性能尚未得到评估。本文旨在定量评估 AI/ML 在识别和预测 UTI 病例中的应用价值。
系统检索了截至 2023 年 12 月 31 日发表的 MEDLINE、EMBASE、Web of Science 和 PubMed 数据库中的文章。使用诊断准确性研究质量评估工具(QUADAS-2)和预测模型风险偏倚评估工具(PROBAST)评估偏倚风险。提取研究特征和详细算法信息。使用双变量混合效应模型综合汇总合并敏感性、特异性和受试者工作特征曲线下面积(AUC)。进行荟萃回归和亚组分析以检验异质性的来源。
最终的荟萃分析共纳入 11 项研究中的 14 个 AI/ML 模型。总体汇总 AUC 为 0.89(95%CI 0.86-0.92)。此外,汇总的 Sen、Spe、PLR、NLR 和 DOR 分别为 0.78(95%CI 0.71-0.84)、0.89(95%CI 0.83-0.93)、6.99(95%CI 4.38-11.14)、0.25(95%CI 0.18-0.34)和 28.07(95%CI 14.27-55.20)。荟萃回归的结果表明,参考标准的定义可能是异质性的来源。
AI/ML 算法似乎有望帮助临床医生检测和识别患有 UTI 风险较高的患者。然而,需要进一步的研究来更全面地评估 AI/ML 的应用价值。