The Second Clinical Medical College of Guangzhou University of Chinese Medicine, Guangzhou, China.
Department of Nephrology, Guangdong Provincial Hospital of Chinese Medicine, The Second Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China.
BMC Med Inform Decis Mak. 2022 Aug 1;22(1):205. doi: 10.1186/s12911-022-01951-1.
Kidney disease progression rates vary among patients. Rapid and accurate prediction of kidney disease outcomes is crucial for disease management. In recent years, various prediction models using Machine Learning (ML) algorithms have been established in nephrology. However, their accuracy have been inconsistent. Therefore, we conducted a systematic review and meta-analysis to investigate the diagnostic accuracy of ML algorithms for kidney disease progression.
We searched PubMed, EMBASE, Cochrane Central Register of Controlled Trials, the Chinese Biomedicine Literature Database, Chinese National Knowledge Infrastructure, Wanfang Database, and the VIP Database for diagnostic studies on ML algorithms' accuracy in predicting kidney disease prognosis, from the establishment of these databases until October 2020. Two investigators independently evaluate study quality by QUADAS-2 tool and extracted data from single ML algorithm for data synthesis using the bivariate model and the hierarchical summary receiver operating characteristic (HSROC) model.
Fifteen studies were left after screening, only 6 studies were eligible for data synthesis. The sample size of these 6 studies was 12,534, and the kidney disease types could be divided into chronic kidney disease (CKD) and Immunoglobulin A Nephropathy, with 5 articles using end-stage renal diseases occurrence as the primary outcome. The main results indicated that the area under curve (AUC) of the HSROC was 0.87 (0.84-0.90) and ML algorithm exhibited a strong specificity, 95% confidence interval and heterogeneity (I) of (0.87, 0.84-0.90, [I 99.0%]) and a weak sensitivity of (0.68, 0.58-0.77, [I 99.7%]) in predicting kidney disease deterioration. And the the results of subgroup analysis indicated that ML algorithm's AUC for predicting CKD prognosis was 0.82 (0.79-0.85), with the pool sensitivity of (0.64, 0.49-0.77, [I 99.20%]) and pool specificity of (0.84, 0.74-0.91, [I 99.84%]). The ML algorithm's AUC for predicting IgA nephropathy prognosis was 0.78 (0.74-0.81), with the pool sensitivity of (0.74, 0.71-0.77, [I 7.10%]) and pool specificity of (0.93, 0.91-0.95, [I 83.92%]).
Taking advantage of big data, ML algorithm-based prediction models have high accuracy in predicting kidney disease progression, we recommend ML algorithms as an auxiliary tool for clinicians to determine proper treatment and disease management strategies.
不同患者的肾脏病进展速度存在差异。快速、准确地预测肾脏病结局对于疾病管理至关重要。近年来,肾脏病学领域已经建立了多种使用机器学习(ML)算法的预测模型。然而,它们的准确性并不一致。因此,我们进行了一项系统评价和荟萃分析,以调查 ML 算法预测肾脏病进展的诊断准确性。
我们检索了从这些数据库建立到 2020 年 10 月期间发表的关于 ML 算法在预测肾脏病预后中的准确性的诊断研究的 PubMed、EMBASE、Cochrane 对照试验中心注册库、中国生物医学文献数据库、中国国家知识基础设施、万方数据库和 VIP 数据库。两名研究者独立使用 QUADAS-2 工具评估研究质量,并使用双变量模型和分层综合受试者工作特征(HSROC)模型从单一 ML 算法中提取数据进行数据综合。
筛选后留下了 15 项研究,只有 6 项研究符合数据综合条件。这 6 项研究的样本量为 12534 例,肾脏病类型可分为慢性肾脏病(CKD)和免疫球蛋白 A 肾病,其中 5 篇文章以终末期肾脏疾病的发生作为主要结局。主要结果表明,HSROC 的曲线下面积(AUC)为 0.87(0.84-0.90),ML 算法表现出较强的特异性,95%置信区间和异质性(I)为(0.87,0.84-0.90,[I 99.0%]),敏感性较弱(0.68,0.58-0.77,[I 99.7%]),预测肾脏病恶化。亚组分析结果表明,ML 算法预测 CKD 预后的 AUC 为 0.82(0.79-0.85),合并敏感性为(0.64,0.49-0.77,[I 99.20%]),合并特异性为(0.84,0.74-0.91,[I 99.84%])。ML 算法预测 IgA 肾病预后的 AUC 为 0.78(0.74-0.81),合并敏感性为(0.74,0.71-0.77,[I 7.10%]),合并特异性为(0.93,0.91-0.95,[I 83.92%])。
利用大数据,基于 ML 算法的预测模型在预测肾脏病进展方面具有较高的准确性,我们建议将 ML 算法作为临床医生确定适当治疗和疾病管理策略的辅助工具。