Medical Research Center, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
Department of Endocrinology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, 1 Shuaifuyuan, Dongcheng District, Beijing, China.
Syst Rev. 2022 Jan 15;11(1):11. doi: 10.1186/s13643-021-01881-5.
BACKGROUND: Systematic review is an indispensable tool for optimal evidence collection and evaluation in evidence-based medicine. However, the explosive increase of the original literatures makes it difficult to accomplish critical appraisal and regular update. Artificial intelligence (AI) algorithms have been applied to automate the literature screening procedure in medical systematic reviews. In these studies, different algorithms were used and results with great variance were reported. It is therefore imperative to systematically review and analyse the developed automatic methods for literature screening and their effectiveness reported in current studies. METHODS: An electronic search will be conducted using PubMed, Embase, ACM Digital Library, and IEEE Xplore Digital Library databases, as well as literatures found through supplementary search in Google scholar, on automatic methods for literature screening in systematic reviews. Two reviewers will independently conduct the primary screening of the articles and data extraction, in which nonconformities will be solved by discussion with a methodologist. Data will be extracted from eligible studies, including the basic characteristics of study, the information of training set and validation set, and the function and performance of AI algorithms, and summarised in a table. The risk of bias and applicability of the eligible studies will be assessed by the two reviewers independently based on Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2). Quantitative analyses, if appropriate, will also be performed. DISCUSSION: Automating systematic review process is of great help in reducing workload in evidence-based practice. Results from this systematic review will provide essential summary of the current development of AI algorithms for automatic literature screening in medical evidence synthesis and help to inspire further studies in this field. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42020170815 (28 April 2020).
背景:系统评价是循证医学中最佳证据收集和评估不可或缺的工具。然而,原始文献的爆炸式增长使得批判性评价和定期更新变得困难。人工智能(AI)算法已被应用于医学系统评价中的文献筛选过程自动化。在这些研究中,使用了不同的算法,并报告了差异很大的结果。因此,有必要系统地回顾和分析当前研究中报道的开发自动文献筛选方法及其有效性。
方法:将通过 PubMed、Embase、ACM 数字图书馆和 IEEE Xplore 数字图书馆数据库以及通过 Google Scholar 中的补充搜索找到的文献进行电子搜索,以查找系统评价中文献筛选的自动方法。两名审查员将独立进行文章的初步筛选和数据提取,如果存在分歧,将通过与方法学家讨论来解决。将从合格研究中提取数据,包括研究的基本特征、训练集和验证集的信息以及 AI 算法的功能和性能,并将其汇总在一个表中。两名审查员将根据诊断准确性研究的质量评估(QUADAS-2)独立评估合格研究的偏倚风险和适用性。如果合适,还将进行定量分析。
讨论:自动化系统评价过程有助于减少循证实践中的工作量。这项系统评价的结果将提供有关医学证据综合中自动文献筛选的 AI 算法当前发展的重要总结,并有助于激发该领域的进一步研究。
系统评价注册:PROSPERO CRD42020170815(2020 年 4 月 28 日)。
Cochrane Database Syst Rev. 2022-2-1
J Am Med Inform Assoc. 2022-7-12
J Med Internet Res. 2024-1-31
J Orthop Surg Res. 2020-10-19
J Korean Med Sci. 2025-6-2
BMC Med Res Methodol. 2025-3-18
Front Plant Sci. 2024-1-8
J Med Internet Res. 2024-1-12
BMC Med Inform Decis Mak. 2023-11-3
Int J Environ Res Public Health. 2023-5-31
Cochrane Database Syst Rev. 2019-10-3
IEEE/ACM Trans Comput Biol Bioinform. 2017
Evid Based Med. 2016-8
Annu Int Conf IEEE Eng Med Biol Soc. 2015
Syst Rev. 2015-6-15
Res Synth Methods. 2011-9-27
Front Neurosci. 2013-12-16
Clin Microbiol Infect. 2014-2
Ann Intern Med. 2011-10-18