Institute for Quality and Efficiency in Health Care, Cologne, Germany.
Institute for Research in Operative Medicine Witten/Herdecke University, Cologne, Germany.
BMC Med Res Methodol. 2019 Jun 28;19(1):132. doi: 10.1186/s12874-019-0782-0.
BACKGROUND: Stringent requirements exist regarding the transparency of the study selection process and the reliability of results. A 2-step selection process is generally recommended; this is conducted by 2 reviewers independently of each other (conventional double-screening). However, the approach is resource intensive, which can be a problem, as systematic reviews generally need to be completed within a defined period with a limited budget. The aim of the following methodological systematic review was to analyse the evidence available on whether single screening is equivalent to double screening in the screening process conducted in systematic reviews. METHODS: We searched Medline, PubMed and the Cochrane Methodology Register (last search 10/2018). We also used supplementary search techniques and sources ("similar articles" function in PubMed, conference abstracts and reference lists). We included all evaluations comparing single with double screening. Data were summarized in a structured, narrative way. RESULTS: The 4 evaluations included investigated a total of 23 single screenings (12 sets for screening involving 9 reviewers). The median proportion of missed studies was 5% (range 0 to 58%). The median proportion of missed studies was 3% for the 6 experienced reviewers (range: 0 to 21%) and 13% for the 3 reviewers with less experience (range: 0 to 58%). The impact of missing studies on the findings of meta-analyses had been reported in 2 evaluations for 7 single screenings including a total of 18,148 references. In 3 of these 7 single screenings - all conducted by the same reviewer (with less experience) - the findings would have changed substantially. The remaining 4 of these 7 screenings were conducted by experienced reviewers and the missing studies had no impact or a negligible on the findings of the meta-analyses. CONCLUSIONS: Single screening of the titles and abstracts of studies retrieved in bibliographic searches is not equivalent to double screening, as substantially more studies are missed. However, in our opinion such an approach could still represent an appropriate methodological shortcut in rapid reviews, as long as it is conducted by an experienced reviewer. Further research on single screening is required, for instance, regarding factors influencing the number of studies missed.
背景:研究选择过程的透明度和结果的可靠性存在严格要求。通常建议采用两步筛选法;这是由两名独立的评审员进行的(常规的双重筛选)。然而,这种方法需要大量的资源,这可能是一个问题,因为系统评价通常需要在规定的时间内、在有限的预算内完成。本方法学系统评价的目的是分析现有的证据,即单筛法与系统评价中的双筛法相比是否等效。
方法:我们检索了 Medline、PubMed 和 Cochrane 方法学登记处(最近一次检索时间为 2018 年 10 月)。我们还使用了补充搜索技术和来源(PubMed 中的“相似文章”功能、会议摘要和参考文献列表)。我们纳入了所有比较单筛法与双筛法的评价。数据以结构化、叙述的方式进行总结。
结果:这 4 项评价共纳入了 23 项单筛法(12 项涉及 9 名评审员的筛查)。漏检研究的中位数比例为 5%(范围 0 至 58%)。在 6 名经验丰富的评审员中,漏检研究的中位数比例为 3%(范围:0 至 21%),在 3 名经验较少的评审员中,漏检研究的中位数比例为 13%(范围:0 至 58%)。有 2 项评价报告了 7 项单筛法中的 23148 项参考文献中缺失研究对荟萃分析结果的影响。在这 7 项单筛法中的 3 项中(均由同一名经验较少的评审员进行),研究结果会发生重大变化。在这 7 项单筛法中的其余 4 项中,由经验丰富的评审员进行,缺失研究对荟萃分析结果没有影响或影响可忽略不计。
结论:在文献检索中对标题和摘要进行单筛法不等同于双筛法,因为会漏检更多的研究。然而,我们认为,只要由经验丰富的评审员进行,这种方法仍然可以作为快速评价的一种适当的方法学捷径。还需要进一步研究单筛法,例如,研究影响漏检研究数量的因素。
Cochrane Database Syst Rev. 2022-2-1
Cochrane Database Syst Rev. 2013-9-11
Early Hum Dev. 2020-11
Cochrane Database Syst Rev. 2007-4-18
JMIR Rehabil Assist Technol. 2025-9-3
Am J Prev Med. 2018-1
BMC Med Res Methodol. 2017-11-28
Res Synth Methods. 2017-4-4
BMC Med Res Methodol. 2016-8-26