Department of Medicine, Tehran University of Medical Sciences, Keshavarz Blvd, Tehran, Iran.
Otorhinolaryngology Research Center, Amiralam Hospital, Tehran University of Medical Sciences, Keshavarz Blvd, Tehran, Iran.
Syst Rev. 2024 Jan 2;13(1):11. doi: 10.1186/s13643-023-02404-0.
One concern in meta-analyses is the presence of publication bias (PB) which leads to the dissemination of inflated results. In this study, we assessed how much the meta-analyses in the field of otorhinolaryngology in 2021 evaluated the presence of PB.
Six of the most influential journals in the field were selected. A search was conducted, and data were extracted from the included studies. In cases where PB was not assessed by the authors, we evaluated the risk of its presence by designing funnel plots and performing statistical tests.
Seventy-five systematic reviews were included. Fifty-one percent of them used at least one method for assessing the risk of PB, with the visual inspection of a funnel plot being the most frequent method used. Twenty-nine percent of the studies reported a high risk of PB presence. We replicated the results of 11 meta-analyses that did not assess the risk of PB and found that 63.6% were at high risk. We also found that a considerable proportion of the systematic reviews that found a high risk of PB did not take it into consideration when making conclusions and discussing their results.
Our results indicate that systematic reviews published in some of the most influential journals in the field do not implement enough measures in their search strategies to reduce the risk of PB, nor do they assess the risk of its presence or take the risk of its presence into consideration when inferring their results.
荟萃分析存在发表偏倚(PB)的问题,这会导致夸大的结果被传播。在这项研究中,我们评估了 2021 年耳鼻喉领域的荟萃分析在多大程度上评估了 PB 的存在。
选择了该领域最有影响力的六种期刊。进行了检索,并从纳入的研究中提取数据。在作者未评估 PB 的情况下,我们通过设计漏斗图和进行统计检验来评估其存在的风险。
共纳入 75 项系统评价。其中 51%的研究使用了至少一种方法评估 PB 风险,最常用的方法是视觉检查漏斗图。29%的研究报告存在 PB 存在的高风险。我们复制了 11 项未评估 PB 风险的荟萃分析的结果,发现其中 63.6%存在高风险。我们还发现,相当一部分报告 PB 风险高的系统评价在得出结论和讨论结果时并未考虑这一点。
我们的结果表明,发表在该领域一些最有影响力期刊上的系统评价在其检索策略中没有采取足够的措施来降低 PB 风险,也没有评估其存在的风险,或者在推断结果时没有考虑 PB 存在的风险。