Sorbonne Université, INSERM, Institut Pierre Louis d'Epidémiologie et de Santé Publique, Département de Santé Publique, Centre de Pharmacoépidémiologie (Cephepi), Unité de Recherche Clinique PSL-CFX, CIC-1901, AP-HP, Hôpital Pitié Salpêtrière, 75013, Paris, France.
Sci Rep. 2022 Nov 21;12(1):20066. doi: 10.1038/s41598-022-24447-4.
Systematic reviews and meta-analyses have been proposed as an approach to synthesize the literature and counteract the lack of power of small preclinical studies. We aimed to evaluate (1) the methodology of these reviews, (2) the methodological quality of the studies they included and (3) whether study methodological characteristics affect effect size. We searched MEDLINE to retrieve 212 systematic reviews with meta-analyses of preclinical studies published from January, 2018 to March, 2020. Less than 15% explored the grey literature. Selection, data extraction and risk of bias assessment were performed in duplicate in less than two thirds of reviews. Most of them assessed the methodological quality of included studies and reported the meta-analysis model. The risk of bias of included studies was mostly rated unclear. In meta-epidemiological analysis, none of the study methodological characteristics was associated with effect size. The methodological characteristics of systematic reviews with meta-analyses of recently published preclinical studies seem to have improved as compared with previous assessments, but the methodological quality of included studies remains poor, thus limiting the validity of their results. Our meta-epidemiological analysis did not show any evidence of a potential association between methodological characteristics of included studies and effect size.
系统评价和荟萃分析已被提议作为综合文献和克服小型临床前研究缺乏效力的方法。我们旨在评估:(1)这些综述的方法学,(2)它们纳入的研究的方法学质量,以及(3)研究方法学特征是否影响效应大小。我们检索了 MEDLINE,以检索 2018 年 1 月至 2020 年 3 月期间发表的 212 篇临床前研究的系统评价和荟萃分析。不到 15%的研究探索了灰色文献。不到三分之二的综述进行了重复的选择、数据提取和偏倚风险评估。其中大多数评估了纳入研究的方法学质量,并报告了荟萃分析模型。纳入研究的偏倚风险大多被评为不清楚。在荟萃流行病学分析中,纳入研究的任何方法学特征均与效应大小无关。与之前的评估相比,最近发表的临床前研究的系统评价和荟萃分析的方法学特征似乎有所改善,但纳入研究的方法学质量仍然较差,从而限制了其结果的有效性。我们的荟萃流行病学分析没有显示纳入研究的方法学特征与效应大小之间存在潜在关联的任何证据。