Lady Davis Institute for Medical Research, Jewish General Hospital, Montreal, Quebec, Canada; Department of Psychiatry, McGill University, Montreal, Quebec, Canada.
Department of Psychology, St. Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada; Department of Psychiatry and Behavioural Neurosciences, McMaster University, Hamilton, Ontario, Canada.
J Clin Epidemiol. 2023 Jul;159:225-234. doi: 10.1016/j.jclinepi.2023.05.017. Epub 2023 Jun 2.
OBJECTIVES: We investigated recent meta-research studies on adherence to four reporting guidelines to determine the proportion that provided (1) an explanation for how adherence to guideline items was rated and (2) results from all included individual studies. We examined conclusions of each meta-research study to evaluate possible repetitive and similar findings. STUDY DESIGN AND SETTING: A cross-sectional meta-research study. MEDLINE (Ovid) was searched on July 5, 2022 for studies that used any version of the Consolidated Standards of Reporting Trials, Preferred Reporting Items for Systematic Reviews and Meta-Analyses, Standards for the Reporting of Diagnostic Accuracy Studies, or Strengthening the Reporting of Observational Studies in Epidemiology reporting guidelines or their extensions to evaluate reporting. RESULTS: Of 148 included meta-research studies published between August 2020 and June 2022, 14 (10%, 95% confidence interval [CI] 6%-15%) provided a fully replicable explanation of how they coded the adherence ratings and 49 (33%, 95% CI 26%-41%) completely reported individual study results. Of 90 studies that classified reporting as adequate or inadequate in the study abstract, six (7%, 95% CI 3%-14%) concluded that reporting was adequate, but none of those six studies provided information on how items were coded or provided item-level results for included studies. CONCLUSION: Almost all included meta-research studies found that reporting in health research is suboptimal. However, few of these reported enough information for verification or replication.
目的:我们调查了最近关于四项报告指南依从性的元研究,以确定提供以下内容的元研究的比例:(1) 解释如何对指南项目的依从性进行评分,以及(2) 所有纳入的单独研究的结果。我们检查了每项元研究的结论,以评估可能存在的重复和相似的发现。
研究设计与设置:横断面元研究。2022 年 7 月 5 日,在 MEDLINE(Ovid)上搜索使用任何版本的临床试验报告统一标准、系统评价和荟萃分析的首选报告项目、诊断准确性研究报告标准或加强观察性研究报告的流行病学报告指南或其扩展来评估报告的研究。
结果:在 2020 年 8 月至 2022 年 6 月期间发表的 148 项纳入的元研究中,14 项(10%,95%置信区间[CI] 6%-15%)提供了对他们如何对依从性评分进行编码的完全可复制的解释,49 项(33%,95%CI 26%-41%)完全报告了个别研究结果。在 90 项在研究摘要中对报告进行充分或不充分分类的研究中,有 6 项(7%,95%CI 3%-14%)得出报告充分的结论,但这 6 项研究中没有一项提供有关项目如何编码或为纳入研究提供项目级结果的信息。
结论:几乎所有纳入的元研究都发现,健康研究的报告质量不理想。然而,这些研究中很少有报告提供足够的信息进行验证或复制。
Cochrane Database Syst Rev. 2022-2-1
BMJ Evid Based Med. 2021-3-30
J Clin Epidemiol. 2018-11-10
Cochrane Database Syst Rev. 2014-10-1
J Am Osteopath Assoc. 2020-12-1
BMC Med Res Methodol. 2023-12-13