Hufstedler Heather, Mauer Nicole, Yeboah Edmund, Carr Sinclair, Rahman Sabahat, Danzer Alexander M, Debray Thomas P A, Jong Valentijn M T, Campbell Harlan, Gustafson Paul, Maxwell Lauren, Jaenisch Thomas, Matthay Ellicott C, Bärnighausen Till
Heidelberg University.
University Medical Center Hamburg- Eppendorf.
Res Sq. 2023 Aug 30:rs.3.rs-3282208. doi: 10.21203/rs.3.rs-3282208/v1.
Observational data provide invaluable real-world information in medicine, but certain methodological considerations are required to derive causal estimates. In this systematic review, we evaluated the methodology and reporting quality of individual-level patient data meta-analyses (IPD-MAs) published in 2009, 2014, and 2019 that sought to estimate a causal relationship in medicine. We screened over 16,000 titles and abstracts, reviewed 45 full-text articles out of the 167 deemed potentially eligible, and included 29 into the analysis. Unfortunately, we found that causal methodologies were rarely implemented, and reporting was generally poor across studies. Specifically, only three of the 29 articles used quasi-experimental methods, and no study used G-methods to adjust for time-varying confounding. To address these issues, we propose stronger collaborations between physicians and methodologists to ensure that causal methodologies are properly implemented in IPD-MAs. In addition, we put forward a suggested checklist of reporting guidelines for IPD-MAs that utilize causal methods. This checklist could improve reporting thereby potentially enhancing the quality and trustworthiness of IPD-MAs, which can be considered one of the most valuable sources of evidence for health policy.
观察性数据在医学中提供了宝贵的真实世界信息,但要得出因果估计值需要考虑某些方法学因素。在本系统评价中,我们评估了2009年、2014年和2019年发表的旨在估计医学中因果关系的个体水平患者数据荟萃分析(IPD-MA)的方法学和报告质量。我们筛选了超过16000篇标题和摘要,在167篇被认为可能符合条件的文章中审查了45篇全文,并将29篇纳入分析。遗憾的是,我们发现因果方法很少被采用,且各研究的报告质量普遍较差。具体而言,29篇文章中只有3篇使用了准实验方法,没有研究使用G方法来调整随时间变化的混杂因素。为解决这些问题,我们建议医生和方法学家加强合作,以确保在IPD-MA中正确实施因果方法。此外,我们提出了一份针对使用因果方法的IPD-MA的报告指南建议清单。该清单可改善报告情况,从而有可能提高IPD-MA的质量和可信度,IPD-MA可被视为卫生政策最有价值的证据来源之一。