Office of Medical Student Research (A.K.R., J.M.A., H.M.G., and M.V.) and Department of Psychiatry and Behavioral Sciences (M.V.), Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma.
Department of Orthopedic Surgery, Oklahoma State University Medical Center, Tulsa, Oklahoma.
J Bone Joint Surg Am. 2021 May 19;103(10):e41. doi: 10.2106/JBJS.20.01743.
Results from systematic reviews and meta-analyses, which have the highest level of evidence (Level I), often drive clinical decision-making and health policy. Often, unpublished trial data are omitted from systematic reviews, raising concerns about the extent of the reliability and validity of results that have been drawn from systematic reviews. We aimed to determine the extent to which systematic review authors include searches of clinical trial registries for unpublished data when conducting systematic reviews in orthopaedic surgery.
Systematic reviews and/or meta-analyses were gathered from the top 5 orthopaedic surgery journals based on the h5-index from Google Scholar Metrics. Systematic reviews that had been published in the Cochrane Database of Systematic Reviews, which requires the inclusion of a clinical trial registry search, served as controls. For the primary outcome, each systematic review from the top 5 orthopaedic journals was screened to determine whether the authors of each study searched for unpublished data in clinical trial registries. We then compared the rate of registry searches with those in the control group. For the secondary analysis, a search of ClinicalTrials.gov was performed for unpublished trial data for 100 randomized systematic reviews.
All 38 of the Cochrane systematic reviews (100%) included clinical trial registry searches, while the top 5 orthopaedic journals had only 31 of 480 studies (6.5%) that looked at clinical trial registries. The secondary analysis yielded 59 of 100 systematic review articles (59.0%) that could have included unpublished clinical trial data from ≥1 studies to their sample.
Systematic reviews that have been published in the top orthopaedic surgery journals seldom included a search for unpublished clinical trial data.
The exclusion of clinical trial registry searches potentially contributes to publication bias within the orthopaedic literature. Moving forward, systematic review authors should include clinical trial registry searches for unpublished clinical trial data to provide the most accurate representation of the available evidence for systematic reviews and meta-analyses.
系统评价和荟萃分析的结果(最高证据级别 I 级)通常会推动临床决策和卫生政策制定。然而,系统评价往往会忽略未发表的试验数据,这引发了人们对于从系统评价中得出的结果的可靠性和有效性的担忧。本研究旨在评估在进行骨科手术系统评价时,系统评价作者纳入临床试验注册库中未发表数据的程度。
从 Google Scholar Metrics 的 h5 指数中选取排名前五的骨科期刊,收集系统评价和/或荟萃分析。以 Cochrane 系统评价数据库(要求纳入临床试验注册库检索)中的系统评价作为对照。对于主要结局,对前 5 名骨科期刊中的每一篇系统评价进行筛查,以确定研究作者是否检索了临床试验注册库中的未发表数据。然后,我们比较了登记库检索率与对照组的差异。在二次分析中,对 ClinicalTrials.gov 进行了 100 项随机系统评价的未发表试验数据检索。
所有 38 项 Cochrane 系统评价(100%)均纳入了临床试验注册库检索,而前 5 名骨科期刊中只有 480 项研究中的 31 项(6.5%)检索了临床试验注册库。二次分析得出,100 篇系统评价文章中有 59 篇(59.0%)可能从≥1 项研究中纳入了其样本的未发表临床试验数据。
发表在顶级骨科期刊上的系统评价很少纳入对未发表临床试验数据的检索。
排除临床试验注册库检索可能导致骨科文献中的发表偏倚。展望未来,系统评价作者应纳入临床试验注册库中未发表的临床试验数据搜索,以提供对系统评价和荟萃分析现有证据最准确的描述。