George and Fay Yee Centre for Healthcare Innovation, Winnipeg, Manitoba, Canada.
Department of Community Health Sciences, Max Rady College of Medicine, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, Manitoba, Canada.
JAMA Netw Open. 2018 May 18;1(1):e180156. doi: 10.1001/jamanetworkopen.2018.0156.
Nonpublication of research results in considerable research waste and compromises medical evidence and the safety of interventions in child health.
To replicate, compare, and contrast the findings of a study conducted 15 years ago to determine the impact of ethical, editorial, and legislative mandates to register and publish findings.
DESIGN, SETTING, AND PARTICIPANTS: In this cohort study, abstracts accepted to the Pediatric Academic Societies (PAS) meetings from May 2008 to May 2011 were screened in duplicate to identify phase 3 randomized clinical trials enrolling pediatric populations. Subsequent publication was ascertained through a search of electronic databases in 2017. Study internal validity was measured using the Cochrane Risk of Bias Tool, the Jadad scale, and allocation concealment, and key variables (eg, trial design and study stage) were extracted. Associations between variables and publication status, time to publication, and publication bias were examined.
Publication rate, trial registration rate, study quality, and risk of bias.
A total of 177 787 abstracts were indexed in the PAS database. Of these, 3132 were clinical trials, and 129 met eligibility criteria. Of these, 93 (72.1%; 95% CI, 53.8%-79.1%) were published. Compared with the previous analysis, the current analysis showed that fewer studies remained unpublished (183 of 447 [40.9%] vs 36 of 129 [27.9%], respectively; odds ratio [OR], 0.56; 95% CI, 0.36-0.86; P = .008). Fifty-one of 129 abstracts (39.5%) were never registered. Abstracts with larger sample sizes (OR, 1.92; 95% CI, 1.15-3.18; P = .01) and those registered in ClinicalTrials.gov (OR, 13.54; 95% CI, 4.78-38.46; P < .001) were more likely to be published. There were no differences in quality measures, risk of bias, or preference for positive results (OR, 1.60; 95% CI, 0.58-4.38; P = .34) between published and unpublished studies. Mean (SE) time to publication following study presentation was 26.48 (1.97) months and did not differ between studies with significant and nonsignificant findings (25.61 vs 26.86 months; P = .93). Asymmetric distribution in the funnel plot (Egger regression, -2.77; P = .04) suggests reduced but ongoing publication bias among published studies. Overall, we observed a reduction in publication bias and in preference for positive findings and an increase in study size and publication rates over time.
These results suggest a promising trend toward a reduction in publication bias and nonpublication rates over time and positive impacts of trial registration. Further efforts are needed to ensure the entirety of evidence can be accessed when assessing treatment effectiveness.
相当数量的研究成果未发表,这造成了研究资源的浪费,还影响了医学证据的质量和儿童健康干预措施的安全性。
复制、比较和对比 15 年前进行的一项研究的结果,以确定伦理、编辑和立法要求注册和发表研究结果的影响。
设计、地点和参与者:在这项队列研究中,从 2008 年 5 月到 2011 年 5 月,对儿科学术协会(PAS)会议接受的摘要进行了重复筛选,以确定招募儿科人群的 3 期随机临床试验。随后在 2017 年通过电子数据库检索确定了后续的发表情况。使用 Cochrane 偏倚风险工具、Jadad 量表和分配隐匿性来衡量研究的内部有效性,并提取了关键变量(例如,试验设计和研究阶段)。研究分析了变量与发表状态、发表时间和发表偏倚之间的关系。
发表率、试验注册率、研究质量和偏倚风险。
PAS 数据库中索引了 177787 篇摘要。其中 3132 篇为临床试验,符合纳入标准的有 129 篇。其中,93 篇(72.1%;95%CI,53.8%至 79.1%)发表了。与之前的分析相比,当前的分析显示,未发表的研究数量减少(447 篇中有 183 篇[40.9%],129 篇中有 36 篇[27.9%],比值比[OR],0.56;95%CI,0.36 至 0.86;P=0.008)。129 篇摘要中有 51 篇(39.5%)从未注册过。样本量较大的摘要(OR,1.92;95%CI,1.15 至 3.18;P=0.01)和在 ClinicalTrials.gov 上注册的摘要(OR,13.54;95%CI,4.78 至 38.46;P<0.001)更有可能发表。发表和未发表的研究在质量措施、偏倚风险或对阳性结果的偏好方面没有差异(OR,1.60;95%CI,0.58 至 4.38;P=0.34)。研究报告后发表的平均(SE)时间为 26.48(1.97)个月,在有显著和无显著结果的研究中没有差异(25.61 与 26.86 个月;P=0.93)。漏斗图的不对称分布(Egger 回归,-2.77;P=0.04)表明,发表研究中仍存在发表偏倚,但程度有所降低。总的来说,我们观察到发表偏倚和对阳性结果的偏好程度随着时间的推移而降低,研究规模和发表率有所增加。
这些结果表明,随着时间的推移,发表偏倚和未发表率呈下降趋势,试验注册具有积极影响。需要进一步努力确保在评估治疗效果时可以获得全部证据。