Université Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France.
Centre d'Épidémiologie Clinique, AP-HP, Hôpital Hôtel-Dieu, F-75004, Paris, France.
BMC Med. 2022 Sep 26;20(1):363. doi: 10.1186/s12916-022-02567-y.
In the context of the COVID-19 pandemic, randomized controlled trials (RCTs) are essential to support clinical decision-making. We aimed (1) to assess and compare the reporting characteristics of RCTs between preprints and peer-reviewed publications and (2) to assess whether reporting improves after the peer review process for all preprints subsequently published in peer-reviewed journals.
We searched the Cochrane COVID-19 Study Register and L·OVE COVID-19 platform to identify all reports of RCTs assessing pharmacological treatments of COVID-19, up to May 2021. We extracted indicators of transparency (e.g., trial registration, data sharing intentions) and assessed the completeness of reporting (i.e., some important CONSORT items, conflict of interest, ethical approval) using a standardized data extraction form. We also identified paired reports published in preprint and peer-reviewed publications.
We identified 251 trial reports: 121 (48%) were first published in peer-reviewed journals, and 130 (52%) were first published as preprints. Transparency was poor. About half of trials were prospectively registered (n = 140, 56%); 38% (n = 95) made their full protocols available, and 29% (n = 72) provided access to their statistical analysis plan report. A data sharing statement was reported in 68% (n = 170) of the reports of which 91% stated their willingness to share. Completeness of reporting was low: only 32% (n = 81) of trials completely defined the pre-specified primary outcome measures; 57% (n = 143) reported the process of allocation concealment. Overall, 51% (n = 127) adequately reported the results for the primary outcomes while only 14% (n = 36) of trials adequately described harms. Primary outcome(s) reported in trial registries and published reports were inconsistent in 49% (n = 104) of trials; of them, only 15% (n = 16) disclosed outcome switching in the report. There were no major differences between preprints and peer-reviewed publications. Of the 130 RCTs published as preprints, 78 were subsequently published in a peer-reviewed journal. There was no major improvement after the journal peer review process for most items.
Transparency, completeness, and consistency of reporting of COVID-19 clinical trials were insufficient both in preprints and peer-reviewed publications. A comparison of paired reports published in preprint and peer-reviewed publication did not indicate major improvement.
在 COVID-19 大流行背景下,随机对照试验(RCT)对于支持临床决策至关重要。我们旨在(1)评估和比较预印本和同行评审出版物中 RCT 的报告特征,(2)评估所有随后在同行评审期刊上发表的预印本在经过同行评审后报告是否有所改善。
我们在 Cochrane COVID-19 研究注册库和 L·OVE COVID-19 平台上检索了评估 COVID-19 药物治疗的所有 RCT 报告,截至 2021 年 5 月。我们提取了透明度指标(例如,试验注册、数据共享意向),并使用标准化数据提取表评估了报告的完整性(即某些重要的 CONSORT 项目、利益冲突、伦理批准)。我们还确定了在预印本和同行评审出版物中发表的配对报告。
我们确定了 251 项试验报告:121 项(48%)首先在同行评审期刊上发表,130 项(52%)首先作为预印本发表。透明度较差。约一半的试验是前瞻性注册的(n = 140,56%);38%(n = 95)提供了完整的方案,29%(n = 72)提供了其统计分析计划报告的访问权限。76%(n = 191)的报告中报告了数据共享声明,其中 91%表示愿意共享。报告的完整性较低:只有 32%(n = 81)的试验完全定义了预先指定的主要结局测量指标;57%(n = 143)报告了分配隐匿的过程。总体而言,只有 51%(n = 127)的试验充分报告了主要结局的结果,而只有 14%(n = 36)的试验充分描述了危害。在 49%(n = 104)的试验中,试验注册和发表报告中报告的主要结局不一致;其中,只有 15%(n = 16)在报告中披露了结局转换。预印本和同行评审出版物之间没有重大差异。在作为预印本发表的 130 项 RCT 中,有 78 项随后在同行评审期刊上发表。经过期刊同行评审后,大多数项目都没有明显改善。
COVID-19 临床试验的透明度、完整性和报告的一致性在预印本和同行评审出版物中都不足。对预印本和同行评审出版物中发表的配对报告进行比较,并未表明有重大改进。