旨在提高研究可重复性和可复制性的开放科学干预措施:一项范围综述
Open science interventions to improve reproducibility and replicability of research: a scoping review.
作者信息
Dudda Leonie, Kormann Eva, Kozula Magdalena, DeVito Nicholas J, Klebel Thomas, Dewi Ayu P M, Spijker René, Stegeman Inge, Van den Eynden Veerle, Ross-Hellauer Tony, Leeflang Mariska M G
机构信息
Department of Otorhinolaryngology and Head & Neck Surgery, University Medical Center Utrecht, Utrecht, The Netherlands.
Brain Center, University Medical Center Utrecht, Utrecht, The Netherlands.
出版信息
R Soc Open Sci. 2025 Apr 9;12(4):242057. doi: 10.1098/rsos.242057. eCollection 2025 Apr.
Various open science practices have been proposed to improve the reproducibility and replicability of scientific research, but not for all practices, there may be evidence they are indeed effective. Therefore, we conducted a scoping review of the literature on interventions to improve reproducibility. We systematically searched Medline, Embase, Web of Science, PsycINFO, Scopus and Eric, on 18 August 2023. Any study empirically evaluating the effectiveness of interventions aimed at improving the reproducibility or replicability of scientific methods and findings was included. We summarized the retrieved evidence narratively and in evidence gap maps. Of the 105 distinct studies we included, 15 directly measured the effect of an intervention on reproducibility or replicability, while the remainder addressed a proxy outcome that might be expected to increase reproducibility or replicability, such as data sharing, methods transparency or pre-registration. Thirty studies were non-comparative and 27 were comparative but cross-sectional observational designs, precluding any causal inference. Despite studies investigating a range of interventions and addressing various outcomes, our findings indicate that in general the evidence base for which various interventions to improve reproducibility of research remains remarkably limited in many respects.
人们提出了各种开放科学实践来提高科学研究的可重复性和可复制性,但并非所有实践都有证据表明它们确实有效。因此,我们对关于提高可重复性的干预措施的文献进行了范围综述。我们于2023年8月18日系统地检索了Medline、Embase、Web of Science、PsycINFO、Scopus和Eric。纳入任何实证评估旨在提高科学方法和研究结果的可重复性或可复制性的干预措施有效性的研究。我们以叙述方式并在证据缺口图中总结了检索到的证据。在我们纳入的105项不同研究中,15项直接测量了干预措施对可重复性或可复制性的影响,其余研究涉及可能预期会提高可重复性或可复制性的替代结果,如数据共享、方法透明度或预注册。30项研究为非对比性研究,27项为对比性研究但采用横断面观察设计,排除了任何因果推断。尽管研究调查了一系列干预措施并涉及各种结果,但我们的研究结果表明,总体而言,在许多方面,关于各种提高研究可重复性的干预措施的证据基础仍然非常有限。