Edlund John E, Cuccolo Kelly, Irgens Megan S, Wagge Jordan R, Zlokovich Martha S
Department of Psychology, Rochester Institute of Technology.
Department of Psychology, University of North Dakota.
Perspect Psychol Sci. 2022 Jan;17(1):216-225. doi: 10.1177/1745691620984385. Epub 2021 Mar 8.
The scientific enterprise has long been based on the presumption of replication, although scientists have recently become aware of various corruptions of the enterprise that have hurt replicability. In this article, we begin by considering three illustrations of research paradigms that have all been subject to intense scrutiny through replications and theoretical concerns. The three paradigms are one for which the corpus of research points to a real finding, one for which the corpus of research points to a significantly attenuated effect, and one for which the debate is ongoing. We then discuss what scientists can learn-and how science can be improved-through replications more generally. From there, we discuss what we believe needs to be done to improve scientific inquiry with regard to replication moving forward. Finally, we conclude by providing readers with several different approaches to replication and how these approaches progress science. The approaches discussed include multilab replications of many effects, multilab replications of specific effects, adversarial collaborations, and stand-alone applications.
长期以来,科学事业一直基于可重复性的假设,尽管科学家们最近已经意识到该事业中存在的各种损害可重复性的不良现象。在本文中,我们首先考虑三种研究范式的例子,这些范式都受到了通过重复研究和理论关注进行的严格审查。这三种范式分别是:一种研究结果指向真实发现;一种研究结果指向显著减弱的效应;还有一种的相关争论仍在继续。然后,我们更广泛地讨论科学家可以从重复研究中学到什么,以及如何通过重复研究来改进科学。在此基础上,我们讨论为了推动未来关于重复研究的科学探究,我们认为需要做些什么。最后,我们通过向读者提供几种不同的重复研究方法以及这些方法如何推动科学发展来得出结论。所讨论的方法包括对多种效应的多实验室重复、对特定效应的多实验室重复、对抗性合作以及独立应用。