Sarafoglou Alexandra, Kovacs Marton, Bakos Bence, Wagenmakers Eric-Jan, Aczel Balazs
Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands.
Doctoral School of Psychology, ELTE Eotvos Lorand University, Budapest, Hungary.
R Soc Open Sci. 2022 Jul 6;9(7):211997. doi: 10.1098/rsos.211997. eCollection 2022 Jul.
The preregistration of research protocols and analysis plans is a main reform innovation to counteract confirmation bias in the social and behavioural sciences. While theoretical reasons to preregister are frequently discussed in the literature, the individually experienced advantages and disadvantages of this method remain largely unexplored. The goal of this exploratory study was to identify the perceived benefits and challenges of preregistration from the researcher's perspective. To this end, we surveyed 355 researchers, 299 of whom had used preregistration in their own work. The researchers indicated the experienced or expected effects of preregistration on their workflow. The results show that experiences and expectations are mostly positive. Researchers in our sample believe that implementing preregistration improves or is likely to improve the quality of their projects. Criticism of preregistration is primarily related to the increase in work-related stress and the overall duration of the project. While the benefits outweighed the challenges for the majority of researchers with preregistration experience, this was not the case for the majority of researchers without preregistration experience. The experienced advantages and disadvantages identified in our survey could inform future efforts to improve preregistration and thus help the methodology gain greater acceptance in the scientific community.
研究方案和分析计划的预注册是社会科学和行为科学中应对确认偏差的一项主要改革创新举措。虽然文献中经常讨论预注册的理论依据,但这种方法对个人而言的利弊在很大程度上仍未得到探索。这项探索性研究的目的是从研究者的角度确定预注册的感知益处和挑战。为此,我们对355名研究者进行了调查,其中299人在自己的工作中使用过预注册。研究者指出了预注册对其工作流程的实际或预期影响。结果表明,实际体验和预期大多是积极的。我们样本中的研究者认为,实施预注册会提高或可能提高他们项目的质量。对预注册的批评主要与工作压力增加和项目总时长有关。虽然对于大多数有预注册经验的研究者来说,益处大于挑战,但对于大多数没有预注册经验的研究者来说并非如此。我们在调查中确定的实际利弊可为未来改进预注册的努力提供参考,从而有助于该方法在科学界获得更广泛的认可。