van den Akker Olmo R, Bakker Marjan, van Assen Marcel A L M, Pennington Charlotte R, Verweij Leone, Elsherif Mahmoud M, Claesen Aline, Gaillard Stefan D M, Yeung Siu Kit, Frankenberger Jan-Luca, Krautter Kai, Cockcroft Jamie P, Kreuer Katharina S, Evans Thomas Rhys, Heppel Frédérique M, Schoch Sarah F, Korbmacher Max, Yamada Yuki, Albayrak-Aydemir Nihan, Alzahawi Shilaan, Sarafoglou Alexandra, Sitnikov Maksim M, Děchtěrenko Filip, Wingen Sophia, Grinschgl Sandra, Hartmann Helena, Stewart Suzanne L K, de Oliveira Cátia M F, Ashcroft-Jones Sarah, Baker Bradley J, Wicherts Jelte M
Department of Methodology and Statistics, Tilburg University.
School of Psychology, Aston University.
Psychol Methods. 2024 Oct 10. doi: 10.1037/met0000687.
Study preregistration has become increasingly popular in psychology, but its potential to restrict researcher degrees of freedom has not yet been empirically verified. We used an extensive protocol to assess the producibility (i.e., the degree to which a study can be properly conducted based on the available information) of preregistrations and the consistency between preregistrations and their corresponding papers for 300 psychology studies. We found that preregistrations often lack methodological details and that undisclosed deviations from preregistered plans are frequent. These results highlight that biases due to researcher degrees of freedom remain possible in many preregistered studies. More comprehensive registration templates typically yielded more producible preregistrations. We did not find that the producibility and consistency of preregistrations differed over time or between original and replication studies. Furthermore, we found that operationalizations of variables were generally preregistered more producible and consistently than other study parts. Inconsistencies between preregistrations and published studies were mainly encountered for data collection procedures, statistical models, and exclusion criteria. Our results indicate that, to unlock the full potential of preregistration, researchers in psychology should aim to write more producible preregistrations, adhere to these preregistrations more faithfully, and more transparently report any deviations from their preregistrations. This could be facilitated by training and education to improve preregistration skills, as well as the development of more comprehensive templates. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
研究预注册在心理学领域越来越普遍,但其限制研究者自由度的潜力尚未得到实证验证。我们使用了一个广泛的方案来评估300项心理学研究的预注册的可操作性(即根据现有信息能够正确开展一项研究的程度)以及预注册与其相应论文之间的一致性。我们发现预注册常常缺乏方法学细节,并且未披露的与预注册计划的偏差很常见。这些结果凸显出,在许多预注册研究中,由于研究者自由度导致的偏差仍然可能存在。更全面的注册模板通常会产生更具可操作性的预注册。我们没有发现预注册的可操作性和一致性在时间上或在原创研究与重复研究之间存在差异。此外,我们发现变量的操作化通常比其他研究部分更易于预注册且更具一致性。预注册与已发表研究之间的不一致主要出现在数据收集程序、统计模型和排除标准方面。我们的结果表明,为了充分发挥预注册的潜力,心理学领域的研究者应该致力于撰写更具可操作性的预注册,更忠实地遵守这些预注册,并更透明地报告与预注册的任何偏差。这可以通过培训和教育来提高预注册技能以及开发更全面的模板来促进。(PsycInfo数据库记录(c)2025美国心理学会,保留所有权利)