Department of Management, Old Dominion University, Norfolk, VA, United States of America.
Department of Management and Entrepreneurship, Virginia Commonwealth University, Richmond, VA, United States of America.
Acta Psychol (Amst). 2023 Sep;239:104005. doi: 10.1016/j.actpsy.2023.104005. Epub 2023 Aug 23.
The goal of industrial/organizational (IO) psychology, is to build and organize trustworthy knowledge about people-related phenomena in the workplace. Unfortunately, as with other scientific disciplines, our discipline may be experiencing a "crisis of confidence" stemming from the lack of reproducibility and replicability of many of our field's research findings, which would suggest that much of our research may be untrustworthy. If a scientific discipline's research is deemed untrustworthy, it can have dire consequences, including the withdraw of funding for future research. In this focal article, we review the current state of reproducibility and replicability in IO psychology and related fields. As part of this review, we discuss factors that make it less likely that research findings will be trustworthy, including the prevalence of scientific misconduct, questionable research practices (QRPs), and errors. We then identify some root causes of these issues and provide several potential remedies. In particular, we highlight the need for improved research methods and statistics training as well as a re-alignment of the incentive structure in academia. To accomplish this, we advocate for changes in the reward structure, improvements to the peer review process, and the implementation of open science practices. Overall, addressing the current "crisis of confidence" in IO psychology requires individual researchers, academic institutions, and publishers to embrace system-wide change.
工业/组织(IO)心理学的目标是建立和组织关于工作场所与人相关现象的可信知识。不幸的是,与其他科学学科一样,我们的学科可能正在经历一场“信任危机”,因为我们领域的许多研究结果都缺乏可重复性和可复制性,这表明我们的许多研究可能是不可信的。如果一个科学学科的研究被认为是不可信的,它可能会产生可怕的后果,包括未来研究的资金撤回。在这篇专题文章中,我们回顾了 IO 心理学及相关领域的可重复性和可复制性的现状。作为这一综述的一部分,我们讨论了使研究结果更不可信的因素,包括科学不端行为、可疑研究实践(QRPs)和错误的普遍存在。然后,我们确定了这些问题的一些根本原因,并提供了一些潜在的补救措施。特别是,我们强调需要改进研究方法和统计培训,以及重新调整学术界的激励结构。为此,我们主张改变奖励结构、改进同行评审过程以及实施开放科学实践。总的来说,解决 IO 心理学当前的“信任危机”需要研究人员、学术机构和出版商共同采取系统的变革。