Faculty of Management, University of Warsaw, Warsaw, Poland.
Account Res. 2024 Nov;31(8):1044-1061. doi: 10.1080/08989621.2023.2198126. Epub 2023 Apr 5.
Fear of retaliation from the original authors and their allies has been proposed as one of the explanations for the paucity of replications. In the current paper the frequency of negative responses to replications in psychology, and the attention such responses attract, was measured in a series of three studies. Study 1 indicates that replications do not attract more negative mentions in literature than randomly selected non-replication papers unless they are independent and failed, in which case a small increase in negative mentions was noticed, although replications with open data were less likely to attract such mentions. Moreover, no difference in attracting comments on a post-publication peer-review site between replications and non-replication papers was found. Study 2 shows that independent failed and partially successful replications are more likely to attract stand-alone replies than non-replication papers, but the risk is still small and is reduced for replications with open data. Study 3 indicates that stand-alone replies to replications attract fewer citations and readers than the replications to which they respond. I conclude that scientists' unwillingness to criticize published research, cited as one of the reasons for the paucity of replications, also benefits replicators by largely shielding their research from questioning.
人们提出,对原创作者及其盟友报复的恐惧是复制研究匮乏的原因之一。在当前的论文中,我们在三项研究中测量了心理学中对复制研究的负面反应的频率,以及这些反应所引起的关注。研究 1 表明,除非复制研究是独立且失败的,否则它们不会比随机选择的非复制研究论文吸引更多的负面提及,在这种情况下,虽然有开放数据的复制研究不太可能吸引此类提及,但确实会注意到负面提及略有增加。此外,在发表后同行评审网站上,复制研究与非复制研究论文吸引评论的程度没有差异。研究 2 表明,独立失败和部分成功的复制研究比非复制研究论文更有可能引起独立的回复,但风险仍然很小,而且对于具有开放数据的复制研究来说,风险会降低。研究 3 表明,对复制研究的独立回复比回复它们的复制研究获得的引用和读者更少。我得出的结论是,由于复制研究匮乏而被引用的科学家不愿意批评已发表的研究,这也使复制研究人员受益,因为这在很大程度上使他们的研究免受质疑。