Jerke Julia, Velicu Antonia, Winter Fabian, Rauhut Heiko
Swiss National Science Foundation, Bern, Switzerland.
Department of Sociology, University of Zurich, Zurich, Switzerland.
PLoS One. 2025 Feb 14;20(2):e0305666. doi: 10.1371/journal.pone.0305666. eCollection 2025.
While publication bias has been widely documented in the social sciences, it is unclear whether the problem aggravated over the last decades due to an increasing pressure to publish. We provide an in-depth analysis of publication bias over time by creating a unique data set, consisting of 12340 test statistics extracted from 571 papers published in 1959-2018 in the Quarterly Journal of Economics. We, further, develop a new methodology to test for discontinuities at the thresholds of significance. Our findings reveal, that, first, in contrast to our expectations, publication bias was already present many decades ago, but that, second, bias patterns notably changed over time. As such, we observe a transition from bias at the 10 percent to bias at the 5 percent significance level. We conclude that these changes are influenced by increasing computational possibilities as well as changes in the acceptance rates of scientific top journals.
虽然社会科学领域已广泛记录了发表偏倚现象,但尚不清楚在过去几十年中,由于发表压力不断增加,这一问题是否加剧。我们通过创建一个独特的数据集,对发表偏倚随时间的变化进行了深入分析,该数据集由1959年至2018年发表在《经济学季刊》上的571篇论文中提取的12340个检验统计量组成。此外,我们开发了一种新方法来检验显著性阈值处的不连续性。我们的研究结果表明,首先,与我们的预期相反,发表偏倚在几十年前就已存在,但其次,偏倚模式随时间显著变化。具体而言,我们观察到从10%显著性水平的偏倚向5%显著性水平的偏倚的转变。我们得出结论,这些变化受到计算能力增强以及顶级科学期刊录用率变化的影响。