Eckhartt Gregory M, Ruxton Graeme D
School of Biology, University of St Andrews, St Andrews, KY16 9TH, UK.
Res Integr Peer Rev. 2023 Apr 11;8(1):1. doi: 10.1186/s41073-022-00126-w.
Integrity and trust in that integrity are fundamental to academic research. However, procedures for monitoring the trustworthiness of research, and for investigating cases where concern about possible data fraud have been raised are not well established. Here we suggest a practical approach for the investigation of work suspected of fraudulent data manipulation using Benford's Law. This should be of value to both individual peer-reviewers and academic institutions and journals. In this, we draw inspiration from well-established practices of financial auditing. We provide synthesis of the literature on tests of adherence to Benford's Law, culminating in advice of a single initial test for digits in each position of numerical strings within a dataset. We also recommend further tests which may prove useful in the event that specific hypotheses regarding the nature of data manipulation can be justified. Importantly, our advice differs from the most common current implementations of tests of Benford's Law. Furthermore, we apply the approach to previously-published data, highlighting the efficacy of these tests in detecting known irregularities. Finally, we discuss the results of these tests, with reference to their strengths and limitations.
学术研究的基础是诚信以及对这种诚信的信任。然而,监测研究可信度以及调查对可能的数据欺诈提出担忧的情况的程序尚未完善。在此,我们提出一种实用方法,利用本福特定律调查涉嫌欺诈性数据操纵的研究工作。这对个体同行评审人员、学术机构和期刊都应具有价值。在此过程中,我们从成熟的财务审计实践中汲取灵感。我们综合了关于本福特定律遵循情况测试的文献,最终给出针对数据集中数字字符串每个位置数字的单一初始测试建议。我们还推荐了进一步的测试,若能证明关于数据操纵性质的特定假设合理,这些测试可能会很有用。重要的是,我们的建议不同于当前本福特定律测试最常见的实施方式。此外,我们将该方法应用于先前发表的数据,突出这些测试在检测已知违规行为方面的有效性。最后,我们结合这些测试的优点和局限性讨论测试结果。