Psychology Department, Faculty of Social and Behavioral Sciences, University of Amsterdam, Amsterdam, The Netherlands.
PLoS One. 2011;6(11):e26828. doi: 10.1371/journal.pone.0026828. Epub 2011 Nov 2.
The widespread reluctance to share published research data is often hypothesized to be due to the authors' fear that reanalysis may expose errors in their work or may produce conclusions that contradict their own. However, these hypotheses have not previously been studied systematically.
We related the reluctance to share research data for reanalysis to 1148 statistically significant results reported in 49 papers published in two major psychology journals. We found the reluctance to share data to be associated with weaker evidence (against the null hypothesis of no effect) and a higher prevalence of apparent errors in the reporting of statistical results. The unwillingness to share data was particularly clear when reporting errors had a bearing on statistical significance.
Our findings on the basis of psychological papers suggest that statistical results are particularly hard to verify when reanalysis is more likely to lead to contrasting conclusions. This highlights the importance of establishing mandatory data archiving policies.
人们普遍不愿意分享已发表的研究数据,这通常被假设是由于作者担心重新分析可能会暴露他们工作中的错误,或者可能得出与自己结论相矛盾的结论。然而,这些假设以前并未得到系统研究。
我们将重新分析研究数据的不情愿程度与发表在两个主要心理学期刊上的 49 篇论文中报告的 1148 个具有统计学意义的结果联系起来。我们发现,不愿分享数据与证据较弱(反对无影响的零假设)以及统计结果报告中明显错误的发生率较高有关。当报告的错误对统计显著性有影响时,不愿分享数据的意愿尤其明显。
我们基于心理学论文的发现表明,当重新分析更有可能导致相反的结论时,统计结果尤其难以验证。这凸显了建立强制性数据归档政策的重要性。