Samuel Sheeba, König-Ries Birgitta
Heinz Nixdorf Chair for Distributed Information Systems, Friedrich Schiller University Jena, Jena, Thuringia, Germany.
Michael Stifel Center Jena, Jena, Thuringia, Germany.
PeerJ. 2021 Apr 21;9:e11140. doi: 10.7717/peerj.11140. eCollection 2021.
Scientific experiments and research practices vary across disciplines. The research practices followed by scientists in each domain play an essential role in the understandability and reproducibility of results. The "Reproducibility Crisis", where researchers find difficulty in reproducing published results, is currently faced by several disciplines. To understand the underlying problem in the context of the reproducibility crisis, it is important to first know the different research practices followed in their domain and the factors that hinder reproducibility. We performed an exploratory study by conducting a survey addressed to researchers representing a range of disciplines to understand scientific experiments and research practices for reproducibility. The survey findings identify a reproducibility crisis and a strong need for sharing data, code, methods, steps, and negative and positive results. Insufficient metadata, lack of publicly available data, and incomplete information in study methods are considered to be the main reasons for poor reproducibility. The survey results also address a wide number of research questions on the reproducibility of scientific results. Based on the results of our explorative study and supported by the existing published literature, we offer general recommendations that could help the scientific community to understand, reproduce, and reuse experimental data and results in the research data lifecycle.
科学实验和研究实践因学科而异。每个领域的科学家所遵循的研究实践在结果的可理解性和可重复性方面起着至关重要的作用。目前,几个学科都面临着“可重复性危机”,即研究人员在重现已发表的结果时遇到困难。为了在可重复性危机的背景下理解潜在问题,首先了解其领域中遵循的不同研究实践以及阻碍可重复性的因素非常重要。我们通过对代表一系列学科的研究人员进行调查,开展了一项探索性研究,以了解科学实验和可重复性的研究实践。调查结果表明存在可重复性危机,并且强烈需要共享数据、代码、方法、步骤以及阴性和阳性结果。元数据不足、缺乏公开可用数据以及研究方法中的信息不完整被认为是可重复性差的主要原因。调查结果还涉及了关于科学结果可重复性的大量研究问题。基于我们探索性研究的结果,并得到现有已发表文献的支持,我们提供了一些一般性建议,这些建议有助于科学界在研究数据生命周期中理解、重现和重用实验数据及结果。