Institute for Geoinformatics, University of Münster, Münster, Germany.
Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK.
F1000Res. 2021 Mar 30;10:253. doi: 10.12688/f1000research.51738.2. eCollection 2021.
The traditional scientific paper falls short of effectively communicating computational research. To help improve this situation, we propose a system by which the computational workflows underlying research articles are checked. The CODECHECK system uses open infrastructure and tools and can be integrated into review and publication processes in multiple ways. We describe these integrations along multiple dimensions (importance, who, openness, when). In collaboration with academic publishers and conferences, we demonstrate CODECHECK with 25 reproductions of diverse scientific publications. These CODECHECKs show that asking for reproducible workflows during a collaborative review can effectively improve executability. While CODECHECK has clear limitations, it may represent a building block in Open Science and publishing ecosystems for improving the reproducibility, appreciation, and, potentially, the quality of non-textual research artefacts. The CODECHECK website can be accessed here: https://codecheck.org.uk/.
传统的科学论文在有效传达计算研究方面存在不足。为了帮助改善这种情况，我们提出了一个系统，可以检查研究文章背后的计算工作流程。CODECHECK 系统使用开放的基础设施和工具，并可以通过多种方式集成到审查和发布过程中。我们沿着多个维度（重要性、人员、开放性、时间）描述这些集成。我们与学术出版商和会议合作，使用 25 种不同科学出版物的复制品展示了 CODECHECK。这些 CODECHECK 表明，在协作审查期间要求可重现的工作流程可以有效地提高可执行性。虽然 CODECHECK 有明显的局限性，但它可能代表着开放科学和出版生态系统的一个构建块，可以提高非文本研究成果的可重复性、可理解性，并且可能提高其质量。可以在此处访问 CODECHECK 网站：https://codecheck.org.uk/。
