Janssen Marco A, Pritchard Calvin, Lee Allen
School of Sustainability and Center for Behavior, Institutions and Environment, Arizona State University, USA.
Center for Behavior, Institutions and Environment, Arizona State University, USA.
Environ Model Softw. 2020 Dec;134:104873. doi: 10.1016/j.envsoft.2020.104873. Epub 2020 Sep 16.
Being able to replicate research results is the hallmark of science. Replication of research findings using computational models should, in principle, be possible. In this manuscript, we assess code sharing and model documentation practices of 7500 publications about individual-based and agent-based models. The code availability increased over the years, up to 18% in 2018. Model documentation does not include all the elements that could improve the transparency of the models, such as mathematical equations, flow charts, and pseudocode. We find that articles with equations and flow charts being cited more among other model papers, probably because the model documentation is more transparent. The practices of code sharing improve slowly over time, partly due to the emergence of more public repositories and archives, and code availability requirements by journals and sponsors. However, a significant change in norms and habits need to happen before computational modeling becomes a reproducible science.
能够复制研究结果是科学的标志。原则上,使用计算模型复制研究结果应该是可行的。在本手稿中,我们评估了7500篇关于个体模型和基于主体模型的出版物的代码共享和模型文档实践。多年来代码可用性有所提高,到2018年达到了18%。模型文档并未包含所有能够提高模型透明度的元素,例如数学方程、流程图和伪代码。我们发现,带有方程和流程图的文章在其他模型论文中被引用得更多,可能是因为模型文档更具透明度。代码共享实践随着时间推移改进缓慢,部分原因是出现了更多公共存储库和档案库,以及期刊和资助者对代码可用性的要求。然而,在计算建模成为一门可重复的科学之前,规范和习惯需要发生重大改变。