Menke Joe, Roelandse Martijn, Ozyurt Burak, Martone Maryann, Bandrowski Anita
Center for Research in Biological Systems, UCSD, SciCrunch Inc, La Jolla, CA 92093, USA.
Independent Consultant at Martijnroelandse.dev, Amsterdam, the Netherlands.
iScience. 2020 Oct 20;23(11):101698. doi: 10.1016/j.isci.2020.101698. eCollection 2020 Nov 20.
The reproducibility crisis is a multifaceted problem involving ingrained practices within the scientific community. Fortunately, some causes are addressed by the author's adherence to rigor and reproducibility criteria, implemented via checklists at various journals. We developed an automated tool (SciScore) that evaluates research articles based on their adherence to key rigor criteria, including NIH criteria and RRIDs, at an unprecedented scale. We show that despite steady improvements, less than half of the scoring criteria, such as blinding or power analysis, are routinely addressed by authors; digging deeper, we examined the influence of specific checklists on average scores. The average score for a journal in a given year was named the Rigor and Transparency Index (RTI), a new journal quality metric. We compared the RTI with the Journal Impact Factor and found there was no correlation. The RTI can potentially serve as a proxy for methodological quality.
可重复性危机是一个多方面的问题，涉及科学界根深蒂固的做法。幸运的是，作者通过坚持严谨性和可重复性标准来解决一些原因，这些标准通过各种期刊的清单来实施。我们开发了一种自动化工具（SciScore），以前所未有的规模根据研究文章对关键严谨标准（包括美国国立卫生研究院标准和RRIDs）的遵守情况来评估研究文章。我们表明，尽管有稳步改进，但不到一半的评分标准（如盲法或功效分析）被作者常规采用；深入研究后，我们考察了特定清单对平均得分的影响。给定年份某期刊的平均得分被命名为严谨性与透明度指数（RTI），这是一种新的期刊质量指标。我们将RTI与期刊影响因子进行比较，发现两者没有相关性。RTI有可能作为方法学质量的一个替代指标。
Zotero 插件
