Sumner Josh Q, Vitale Cynthia Hudson, McIntosh Leslie D
Ripeta, LLC, St. Louis, MI, United States.
Washington University School of Medicine, Donald Danforth Plant Science Center, Washington University in St. Louis, St. Louis, MI, United States.
Front Res Metr Anal. 2022 Jan 21;6:751734. doi: 10.3389/frma.2021.751734. eCollection 2021.
A wide array of existing metrics quantifies a scientific paper's prominence or the author's prestige. Many who use these metrics make assumptions that higher citation counts or more public attention must indicate more reliable, better quality science. While current metrics offer valuable insight into scientific publications, they are an inadequate proxy for measuring the quality, transparency, and trustworthiness of published research. Three essential elements to establishing trust in a work include: trust in the paper, trust in the author, and trust in the data. To address these elements in a systematic and automated way, we propose the ripetaScore as a direct measurement of a paper's research practices, professionalism, and reproducibility. Using a sample of our current corpus of academic papers, we demonstrate the ripetaScore's efficacy in determining the quality, transparency, and trustworthiness of an academic work. In this paper, we aim to provide a metric to evaluate scientific reporting quality in terms of transparency and trustworthiness of the research, professionalism, and reproducibility.
大量现有的指标量化了一篇科学论文的影响力或作者的声望。许多使用这些指标的人认为,更高的引用次数或更多的公众关注必然意味着更可靠、质量更高的科学。虽然当前的指标为科学出版物提供了有价值的见解,但它们不足以作为衡量已发表研究的质量、透明度和可信度的替代指标。建立对一项研究的信任的三个基本要素包括:对论文的信任、对作者的信任和对数据的信任。为了以系统和自动化的方式解决这些要素,我们提出ripetaScore作为对论文研究实践、专业性和可重复性的直接衡量标准。通过使用我们当前学术论文语料库的一个样本,我们证明了ripetaScore在确定学术作品的质量、透明度和可信度方面的有效性。在本文中,我们旨在提供一个指标,从研究的透明度和可信度、专业性和可重复性方面评估科学报告的质量。