BIH QUEST Center for Responsible Research, Berlin Institute of Health at Charité Universitätsmedizin Berlin, Berlin, Germany.
Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health & Social Work, Queensland University of Technology, Brisbane, QLD, Australia.
BMC Res Notes. 2022 Jun 11;15(1):203. doi: 10.1186/s13104-022-06080-6.
The rising rate of preprints and publications, combined with persistent inadequate reporting practices and problems with study design and execution, have strained the traditional peer review system. Automated screening tools could potentially enhance peer review by helping authors, journal editors, and reviewers to identify beneficial practices and common problems in preprints or submitted manuscripts. Tools can screen many papers quickly, and may be particularly helpful in assessing compliance with journal policies and with straightforward items in reporting guidelines. However, existing tools cannot understand or interpret the paper in the context of the scientific literature. Tools cannot yet determine whether the methods used are suitable to answer the research question, or whether the data support the authors' conclusions. Editors and peer reviewers are essential for assessing journal fit and the overall quality of a paper, including the experimental design, the soundness of the study's conclusions, potential impact and innovation. Automated screening tools cannot replace peer review, but may aid authors, reviewers, and editors in improving scientific papers. Strategies for responsible use of automated tools in peer review may include setting performance criteria for tools, transparently reporting tool performance and use, and training users to interpret reports.
预印本和出版物数量的不断增加,加上报告实践的持续不足以及研究设计和执行方面的问题,给传统的同行评审系统带来了压力。自动化筛选工具可以通过帮助作者、期刊编辑和审稿人识别预印本或提交的手稿中的有益实践和常见问题,从而潜在地增强同行评审。这些工具可以快速筛选许多论文,并且在评估期刊政策和报告指南中的简单项目方面可能特别有帮助。然而,现有的工具无法理解或解释论文在科学文献中的上下文。这些工具目前还无法确定所使用的方法是否适合回答研究问题,或者数据是否支持作者的结论。编辑和同行评审者对于评估期刊的适合性以及论文的整体质量至关重要,包括实验设计、研究结论的合理性、潜在的影响和创新性。自动化筛选工具不能替代同行评审,但可以帮助作者、审稿人和编辑改进科学论文。在同行评审中负责任地使用自动化工具的策略可能包括为工具设定绩效标准、透明地报告工具的性能和使用情况,以及培训用户解读报告。