文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

Reviewer training for improving grant and journal peer review.

作者信息

Hesselberg Jan-Ole, Dalsbø Therese K, Stromme Hilde, Svege Ida, Fretheim Atle

机构信息

Department of Psychology, University of Oslo, Oslo, Norway.

Stiftelsen Dam, Oslo, Norway.

出版信息

Cochrane Database Syst Rev. 2023 Nov 28;11(11):MR000056. doi: 10.1002/14651858.MR000056.pub2.


DOI:10.1002/14651858.MR000056.pub2
PMID:38014743
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10683016/
Abstract

BACKGROUND: Funders and scientific journals use peer review to decide which projects to fund or articles to publish. Reviewer training is an intervention to improve the quality of peer review. However, studies on the effects of such training yield inconsistent results, and there are no up-to-date systematic reviews addressing this question. OBJECTIVES: To evaluate the effect of peer reviewer training on the quality of grant and journal peer review. SEARCH METHODS: We used standard, extensive Cochrane search methods. The latest search date was 27 April 2022. SELECTION CRITERIA: We included randomized controlled trials (RCTs; including cluster-RCTs) that evaluated peer review with training interventions versus usual processes, no training interventions, or other interventions to improve the quality of peer review. DATA COLLECTION AND ANALYSIS: We used standard Cochrane methods. Our primary outcomes were 1. completeness of reporting and 2. peer review detection of errors. Our secondary outcomes were 1. bibliometric scores, 2. stakeholders' assessment of peer review quality, 3. inter-reviewer agreement, 4. process-centred outcomes, 5. peer reviewer satisfaction, and 6. completion rate and speed of funded projects. We used the first version of the Cochrane risk of bias tool to assess the risk of bias, and we used GRADE to assess the certainty of evidence. MAIN RESULTS: We included 10 RCTs with a total of 1213 units of analysis. The unit of analysis was the individual reviewer in seven studies (722 reviewers in total), and the reviewed manuscript in three studies (491 manuscripts in total). In eight RCTs, participants were journal peer reviewers. In two studies, the participants were grant peer reviewers. The training interventions can be broadly divided into dialogue-based interventions (interactive workshop, face-to-face training, mentoring) and one-way communication (written information, video course, checklist, written feedback). Most studies were small. We found moderate-certainty evidence that emails reminding peer reviewers to check items of reporting checklists, compared with standard journal practice, have little or no effect on the completeness of reporting, measured as the proportion of items (from 0.00 to 1.00) that were adequately reported (mean difference (MD) 0.02, 95% confidence interval (CI) -0.02 to 0.06; 2 RCTs, 421 manuscripts). There was low-certainty evidence that reviewer training, compared with standard journal practice, slightly improves peer reviewer ability to detect errors (MD 0.55, 95% CI 0.20 to 0.90; 1 RCT, 418 reviewers). We found low-certainty evidence that reviewer training, compared with standard journal practice, has little or no effect on stakeholders' assessment of review quality in journal peer review (standardized mean difference (SMD) 0.13 standard deviations (SDs), 95% CI -0.07 to 0.33; 1 RCT, 418 reviewers), or change in stakeholders' assessment of review quality in journal peer review (SMD -0.15 SDs, 95% CI -0.39 to 0.10; 5 RCTs, 258 reviewers). We found very low-certainty evidence that a video course, compared with no video course, has little or no effect on inter-reviewer agreement in grant peer review (MD 0.14 points, 95% CI -0.07 to 0.35; 1 RCT, 75 reviewers). There was low-certainty evidence that structured individual feedback on scoring, compared with general information on scoring, has little or no effect on the change in inter-reviewer agreement in grant peer review (MD 0.18 points, 95% CI -0.14 to 0.50; 1 RCT, 41 reviewers, low-certainty evidence). AUTHORS' CONCLUSIONS: Evidence from 10 RCTs suggests that training peer reviewers may lead to little or no improvement in the quality of peer review. There is a need for studies with more participants and a broader spectrum of valid and reliable outcome measures. Studies evaluating stakeholders' assessments of the quality of peer review should ensure that these instruments have sufficient levels of validity and reliability.

摘要

相似文献

[1]
Reviewer training for improving grant and journal peer review.

Cochrane Database Syst Rev. 2023-11-28

[2]
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.

Cochrane Database Syst Rev. 2022-2-1

[3]
Tailored or adapted interventions for adults with chronic obstructive pulmonary disease and at least one other long-term condition: a mixed methods review.

Cochrane Database Syst Rev. 2021-7-26

[4]
Peer support interventions for parents and carers of children with complex needs.

Cochrane Database Syst Rev. 2021-12-20

[5]
Face-to-face interventions for informing or educating parents about early childhood vaccination.

Cochrane Database Syst Rev. 2018-5-8

[6]
Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals.

Cochrane Database Syst Rev. 2012-11-14

[7]
Interventions for improving medical students' interpersonal communication in medical consultations.

Cochrane Database Syst Rev. 2021-2-8

[8]
Interventions for improving health literacy in migrants.

Cochrane Database Syst Rev. 2023-11-14

[9]
Educational and psychological interventions for managing atopic dermatitis (eczema).

Cochrane Database Syst Rev. 2024-8-12

[10]
Cardiovascular training for fatigue in people with cancer.

Cochrane Database Syst Rev. 2025-2-20

引用本文的文献

[1]
The costs of competition in distributing scarce research funds.

Proc Natl Acad Sci U S A. 2024-12-10

[2]
Peer Review in Pharmacovigilance: Lens on Disproportionality Analysis.

Drug Saf. 2024-7

[3]
A structured, journal-led peer-review mentoring program enhances peer review training.

Res Integr Peer Rev. 2024-3-8

[4]
The critical role of peer reviewers: Challenges and future steps.

Nordisk Alkohol Nark. 2023-2

本文引用的文献

[1]
Reminding Peer Reviewers of Reporting Guideline Items to Improve Completeness in Published Articles: Primary Results of 2 Randomized Trials.

JAMA Netw Open. 2023-6-1

[2]
Nobel and novice: Author prominence affects peer review.

Proc Natl Acad Sci U S A. 2022-10-11

[3]
Peer Reviewed Evaluation of Registered End-Points of Randomised Trials (the PRE-REPORT study): a stepped wedge, cluster-randomised trial.

BMJ Open. 2022-9-28

[4]
What works for peer review and decision-making in research funding: a realist synthesis.

Res Integr Peer Rev. 2022-3-4

[5]
Individual versus general structured feedback to improve agreement in grant peer review: a randomized controlled trial.

Res Integr Peer Rev. 2021-9-30

[6]
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews.

BMJ. 2021-3-29

[7]
A randomized trial of an editorial intervention to reduce spin in the abstract's conclusion of manuscripts showed no significant effect.

J Clin Epidemiol. 2021-2

[8]
Effect of an editorial intervention to improve the completeness of reporting of randomised trials: a randomised controlled trial.

BMJ Open. 2020-5-18

[9]
Impact of a short version of the CONSORT checklist for peer reviewers to improve the reporting of randomised controlled trials published in biomedical journals: study protocol for a randomised controlled trial.

BMJ Open. 2020-3-19

[10]
Enhanced peer-review for optimising publication of biomedical papers submitted from low- and middle-income countries: feasibility study for a randomised controlled trial.

BJPsych Open. 2019-3

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索