Shashok Karen
Translator and Editorial consultant, Compositor Ruiz Aznar 12, 2-A 18008 GRANADA, Spain.
BMC Med Res Methodol. 2008 Jan 31;8:3. doi: 10.1186/1471-2288-8-3.
Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes.
The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written.
Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now.
同行评议被认为可提高作为科学交流工具的研究报告的质量,但一直难以获得确凿证据证明始终能取得这一成果。未能区分特定学科内容的各个方面与写作或语言使用的各个方面,可能是当前同行评议过程中存在一些缺陷的原因。
同行评议的过程和结果可从两个维度进行分析:1)识别对其他研究人员有用的科学或技术内容(即其“筛选”功能),以及2)将研究文章改进为交流工具(即其“改进”功能)。然而,编辑和审稿人并不总是能清楚地区分内容标准和写作标准。当同行审稿人混淆内容和写作时,作者可能会误解他们的反馈,从而可能以不利于读者理解的方式修改文本。当同行评议中的研究人员混淆这两个维度时,可能会导致内容效度问题,阻碍定义信息变量和结果测量的尝试,从而无法呈现清晰的趋势。关于写作、修订和编辑的研究揭示了同行评议在改进所写内容方面并非总是像预期那样有效的一些原因。
如果利益相关者更加意识到把关人(审稿人和编辑)在提供有关内容或写作的反馈方面能力存在差异,同行评议可能会得到改进。把关人、学术素养研究人员和文字处理专业人员(作者编辑、医学撰写人员和翻译人员)可以共同努力,找出作者认为最有用的反馈类型。我提出了一些建议,以帮助编辑学家设计更好的同行评议研究,使这一过程比现在更有力地成为改进稿件的工具。