Department of Information Engineering and Computer Science, University of Trento Trento, Italy.
Front Comput Neurosci. 2011 Dec 14;5:56. doi: 10.3389/fncom.2011.00056. eCollection 2011.
In this paper we review several novel approaches for research evaluation. We start with a brief overview of the peer review, its controversies, and metrics for assessing efficiency and overall quality of the peer review. We then discuss five approaches, including reputation-based ones, that come out of the research carried out by the LiquidPub project and research groups collaborated with LiquidPub. Those approaches are alternative or complementary to traditional peer review. We discuss pros and cons of the proposed approaches and conclude with a vision for the future of the research evaluation, arguing that no single system can suit all stakeholders in various communities.
本文综述了几种新颖的研究评估方法。我们首先简要概述了同行评议，及其争议，以及评估同行评议的效率和整体质量的指标。然后，我们讨论了五种方法，包括基于声誉的方法，这些方法源自 LiquidPub 项目和与 LiquidPub 合作的研究小组开展的研究。这些方法是对传统同行评议的替代或补充。我们讨论了所提出方法的优缺点，并对研究评估的未来提出展望，认为没有单一的系统可以满足不同社区的所有利益相关者的需求。
