Salimi Negin
Leiden University, Leiden, The Netherlands.
Scientometrics. 2017;112(1):195-213. doi: 10.1007/s11192-017-2284-3. Epub 2017 Feb 16.
Assessing the quality of scientific outputs (i.e. research papers, books and reports) is a challenging issue. Although in practice, the basic quality of scientific outputs is evaluated by committees/peers (peer review) who have general knowledge and competencies. However, their assessment might not comprehensively consider different dimensions of the quality of the scientific outputs. Hence, there is a requirement to evaluate scientific outputs based on some other metrics which cover more aspects of quality after publishing, which is the aim of this study. To reach this aim, first different quality metrics are identified through an extensive literature review. Then a recently developed multi-criteria methodology (best worst method) is used to find the importance of each quality metric. Finally, based on the importance of each quality metric and the data which are collected from Scopus, the quality of research papers published by the members of a university faculty is measured. The proposed model in this paper provides the opportunity to measure quality of research papers not only by considering different aspects of quality, but also by considering the importance of each quality metric. The proposed model can be used for assessing other scientific outputs as well.
评估科学成果(即研究论文、书籍和报告)的质量是一个具有挑战性的问题。虽然在实践中,科学成果的基本质量是由具有一般知识和能力的委员会/同行进行评估(同行评审)。然而,他们的评估可能没有全面考虑科学成果质量的不同维度。因此,需要基于一些其他指标来评估科学成果,这些指标在发表后能涵盖更多质量方面,这就是本研究的目的。为了实现这一目标,首先通过广泛的文献综述确定不同的质量指标。然后使用一种最近开发的多标准方法(最佳 - 最差方法)来确定每个质量指标的重要性。最后,根据每个质量指标的重要性以及从Scopus收集的数据,衡量一所大学教师发表的研究论文的质量。本文提出的模型不仅提供了通过考虑质量的不同方面来衡量研究论文质量的机会,还考虑了每个质量指标的重要性。所提出的模型也可用于评估其他科学成果。