Li Xuan, Hao J Y
Military Medical Research Institute, Academy of Military Science, Chinese People's Liberation Army, Beijing, China.
Military Science Information Research Center, Academy of Military Science, Chinese People's Liberation Army, Beijing, China.
J R Army Med Corps. 2018 Jul;164(3):164-169. doi: 10.1136/jramc-2017-000863. Epub 2018 Jan 13.
Academic papers are an essential manner for describing new ideas and consolidating existing concepts in the field of military medicine. The academic impact of military medical publications reflects the extent and depth of recognition, acceptance and utilisation of the concepts transmitted in these publications. The aim of this research was to construct an evaluation index system suitable for evaluating the academic influence of scholars in the field of military medicine.
Using the Delphi consensus methodology, 30 experts from the field of military medicine, military medical information and library and information science were asked during three rounds of questioning to score the feasibility and importance of indicators that could be used to determine academic impact. An analytic hierarchy process method was used to calculate the relative weighting of each indicator in determining the final level of academic impact.
Eight evaluation indicators were agreed on to potentially determine academic impact. These comprised: 'Web of Science documents', 'Citation impact', 'h-index', 'Percentage of international collaborations', 'Percentage of the top 10% of the cited frequency', 'Category normalised citation impact', 'Percentage of documents cited' and 'The number of F1000 Recommended papers'.
The evaluation index system determined from this study combines the advantages of both qualitative and quantitative recognised evaluation indicators, which are subsequently weighted according to their importance in the field of military medicine. It is hoped that this framework will provide a manner in the future for comparing the potential academic impact of military medical scholars.
学术论文是描述军事医学领域新思想和巩固现有概念的重要方式。军事医学出版物的学术影响力反映了这些出版物中所传播概念的认可、接受和利用程度与深度。本研究的目的是构建一个适合评估军事医学领域学者学术影响力的评价指标体系。
采用德尔菲共识方法，在三轮询问过程中，向30位来自军事医学、军事医学信息以及图书馆与信息科学领域的专家询问可用于确定学术影响力的指标的可行性和重要性。采用层次分析法计算每个指标在确定学术影响力最终水平时的相对权重。
就可能用于确定学术影响力的八个评价指标达成了共识。这些指标包括：“科学引文索引（Web of Science）文献”、“被引影响”、“h指数”、“国际合作百分比”、“被引频次前10%的百分比”、“类别标准化被引影响”、“文献被引百分比”以及“F1000推荐论文数量”。
本研究确定的评价指标体系结合了定性和定量公认评价指标的优点，随后根据它们在军事医学领域的重要性进行加权。希望这个框架将来能为比较军事医学学者的潜在学术影响力提供一种方法。
