"Double First-class" Construction Office, West China Hospital, 34753Sichuan University, Chengdu, China.
Department of Cardiology, West China Hospital, Sichuan University, Chengdu, China.
Inquiry. 2021 Jan-Dec;58:469580211059469. doi: 10.1177/00469580211059469.
A specific and rational index system is key to scientific research evaluation. According to the characteristics and status of research-oriented hospitals in China, this study aimed to construct a comprehensive and methodical system for scientific research evaluation. Using bibliometric research, we sorted and refined indices for both domestic and international scientific research evaluation systems, established two-dimensional indices of input and output, and constructed the theoretical framework of evaluation after experts. The Delphi method was adopted to determine the evaluation indices at all levels, and the Analytic Hierarchy Process was used to calculate the weights of the indices at all levels. Twenty experts from different medical fields were involved in the 2 rounds study. Altogether, 7 primary, 14 secondary, and 37 tertiary indices were included in the evaluation system. A matrix was built to conduct the maximum eigenvalue, the consistency indices, and the consistency ratio of each expert in the survey. The index weight coefficients of the indices were calculated accordingly. The model exhibited high consistency, and the credibility of the results was verified. The evaluation system for research-oriented hospitals that we established had high specificity, credibility, and rationality. The evaluation system that we established combines some quantitative evaluation indicators, which are subsequently weighted according to their importance in the field of research-oriented hospital. Evaluation index system will provide the practical manner in the future for comparing the potential academic level and impact of research-oriented hospitals. Moreover, further verification, adjustments, and optimization of the system and indicators will be performed in follow-up empirical studies.
一个特定的和合理的指标体系是科研评价的关键。根据中国研究型医院的特点和现状，本研究旨在构建一个全面而系统的科研评价指标体系。采用文献计量学研究方法，对国内外科研评价体系的指标进行了分类和提炼，建立了投入和产出二维指标，并在专家的指导下构建了评价理论框架。采用德尔菲法确定各级评价指标，采用层次分析法计算各级指标权重。共有 20 名来自不同医学领域的专家参与了两轮研究。最终，评价体系共纳入 7 项一级指标、14 项二级指标和 37 项三级指标。建立矩阵对专家调查中的最大特征值、一致性指标和一致性比率进行分析，并计算相应的指标权重系数。该模型一致性较高，验证了结果的可信度。我们建立的研究型医院评价体系具有较高的特异性、可信度和合理性。该评价体系结合了一些定量评价指标，并根据其在研究型医院领域的重要性进行加权。评价指标体系将为未来比较研究型医院的潜在学术水平和影响力提供实际方法。此外，我们将在后续的实证研究中对系统和指标进行进一步的验证、调整和优化。
