Department of Medicine, Yang Ming Campus, National Yang Ming Chiao Tung University College of Medicine, 155 Li-Long St., Sec. 2, Shih-Pai, Taipei, 112, Taiwan R.O.C.
Office of Medical Education, University of New South Wales, Sydney, Australia.
BMC Med Educ. 2022 May 10;22(1):356. doi: 10.1186/s12909-022-03435-2.
A rigorous faculty appointment and promotion (FAP) system is vital for the success of any academic institution. However, studies examining the FAP system in Asian universities are lacking. We surveyed the FAP policies of Taiwan's medical schools and identified an overreliance on the CJA score (manuscript Category, Journal quality, and Author order). The potential shortcomings of this metric and recommendations for refinement were discussed.
We obtained the FAP documents from all 12 medical schools in Taiwan, and analyzed their use of traditional versus non-traditional criteria for FAP according to a published methodology. The influence of the journal impact factor (JIF) on the FAP process was quantified by comparing its relative weight between papers with two extreme JIFs. To better understand the research impact and international standing of each school, we utilized the public bibliographic database to rank universities by the number of papers, and the proportions of papers within the top 10% or 50% citation.
Compared with other countries, Taiwan's medical schools focus more on the quantifiable quality of the research, mostly using a "CJA" score that integrates the category, JIF or ranking, and authorship of a paper, with the JIF being the most influential factor. The CJA score for an article with a JIF of 20 can be up to three times the threshold for promotion to Assistant Professor. The emphasis on JIF is based on a presumed correlation between JIF and citation counts. However, our analysis shows that Taiwan's medical schools have lower-than-average citation counts despite a competitive rank in the number of publications.
The JIF plays an unrivaled role in determining the outcome of FAP in Taiwan's medical schools, mostly via the CJA system. The questionable effectiveness of the current system in elevating the international standing of Taiwan's higher-education institutions calls for a re-examination of the FAP system. We recommend a reduction in the relative importance of CJA score in the FAP system, adopting more rigorous metrics such as the h-index for evaluating research quality, and supporting more research aimed at improving the FAP system.
严格的教职任命和晋升(FAP)制度对于任何学术机构的成功都至关重要。然而,在亚洲大学中,对 FAP 系统的研究还很缺乏。我们调查了台湾医学院的 FAP 政策,并发现对 CJA 评分(稿件类别、期刊质量和作者顺序)的过度依赖。讨论了这种衡量标准的潜在缺点和改进建议。
我们从台湾的 12 所医学院获得了 FAP 文件,并根据已发表的方法分析了它们对 FAP 的传统和非传统标准的使用。通过比较具有两种极端 JIF 的论文之间的 JIF 相对权重,量化了期刊影响因子(JIF)对 FAP 过程的影响。为了更好地了解每个学校的研究影响力和国际地位,我们利用公共书目数据库,根据论文数量对大学进行排名,并根据论文在前 10%或 50%被引中的比例进行排名。
与其他国家相比,台湾的医学院更加注重研究的可量化质量,主要使用“CJA”评分来综合考虑论文的类别、JIF 或排名以及作者身份,其中 JIF 是最具影响力的因素。一篇 JIF 为 20 的论文的 CJA 评分可能高达晋升助理教授的门槛的三倍。对 JIF 的重视是基于 JIF 与引文计数之间的假定相关性。然而,我们的分析表明,尽管台湾的医学院在论文数量方面排名较高,但它们的引文计数却低于平均水平。
JIF 在决定台湾医学院 FAP 的结果方面发挥着无与伦比的作用,主要是通过 CJA 系统。目前的系统在提高台湾高等教育机构的国际地位方面的有效性值得质疑,需要重新审查 FAP 系统。我们建议在 FAP 系统中降低 CJA 评分的相对重要性,采用更严格的指标,如 h 指数来评估研究质量,并支持更多旨在改进 FAP 系统的研究。