Sharma Akshita, Schauer Daniel P, Kelleher Matthew, Kinnear Benjamin, Sall Dana, Warm Eric
J Grad Med Educ. 2019 Aug;11(4):412-419. doi: 10.4300/JGME-D-19-00099.1.
Internal medicine (IM) residency programs receive information about applicants via academic transcripts, but studies demonstrate wide variability in satisfaction with and usefulness of this information. In addition, many studies compare application materials to only 1 or 2 assessment metrics, usually standardized test scores and work-based observational faculty assessments.
We sought to determine which application materials best predict performance across a broad array of residency assessment outcomes generated by standardized testing and a yearlong IM residency ambulatory long block.
In 2019, we analyzed available Electronic Residency Application Service data for 167 categorical IM residents, including advanced degree status, research experience, failures during medical school, undergraduate medical education award status, and United States Medical Licensing Examination (USMLE) scores. We compared these with post-match residency multimodal performance, including standardized test scores and faculty member, peer, allied health professional, and patient-level assessment measures.
In multivariate analyses, USMLE Step 2 Clinical Knowledge (CK) scores were most predictive of performance across all residency performance domains measured. Having an advanced degree was associated with higher patient-level assessments (eg, physician listens, physician explains, etc). USMLE Step 1 scores were associated with in-training examination scores only. None of the other measured application materials predicted performance.
USMLE Step 2 CK scores were the highest predictors of residency performance across a broad array of performance measurements generated by standardized testing and an IM residency ambulatory long block.
内科住院医师培训项目通过学术成绩单获取申请人的信息,但研究表明,人们对这些信息的满意度和有用性差异很大。此外,许多研究仅将申请材料与一两个评估指标进行比较,通常是标准化考试成绩和基于工作的观察性教师评估。
我们试图确定哪些申请材料能最好地预测由标准化测试和为期一年的内科住院医师门诊长期培训所产生的一系列住院医师评估结果中的表现。
2019年,我们分析了167名分类内科住院医师的可用电子住院医师申请服务数据,包括学位状况、研究经历、医学院期间的不及格情况、本科医学教育奖励状况以及美国医学执照考试(USMLE)成绩。我们将这些数据与匹配后的住院医师多模式表现进行比较,包括标准化考试成绩以及教师、同行、专职医疗人员和患者层面的评估指标。
在多变量分析中,USMLE第二步临床知识(CK)分数最能预测所测量的所有住院医师表现领域的表现。拥有高级学位与更高的患者层面评估(例如,医生倾听、医生解释等)相关。USMLE第一步成绩仅与培训期间考试成绩相关。其他所测量的申请材料均不能预测表现。
在由标准化测试和内科住院医师门诊长期培训所产生的一系列表现测量中,USMLE第二步CK分数是住院医师表现的最强预测指标。