University of Toledo College of Medicine and Life Sciences, Toledo, Ohio, United States.
Departments of Medical Education and Neurology, University of Toledo College of Medicine and Life Sciences, Toledo, Ohio, United States.
BMC Med Educ. 2023 Jul 31;23(1):543. doi: 10.1186/s12909-023-04530-8.
The purpose of this systematic review was to (1) determine the scope of literature measuring USMLE Step 1 and Step 2 CK as predictors or indicators of quality resident performance across all medical specialties and (2) summarize the ability of Step 1 and Step 2 CK to predict quality resident performance, stratified by ACGME specialties, based on available literature.
This systematic review was designed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [16]. The original search strategy surveyed MEDLINE and was adapted to survey Cochrane Library and Embase. A study was deemed eligible if it provided all three of the following relevant information: (a) Step 1 or Step 2 CK as indicators for (b) resident outcomes in (c) any ACGME accredited specialty training program.
A total of 1803 articles were screened from three separate databases. The 92 included studies were stratified by specialty, with Surgery (21.7% [20/92]), Emergency Medicine (13.0% [12/92]), Internal Medicine (10.9% [10/92]), and Orthopedic Surgery (8.7% [8/92]) being the most common. Common resident performance measures included ITE scores, board certification, ACGME milestone ratings, and program director evaluations.
Further studies are imperative to discern the utility of Step 1 and Step 2 CK as predictors of resident performance and as tools for resident recruitment and selection. The results of this systematic review suggest that a scored Step 1 dated prior to January 2022 can be useful as a tool in a holistic review of future resident performance, and that Step 2 CK score performance may be an effective tool in the holistic review process. Given its inherent complexity, multiple tools across many assessment modalities are necessary to assess resident performance comprehensively and effectively.
本系统评价的目的是:(1)确定测量 USMLE 步骤 1 和步骤 2 CK 的文献范围,以预测或指示所有医学专业的住院医师质量表现;(2)根据现有文献,总结步骤 1 和步骤 2 CK 预测住院医师质量表现的能力,按 ACGME 专业进行分层。
本系统评价根据《系统评价和荟萃分析的首选报告项目》(PRISMA)[16]进行设计。原始搜索策略调查了 MEDLINE,并对 Cochrane Library 和 Embase 进行了改编。如果一项研究提供了以下所有三项相关信息,则被认为是合格的:(a)步骤 1 或步骤 2 CK 作为(b)任何 ACGME 认可的专业培训计划中的(c)住院医师结果的指标。
从三个独立的数据库中筛选出 1803 篇文章。92 项纳入研究按专业进行分层,其中外科(21.7%[20/92])、急诊医学(13.0%[12/92])、内科(10.9%[10/92])和矫形外科(8.7%[8/92])是最常见的。常见的住院医师表现评估指标包括 ITE 评分、委员会认证、ACGME 里程碑评估和项目主任评估。
进一步的研究对于确定步骤 1 和步骤 2 CK 作为住院医师表现预测指标的效用以及作为住院医师招募和选择工具的效用至关重要。本系统评价的结果表明,在对未来住院医师表现进行整体评估时,可将 2022 年 1 月之前获得的有分数的步骤 1 作为工具使用,步骤 2 CK 评分表现可能是整体评估过程中的有效工具。鉴于其固有的复杂性,需要使用多种工具和多个评估模式来全面、有效地评估住院医师的表现。