Seal Zachary A, Koek Wouter, Sharma Ramaswamy
Medical Education and Simulation, University of Texas Health Science Center at San Antonio, San Antonio, USA.
Psychiatry, University of Texas Health Science Center at San Antonio, San Antonio, USA.
Cureus. 2020 Apr 2;12(4):e7519. doi: 10.7759/cureus.7519.
Purpose Candidates' performance on the United States Medical Licensing Examination (USMLE) Step 1 examination had been correlated with the Medical College Admission Test (MCAT). However, in 2015, a new MCAT format was released and its correlation with Step 1 remains to be fully analyzed. Preparation for Step 1 typically involves purchasing and perusing practice tests from the National Board of Medical Examiners (NBME) and UWorld; however, their predictive value to performance on Step 1 remains to be ascertained, especially with the release of five new NBME practice tests. Additionally, there is a need for accurately predicting Step 1 scores to self-evaluate study progress and reduce student anxiety. Rationale Program directors rank USMLE Step 1 scores as the number one criterion in selecting interviewees for residency. Step 1 scores are more important than Step 2 scores, Dean's letter, or other letters of recommendation in determining the overall ranking of a candidate after interviews. Hypotheses The authors hypothesized that the new MCAT scores correlated positively with Step 1 scores and that the new NBME practice tests were more predictive of performance on Step 1 as compared to old NBME tests. Methods Linear regression analysis followed by either analysis of variance (ANOVA) or Student's t-tests were used to analyze 399 responses. Data obtained was used to update an existing Step 1 score predictor, which was then validated. Results A positive correlation between the MCAT (average score: 510.1 ± 6.3) and Step 1 scores (average score: 246.1 ± 14.2) was observed. While new NBME practice tests were more predictive of Step 1 scores than old NBME tests, UWorld test scores were the most predictive. Students who practiced with the new NBME practice tests scored significantly higher than students who did not use them. However, students using any of the UWorld practice tests did significantly better than students who practiced using only NBME practice tests but not UWorld practice tests. Ironically, NBME16,the second-most correlativetest to Step 1 performance, is no longer available for purchase. Overall, taking six or more practice tests significantly enhanced Step 1 scores; the optimal number of tests was found to be between six and nine. The predicted score by an updated Step 1 score predictor was within 3.8 points or 1.6% of the actual Step 1 score. Conclusions We believe this study will aid in the selection and purchase of appropriate self-assessment tests as preparatory material for the USMLE Step 1 examination. It will also introduce them to an existing Step 1 score predictor that will help determine their readiness for Step 1.
目的 美国执业医师资格考试(USMLE)第一步考试中考生的表现一直与医学院入学考试(MCAT)相关。然而,2015年发布了新的MCAT考试形式,其与第一步考试的相关性仍有待全面分析。第一步考试的备考通常包括从美国国家医学考试委员会(NBME)和优思得(UWorld)购买并研读模拟试题;然而,它们对第一步考试表现的预测价值仍有待确定,尤其是在新发布了五套NBME模拟试题之后。此外,需要准确预测第一步考试成绩以自我评估学习进度并减轻学生焦虑。
理论依据 项目主任将USMLE第一步考试成绩列为选拔住院医师面试候选人的首要标准。在确定面试后候选人的综合排名时,第一步考试成绩比第二步考试成绩、院长推荐信或其他推荐信更重要。
假设 作者假设新的MCAT成绩与第一步考试成绩呈正相关,并且与旧的NBME考试相比,新的NBME模拟试题对第一步考试表现的预测性更强。
方法 采用线性回归分析,随后进行方差分析(ANOVA)或学生t检验来分析399份回复。所获得的数据用于更新现有的第一步考试成绩预测模型,然后对其进行验证。
结果 观察到MCAT(平均成绩:510.1±6.3)与第一步考试成绩(平均成绩:246.1±14.2)之间呈正相关。虽然新的NBME模拟试题比旧的NBME考试对第一步考试成绩的预测性更强,但优思得模拟试题的预测性最强。使用新的NBME模拟试题练习的学生得分显著高于未使用的学生。然而,使用任何优思得模拟试题的学生比仅使用NBME模拟试题而未使用优思得模拟试题练习的学生表现明显更好。具有讽刺意味的是,与第一步考试表现相关性第二高的NBME16已不再可供购买。总体而言,进行六次或更多次模拟试题练习显著提高了第一步考试成绩;发现最佳练习次数在六至九次之间。更新后的第一步考试成绩预测模型预测的分数与实际第一步考试成绩相差在3.8分以内或1.6%以内。
结论 我们相信这项研究将有助于选择和购买合适的自我评估测试题作为USMLE第一步考试的备考材料。它还将向考生介绍现有的第一步考试成绩预测模型,这将有助于确定他们对第一步考试的准备程度。