Hoffman K I
Department of Medical Education KAM-200, USC School of Medicine, Los Angeles 90033.
Acad Med. 1993 Oct;68(10):740-7. doi: 10.1097/00001888-199310000-00003.
This second of the four-part set of articles published in this issue examines the appropriateness of using scores on the Step 1 and Step 2 examinations of the United States Medical Licensing Examination (USMLE) to make individual academic achievement decisions (e.g., for promotion or graduation) and the appropriateness of determining course grades by using scores on the National Board of Medical Examiners (NBME) Subject Examinations. The article attempts to make explicit the underlying philosophical and psychometric assumptions involved in using these examinations for such purposes. Specifically, in using the USMLE examinations for promotion and/or graduation, one assumes (1) that the competencies measured by the examinations are essential requirements for graduation or promotion, and (2) that these competencies are not effectively measured by current in-school assessment or that they need an external verification. In using the NBME subject examinations for in-course grading, one assumes (1) that grades should reflect the student's current (end-of-course) knowledge in a subject area; (2) that grades should reflect global content knowledge versus knowledge of content presented during the course; and (3) that grades should be assigned in a normative versus a criterion- or content-referenced manner unless percent-correct scores are specifically requested and properly used. The author argues for and against the viability of the various assumptions stated in the article and concludes that there are dangers and limitations in using the USMLE examinations and the NBME subject examinations for internal academic decision making.(ABSTRACT TRUNCATED AT 250 WORDS)
本期发表的四篇系列文章中的第二篇,探讨了使用美国医学执照考试(USMLE)第一步和第二步考试的分数来做出个人学业成就决定(如晋升或毕业)的合理性,以及使用美国国家医学考试委员会(NBME)科目考试的分数来确定课程成绩的合理性。本文试图明确将这些考试用于此类目的所涉及的潜在哲学和心理测量学假设。具体而言,在使用USMLE考试进行晋升和/或毕业评估时,人们假定:(1)考试所衡量的能力是毕业或晋升的必要条件;(2)当前校内评估无法有效衡量这些能力,或者需要外部验证。在使用NBME科目考试进行课程评分时,人们假定:(1)成绩应反映学生在某一学科领域当前(课程结束时)的知识水平;(2)成绩应反映整体内容知识,而非课程中所呈现内容的知识;(3)成绩应以常模参照而非标准参照或内容参照的方式评定,除非特别要求并正确使用百分制正确得分。作者对文中所述各种假设能否成立进行了正反两方面的论证,并得出结论:将USMLE考试和NBME科目考试用于内部学业决策存在风险和局限性。(摘要截选于250字)