K. Short is program officer, National Board of Medical Examiners, Philadelphia, Pennsylvania; ORCID: http://orcid.org/0000-0001-9602-3124. S.D. Bucak is manager, National Board of Medical Examiners, Philadelphia, Pennsylvania; http://orcid.org/0000-0002-4370-8266. F. Rosenthal is senior editor, National Board of Medical Examiners, Philadelphia, Pennsylvania. M.R. Raymond is research director and principal assessment scientist, National Board of Medical Examiners, Philadelphia, Pennsylvania.
Acad Med. 2018 May;93(5):781-785. doi: 10.1097/ACM.0000000000001906.
In 2007, the United States Medical Licensing Examination embedded multimedia simulations of heart sounds into multiple-choice questions. This study investigated changes in item difficulty as determined by examinee performance over time. The data reflect outcomes obtained following initial use of multimedia items from 2007 through 2012, after which an interface change occurred.
A total of 233,157 examinees responded to 1,306 cardiology test items over the six-year period; 138 items included multimedia simulations of heart sounds, while 1,168 text-based items without multimedia served as controls. The authors compared changes in difficulty of multimedia items over time with changes in difficulty of text-based cardiology items over time. Further, they compared changes in item difficulty for both groups of items between graduates of Liaison Committee on Medical Education (LCME)-accredited and non-LCME-accredited (i.e., international) medical schools.
Examinee performance on cardiology test items with multimedia heart sounds improved by 12.4% over the six-year period, while performance on text-based cardiology items improved by approximately 1.4%. These results were similar for graduates of LCME-accredited and non-LCME-accredited medical schools.
Examinees' ability to interpret auscultation findings in test items that include multimedia presentations increased from 2007 to 2012.
2007 年,美国医师执照考试在多项选择题中嵌入了心脏音的多媒体模拟。本研究调查了随时间推移考生表现所决定的项目难度变化。这些数据反映了 2007 年至 2012 年首次使用多媒体项目后的结果,此后界面发生了变化。
共有 233157 名考生在六年期间回答了 1306 项心脏病学测试题;其中 138 项包含心脏音的多媒体模拟,而 1168 项无多媒体的基于文本的项目作为对照。作者比较了多媒体项目随时间的难度变化与基于文本的心脏病学项目随时间的难度变化。此外,他们还比较了两组项目在医学教育联络委员会(LCME)认证和非 LCME 认证(即国际)医学院毕业生之间的项目难度变化。
在六年期间,考生在包含多媒体心脏音的心脏病学测试题中的表现提高了 12.4%,而在基于文本的心脏病学测试题中的表现提高了约 1.4%。LCME 认证和非 LCME 认证医学院毕业生的结果相似。
从 2007 年到 2012 年,考生在包含多媒体演示的测试题中解释听诊结果的能力有所提高。