Kreiter C D, Ferguson K, Gruppen L D
Office of Consultation and Research in Medical Education, University of Iowa College of Medicine, Iowa City 52242-1008, USA.
Acad Med. 1999 Oct;74(10):1125-8. doi: 10.1097/00001888-199910000-00016.
This study investigated the feasibility of converting an existing computer-administered, in-course internal medicine test to an adaptive format.
A 200-item internal medicine extended matching test was used for this research. Parameters were estimated with commercially available software with responses from 621 examinees. A specially developed simulation program was used to retrospectively estimate the efficiency of the computer-adaptive exam format.
It was found that the average test length could be shortened by almost half with measurement precision approximately equal to that of the full 200-item paper-and-pencil test. However, computer-adaptive testing with this item bank provided little advantage for examinees at the upper end of the ability continuum. An examination of classical item statistics and IRT item statistics suggested that adding more difficult items might extend the advantage to this group of examinees.
Medical item banks presently used for incourse assessment might be advantageously employed in adaptive testing. However, it is important to evaluate the match between the items and the measurement objective of the test before implementing this format.
本研究调查了将现有的计算机 administered、课程内内科测试转换为自适应形式的可行性。
本研究使用了一个200项的内科扩展匹配测试。使用商业软件根据621名考生的回答估计参数。使用专门开发的模拟程序回顾性地估计计算机自适应考试形式的效率。
发现平均测试长度可以缩短近一半，测量精度与完整的200项纸笔测试大致相同。然而，使用此题库进行计算机自适应测试对能力连续体高端的考生几乎没有优势。对经典项目统计和IRT项目统计的检查表明，增加更多难度较大的项目可能会将优势扩展到这组考生。
目前用于课程内评估的医学题库可能有利于用于自适应测试。然而，在实施这种形式之前，评估项目与测试测量目标之间的匹配度很重要。
