Davis Laurie Laughlin, Pastor Dena A, Dodd Barbara G, Chiang Claire, Fitzpatrick Steven J
Pearson Educational Measurement, Austin, TX 78758, USA.
J Appl Meas. 2003;4(1):24-42.
The purpose of the present investigation was to systematically examine the effectiveness of the Sympson-Hetter technique and rotated content balancing relative to no exposure control and no content rotation conditions in a computerized adaptive testing system (CAT) based on the partial credit model. A series of simulated fixed and variable length CATs were run using two data sets generated to multiple content areas for three sizes of item pools. The 2 (exposure control) X 2 (content rotation) X 2 (test length) X 3 (item pool size) X 2 (data sets) yielded a total of 48 conditions. Results show that while both procedures can be used with no deleterious effect on measurement precision, the gains in exposure control, pool utilization, and item overlap appear quite modest. Difficulties involved with setting the exposure control parameters in small item pools make questionable the utility of the Sympson-Hetter technique with similar item pools.
本研究的目的是在基于部分计分模型的计算机自适应测试系统（CAT）中，相对于无暴露控制和无内容旋转条件，系统地检验辛普森-赫特技术和旋转内容平衡的有效性。使用针对三个项目库大小的多个内容领域生成的两个数据集，运行了一系列模拟的固定长度和可变长度CAT。2（暴露控制）×2（内容旋转）×2（测试长度）×3（项目库大小）×2（数据集）产生了总共48种条件。结果表明，虽然这两种程序都可以使用且对测量精度没有有害影响，但在暴露控制、题库利用率和项目重叠方面的收益似乎相当有限。在小项目库中设置暴露控制参数所涉及的困难使得辛普森-赫特技术在类似项目库中的实用性受到质疑。
