Leroux Audrey J, Waid-Ebbs J Kay, Wen Pey-Shan, Helmer Drew A, Graham David P, O'Connor Maureen K, Ray Kathleen
Georgia State University, Atlanta, GA, USA.
Veterans Administration North Florida/South Georgia Veterans Health System, Gainesville, FL, USA.
Appl Psychol Meas. 2019 Nov;43(8):624-638. doi: 10.1177/0146621618824856. Epub 2019 Jan 23.
The purpose of this simulation study was to investigate the effect of several different item exposure control procedures in computerized adaptive testing (CAT) with variable-length stopping rules using the partial credit model. Previous simulation studies on CAT exposure control methods with polytomous items rarely considered variable-length tests. The four exposure control techniques examined were the randomesque with a group of three items, randomesque with a group of six items, progressive-restricted standard error (PR-SE), and no exposure control. The two variable-length stopping rules included were the and predicted standard error reduction (PSER), along with three item pools of varied sizes (43, 86, and 172 items). Descriptive statistics on number of nonconvergent cases, measurement precision, testing burden, item overlap, item exposure, and pool utilization were calculated. Results revealed that the PSER stopping rule administered fewer items on average while maintaining measurement precision similar to the stopping rule across the different item pool sizes and exposure controls. The PR-SE exposure control procedure surpassed the randomesque methods by further reducing test overlap, maintaining maximum exposure rates at the target rate or lower, and utilizing all items from the pool with a minimal increase in number of items administered and nonconvergent cases.
本模拟研究的目的是使用部分计分模型，在具有可变长度停止规则的计算机自适应测试（CAT）中，研究几种不同的项目曝光控制程序的效果。先前关于多分类项目的CAT曝光控制方法的模拟研究很少考虑可变长度测试。所考察的四种曝光控制技术分别是一组三个项目的类似随机法、一组六个项目的类似随机法、渐进限制标准误差（PR-SE）以及无曝光控制。所纳入的两个可变长度停止规则分别是预测标准误差缩减（PSER），以及三个不同规模（43、86和172个项目）的项目库。计算了关于非收敛情况数量、测量精度、测试负担、项目重叠、项目曝光和库利用率的描述性统计量。结果显示，在不同的项目库规模和曝光控制条件下，PSER停止规则平均施测的项目较少，同时保持了与 停止规则相似的测量精度。PR-SE曝光控制程序通过进一步减少测试重叠、将最大曝光率维持在目标率或更低水平以及使用库中的所有项目，且施测项目数量和非收敛情况数量仅有少量增加，从而超过了类似随机法。
