Suppr超能文献

控制计算机自适应测试中的最小项目曝光率:一种两阶段的辛普森-赫特程序。

Controlling the Minimum Item Exposure Rate in Computerized Adaptive Testing: A Two-Stage Sympson-Hetter Procedure.

作者信息

Chao Hsiu-Yi, Chen Jyun-Hong

机构信息

Soochow University, Taiwan.

National Cheng Kung University, Taiwan.

出版信息

Appl Psychol Meas. 2023 Nov;47(7-8):460-477. doi: 10.1177/01466216231209756. Epub 2023 Oct 20.

Abstract

Computerized adaptive testing (CAT) can improve test efficiency, but it also causes the problem of unbalanced item usage within a pool. The effect of uneven item exposure rates can not only induce a test security problem due to overexposed items but also raise economic concerns about item pool development due to underexposed items. Therefore, this study proposes a two-stage Sympson-Hetter (TSH) method to enhance balanced item pool utilization by simultaneously controlling the minimum and maximum item exposure rates. The TSH method divides CAT into two stages. While the item exposure rates are controlled above a prespecified level (e.g., ) in the first stage to increase the exposure rates of the underexposed items, they are controlled below another prespecified level (e.g., ) in the second stage to prevent items from overexposure. To reduce the effect on trait estimation, TSH only administers a minimum sufficient number of underexposed items that are generally less discriminating in the first stage of CAT. The simulation study results indicate that the TSH method can effectively improve item pool usage without clearly compromising trait estimation precision in most conditions while maintaining the required level of test security.

摘要

计算机自适应测试(CAT)可以提高测试效率,但它也会导致题库中题目使用不均衡的问题。题目曝光率不均衡的影响不仅会因过度曝光的题目引发测试安全问题,还会因曝光不足的题目引发关于题库开发的经济问题。因此,本研究提出一种两阶段的辛普森-赫特(TSH)方法,通过同时控制题目曝光率的最小值和最大值来提高题库的均衡利用率。TSH方法将CAT分为两个阶段。在第一阶段,题目曝光率被控制在预先设定的水平(例如)之上,以提高曝光不足题目的曝光率,而在第二阶段,题目曝光率被控制在另一个预先设定的水平(例如)之下,以防止题目过度曝光。为了减少对特质估计的影响,TSH在CAT的第一阶段只施测数量最少的足够多的曝光不足题目,这些题目通常区分度较低。模拟研究结果表明,TSH方法在大多数情况下可以有效提高题库利用率,同时在保持所需测试安全水平的情况下,不会明显损害特质估计精度。

相似文献

1
Controlling the Minimum Item Exposure Rate in Computerized Adaptive Testing: A Two-Stage Sympson-Hetter Procedure.
Appl Psychol Meas. 2023 Nov;47(7-8):460-477. doi: 10.1177/01466216231209756. Epub 2023 Oct 20.
3
-Stratified Computerized Adaptive Testing in the Presence of Calibration Error.
Educ Psychol Meas. 2015 Apr;75(2):260-283. doi: 10.1177/0013164414530719. Epub 2014 Apr 21.
4
Comparing single-pool and multiple-pool designs regarding test security in computerized testing.
Behav Res Methods. 2012 Sep;44(3):742-52. doi: 10.3758/s13428-011-0178-5.
5
Controlling item exposure and test overlap on the fly in computerized adaptive testing.
Br J Math Stat Psychol. 2008 Nov;61(Pt 2):471-92. doi: 10.1348/000711007X227067. Epub 2007 Jul 23.
6
a-Stratified CAT design with content blocking.
Br J Math Stat Psychol. 2003 Nov;56(Pt 2):359-78. doi: 10.1348/000711003770480084.
7
Predicting item exposure parameters in computerized adaptive testing.
Br J Math Stat Psychol. 2008 May;61(Pt 1):75-91. doi: 10.1348/000711006X129553.
9
Components of the item selection algorithm in computerized adaptive testing.
J Educ Eval Health Prof. 2018 Mar 24;15:7. doi: 10.3352/jeehp.2018.15.7. eCollection 2018.

引用本文的文献

1
Standard Error Estimation for Subpopulation Non-invariance.
Appl Psychol Meas. 2025 Jul 5:01466216251351947. doi: 10.1177/01466216251351947.
2
Maximin criterion for item selection in computerized adaptive testing.
Behav Res Methods. 2025 May 28;57(7):180. doi: 10.3758/s13428-025-02673-8.

本文引用的文献

1
A Dynamic Stratification Method for Improving Trait Estimation in Computerized Adaptive Testing Under Item Exposure Control.
Appl Psychol Meas. 2020 May;44(3):182-196. doi: 10.1177/0146621619843820. Epub 2019 Apr 23.
2
On-the-Fly Assembled Multistage Adaptive Testing.
Appl Psychol Meas. 2015 Mar;39(2):104-118. doi: 10.1177/0146621614544519. Epub 2014 Sep 5.
3
Incorporating randomness in the Fisher information for improving item-exposure control in CATs.
Br J Math Stat Psychol. 2008 Nov;61(Pt 2):493-513. doi: 10.1348/000711007X230937. Epub 2007 Aug 4.
4
Controlling item exposure and test overlap on the fly in computerized adaptive testing.
Br J Math Stat Psychol. 2008 Nov;61(Pt 2):471-92. doi: 10.1348/000711007X227067. Epub 2007 Jul 23.
5
a-Stratified CAT design with content blocking.
Br J Math Stat Psychol. 2003 Nov;56(Pt 2):359-78. doi: 10.1348/000711003770480084.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验