University of Georgia, Athens, USA.
University of Illinois at Urbana-Champaign, Urbana, USA.
Psychometrika. 2019 Jun;84(2):375-394. doi: 10.1007/s11336-019-09662-9. Epub 2019 Feb 25.
The compatibility of computerized adaptive testing (CAT) with response revision has been a topic of debate in psychometrics for many years. The problem is to provide test takers opportunities to change their answers during the test, while discouraging deceptive strategies from their side and preserving the statistical efficiency of the traditional CAT. The estimating approach proposed in Wang et al. (Stat Sin 27(4):1987-2010, 2017), based on the nominal response model, allows test takers to provide more than one answer to each item during the test, which they all contribute to the interim and final ability estimation. This approach is here reformulated, extended to incorporate a larger class of polytomous and dichotomous item response theory models, and investigated with simulation studies under different test-taking strategies.
计算机化自适应测验(CAT)与应答修订的兼容性在心理测量学中已经争论了很多年。问题是要为应试者在测试期间提供更改答案的机会,同时阻止他们使用欺骗策略,并保持传统 CAT 的统计效率。Wang 等人提出的估计方法(Stat Sin 27(4):1987-2010, 2017),基于名义反应模型,允许应试者在测试期间对每个项目提供多个答案,这些答案都有助于中间和最终能力估计。本文对该方法进行了重新表述,将其扩展到包含更大类别的多分制和二分制项目反应理论模型,并在不同的应试策略下进行了模拟研究。