Lee Chansoon, Gorney Kylie, Chen Jianshen
American Board of Internal Medicine, Philadelphia, PA, USA.
Michigan State University, East Lansing, MI, USA.
Educ Psychol Meas. 2025 Sep 14:00131644251368335. doi: 10.1177/00131644251368335.
Sequential procedures have been shown to be effective methods for real-time detection of compromised items in computerized adaptive testing. In this study, we propose three item response theory-based sequential procedures that involve the use of item scores and response times (RTs). The first procedure requires that either the score-based statistic or the RT-based statistic be extreme, the second procedure requires that both the score-based statistic and the RT-based statistic be extreme, and the third procedure requires that a combined score and RT-based statistic be extreme. Results suggest that the third procedure is the most promising, providing a reasonable balance between the false-positive rate and the true-positive rate while also producing relatively short lag times across a wide range of simulation conditions.
序贯程序已被证明是在计算机自适应测试中实时检测受损项目的有效方法。在本研究中，我们提出了三种基于项目反应理论的序贯程序，这些程序涉及使用项目得分和反应时间（RTs）。第一种程序要求基于得分的统计量或基于反应时间的统计量是极端的，第二种程序要求基于得分的统计量和基于反应时间的统计量都是极端的，第三种程序要求基于得分和反应时间的组合统计量是极端的。结果表明，第三种程序最有前景，在误报率和真阳性率之间提供了合理的平衡，同时在广泛的模拟条件下也产生了相对较短的延迟时间。
