Sinharay Sandip
Educational Testing Service, Princeton, NJ, USA.
Appl Psychol Meas. 2020 Jul;44(5):376-392. doi: 10.1177/0146621620909893. Epub 2020 Apr 13.
Benefiting from item preknowledge is a major type of fraudulent behavior during educational assessments. This article suggests a new statistic that can be used for detecting the examinees who may have benefited from item preknowledge using their response times. The statistic quantifies the difference in speed between the compromised items and the non-compromised items of the examinees. The distribution of the statistic under the null hypothesis of no preknowledge is proved to be the standard normal distribution. A simulation study is used to evaluate the Type I error rate and power of the suggested statistic. A real data example demonstrates the usefulness of the new statistic that is found to provide information that is not provided by statistics based only on item scores.
在教育评估中,受益于题目先验知识是一种主要的欺诈行为类型。本文提出了一种新的统计量,可用于通过考生的答题时间来检测那些可能受益于题目先验知识的考生。该统计量量化了考生在受影响题目和未受影响题目上答题速度的差异。在不存在先验知识的原假设下,该统计量的分布被证明为标准正态分布。通过模拟研究来评估所提出统计量的第一类错误率和检验功效。一个实际数据示例展示了这种新统计量的有用性,发现它能提供仅基于题目分数的统计量所无法提供的信息。