Suppr超能文献

利用反应时间检测项目预知识

Detection of Item Preknowledge Using Response Times.

作者信息

Sinharay Sandip

机构信息

Educational Testing Service, Princeton, NJ, USA.

出版信息

Appl Psychol Meas. 2020 Jul;44(5):376-392. doi: 10.1177/0146621620909893. Epub 2020 Apr 13.

Abstract

Benefiting from item preknowledge is a major type of fraudulent behavior during educational assessments. This article suggests a new statistic that can be used for detecting the examinees who may have benefited from item preknowledge using their response times. The statistic quantifies the difference in speed between the compromised items and the non-compromised items of the examinees. The distribution of the statistic under the null hypothesis of no preknowledge is proved to be the standard normal distribution. A simulation study is used to evaluate the Type I error rate and power of the suggested statistic. A real data example demonstrates the usefulness of the new statistic that is found to provide information that is not provided by statistics based only on item scores.

摘要

在教育评估中,受益于题目先验知识是一种主要的欺诈行为类型。本文提出了一种新的统计量,可用于通过考生的答题时间来检测那些可能受益于题目先验知识的考生。该统计量量化了考生在受影响题目和未受影响题目上答题速度的差异。在不存在先验知识的原假设下,该统计量的分布被证明为标准正态分布。通过模拟研究来评估所提出统计量的第一类错误率和检验功效。一个实际数据示例展示了这种新统计量的有用性,发现它能提供仅基于题目分数的统计量所无法提供的信息。

相似文献

1
Detection of Item Preknowledge Using Response Times.
Appl Psychol Meas. 2020 Jul;44(5):376-392. doi: 10.1177/0146621620909893. Epub 2020 Apr 13.
2
The use of item scores and response times to detect examinees who may have benefited from item preknowledge.
Br J Math Stat Psychol. 2020 Nov;73(3):397-419. doi: 10.1111/bmsp.12187. Epub 2019 Aug 16.
3
Which Statistic Should Be Used to Detect Item Preknowledge When the Set of Compromised Items Is Known?
Appl Psychol Meas. 2017 Sep;41(6):403-421. doi: 10.1177/0146621617698453. Epub 2017 Mar 26.
4
Comparing the Performance of Eight Item Preknowledge Detection Statistics.
Appl Psychol Meas. 2016 Mar;40(2):83-97. doi: 10.1177/0146621615603327. Epub 2015 Sep 9.
5
Detecting Item Preknowledge Using a Predictive Checking Method.
Appl Psychol Meas. 2017 Jun;41(4):243-263. doi: 10.1177/0146621616687285. Epub 2017 Jan 22.
6
Detecting Examinees With Item Preknowledge in Large-Scale Testing Using Extreme Gradient Boosting (XGBoost).
Educ Psychol Meas. 2019 Oct;79(5):931-961. doi: 10.1177/0013164419839439. Epub 2019 Apr 2.
7
Two New Models for Item Preknowledge.
Appl Psychol Meas. 2022 Sep;46(6):447-461. doi: 10.1177/01466216221108130. Epub 2022 Jun 22.
9
The Lack of Robustness of a Statistic Based on the Neyman-Pearson Lemma to Violations of Its Underlying Assumptions.
Appl Psychol Meas. 2022 Jan;46(1):19-39. doi: 10.1177/01466216211049209. Epub 2021 Oct 23.
10
Detecting Examinees With Item Preknowledge on Real Data.
Appl Psychol Meas. 2022 Jun;46(4):273-287. doi: 10.1177/01466216221084202. Epub 2022 Apr 21.

引用本文的文献

1
Using Biclustering to Detect Cheating in Real Time on Mixed-Format Tests.
Educ Psychol Meas. 2025 May 24:00131644251333143. doi: 10.1177/00131644251333143.
2
Few and Different: Detecting Examinees With Preknowledge Using Extended Isolation Forests.
Appl Psychol Meas. 2025 Feb 20:01466216251320403. doi: 10.1177/01466216251320403.
3
Application of Bayesian Decision Theory in Detecting Test Fraud.
Appl Psychol Meas. 2025 Jan 27:01466216251316559. doi: 10.1177/01466216251316559.
4
Detecting Differential Item Functioning Using Response Time.
Educ Psychol Meas. 2024 Oct 26:00131644241280400. doi: 10.1177/00131644241280400.
5
Multimodal Data Fusion to Detect Preknowledge Test-Taking Behavior Using Machine Learning.
Educ Psychol Meas. 2024 Aug;84(4):753-779. doi: 10.1177/00131644231193625. Epub 2023 Sep 19.
6
What Can We Learn from a Semiparametric Factor Analysis of Item Responses and Response Time? An Illustration with the PISA 2015 Data.
Psychometrika. 2024 Jun;89(2):386-410. doi: 10.1007/s11336-023-09936-3. Epub 2023 Nov 16.

本文引用的文献

1
The use of item scores and response times to detect examinees who may have benefited from item preknowledge.
Br J Math Stat Psychol. 2020 Nov;73(3):397-419. doi: 10.1111/bmsp.12187. Epub 2019 Aug 16.
2
Which Statistic Should Be Used to Detect Item Preknowledge When the Set of Compromised Items Is Known?
Appl Psychol Meas. 2017 Sep;41(6):403-421. doi: 10.1177/0146621617698453. Epub 2017 Mar 26.
3
Detecting Test Tampering Using Item Response Theory.
Educ Psychol Meas. 2015 Dec;75(6):931-953. doi: 10.1177/0013164414568716. Epub 2015 Jan 23.
4
Improving precision of ability estimation: Getting more from response times.
Br J Math Stat Psychol. 2018 Feb;71(1):13-38. doi: 10.1111/bmsp.12104. Epub 2017 Jun 21.
5
A note on the hierarchical model for responses and response times in tests of van der Linden (2007).
Psychometrika. 2013 Jul;78(3):538-44. doi: 10.1007/s11336-013-9324-6. Epub 2013 Feb 2.
6
Using Deterministic, Gated Item Response Theory Model to detect test cheating due to item compromise.
Psychometrika. 2013 Jul;78(3):481-97. doi: 10.1007/s11336-012-9311-3. Epub 2013 Jan 3.
7
Marginal likelihood inference for a model for item responses and response times.
Br J Math Stat Psychol. 2010 Nov;63(Pt 3):603-26. doi: 10.1348/000711009X481360. Epub 2010 Jan 28.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验