Suppr超能文献

评估项目反应理论等值中处理快速猜测反应策略的性能。

Assessing the Performance of Strategies for Handling Rapid Guessing Responses in Item Response Theory Equating.

作者信息

Jung Juyoung, Lee Won-Chan

机构信息

Educational Measurement and Statistics, Psychological and Quantitative Foundations, University of Iowa, Iowa City, IA, USA.

出版信息

Educ Psychol Meas. 2025 Mar 30:00131644251329524. doi: 10.1177/00131644251329524.

Abstract

This study assesses the performance of strategies for handling rapid guessing responses (RGs) within the context of item response theory observed-score equating. Four distinct approaches were evaluated: (1) ignoring RGs, (2) penalizing RGs as incorrect responses, (3) implementing list-wise deletion (LWD), and (4) treating RGs as missing data followed by imputation using logistic regression-based methodologies. These strategies were examined across a diverse array of testing scenarios. Results indicate that the performance of each strategy varied depending on the specific manipulated factors. Both ignoring and penalizing RGs were found to introduce substantial distortions in equating accuracy. LWD generally exhibited the lowest bias among the strategies evaluated but showed higher standard errors. Data imputation methods, particularly those employing lasso logistic regression and bootstrap techniques, demonstrated superior performance in minimizing equating errors compared to other approaches.

摘要

本研究评估了在项目反应理论观察分数等值的背景下处理快速猜测反应(RG)的策略的性能。评估了四种不同的方法:(1)忽略RG,(2)将RG视为错误反应进行惩罚,(3)实施逐行删除(LWD),以及(4)将RG视为缺失数据,随后使用基于逻辑回归的方法进行插补。这些策略在各种测试场景中进行了检验。结果表明,每种策略的性能因具体的操作因素而异。发现忽略和惩罚RG都会在等值准确性方面引入实质性的偏差。在评估的策略中,LWD通常表现出最低的偏差,但标准误差较高。数据插补方法,特别是那些采用套索逻辑回归和自助法技术的方法,与其他方法相比,在最小化等值误差方面表现出卓越的性能。

相似文献

1
Assessing the Performance of Strategies for Handling Rapid Guessing Responses in Item Response Theory Equating.
Educ Psychol Meas. 2025 Mar 30:00131644251329524. doi: 10.1177/00131644251329524.
2
Evaluating the Effects of Missing Data Handling Methods on Scale Linking Accuracy.
Educ Psychol Meas. 2023 Dec;83(6):1202-1228. doi: 10.1177/00131644221140941. Epub 2022 Dec 9.
3
Investigating the Effect of Differential Rapid Guessing on Population Invariance in Equating.
Appl Psychol Meas. 2022 Oct;46(7):589-604. doi: 10.1177/01466216221108991. Epub 2022 Jun 16.
4
Asymptotic Standard Errors of Generalized Partial Credit Model True Score Equating Using Characteristic Curve Methods.
Appl Psychol Meas. 2021 Jul;45(5):331-345. doi: 10.1177/01466216211013101. Epub 2021 May 12.
6
Item Response Theory Observed-Score Kernel Equating.
Psychometrika. 2017 Mar;82(1):48-66. doi: 10.1007/s11336-016-9528-7. Epub 2016 Oct 14.
7
Efficiency Analysis of Item Response Theory Kernel Equating for Mixed-Format Tests.
Appl Psychol Meas. 2023 Nov;47(7-8):496-512. doi: 10.1177/01466216231209757. Epub 2023 Oct 19.
9
Evaluating Different Equating Setups in the Continuous Item Pool Calibration for Computerized Adaptive Testing.
Front Psychol. 2019 Jun 6;10:1277. doi: 10.3389/fpsyg.2019.01277. eCollection 2019.
10
Item Response Theory True Score Equating for the Bifactor Model Under the Common-Item Nonequivalent Groups Design.
Appl Psychol Meas. 2022 Sep;46(6):479-493. doi: 10.1177/01466216221108995. Epub 2022 Jun 17.

本文引用的文献

1
Evaluating the Effects of Missing Data Handling Methods on Scale Linking Accuracy.
Educ Psychol Meas. 2023 Dec;83(6):1202-1228. doi: 10.1177/00131644221140941. Epub 2022 Dec 9.
2
Changes in the Speed-Ability Relation Through Different Treatments of Rapid Guessing.
Educ Psychol Meas. 2023 Jun;83(3):473-494. doi: 10.1177/00131644221109490. Epub 2022 Jul 11.
3
Investigating the Effect of Differential Rapid Guessing on Population Invariance in Equating.
Appl Psychol Meas. 2022 Oct;46(7):589-604. doi: 10.1177/01466216221108991. Epub 2022 Jun 16.
4
Quantifying the Distorting Effect of Rapid Guessing on Estimates of Coefficient Αlpha.
Appl Psychol Meas. 2022 Jan;46(1):40-52. doi: 10.1177/01466216211051719. Epub 2021 Oct 11.
5
Investigating the Impact of Noneffortful Responses on Individual-Level Scores: Can the Effort-Moderated IRT Model Serve as a Solution?
Appl Psychol Meas. 2021 Sep;45(6):391-406. doi: 10.1177/01466216211013896. Epub 2021 Jun 11.
6
Is Differential Noneffortful Responding Associated With Type I Error in Measurement Invariance Testing?
Educ Psychol Meas. 2021 Oct;81(5):957-979. doi: 10.1177/0013164421990429. Epub 2021 Feb 12.
8
A Two-Stage Approach to Differentiating Normal and Aberrant Behavior in Computer Based Testing.
Psychometrika. 2018 Mar;83(1):223-254. doi: 10.1007/s11336-016-9525-x. Epub 2016 Oct 28.
9
Investigation and Treatment of Missing Item Scores in Test and Questionnaire Data.
Multivariate Behav Res. 2003 Oct 1;38(4):505-28. doi: 10.1207/s15327906mbr3804_4.
10
Influence of Imputation and EM Methods on Factor Analysis when Item Nonresponse in Questionnaire Data is Nonignorable.
Multivariate Behav Res. 2000 Jul 1;35(3):321-64. doi: 10.1207/S15327906MBR3503_03.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验