Jung Juyoung, Lee Won-Chan
Educational Measurement and Statistics, Psychological and Quantitative Foundations, University of Iowa, Iowa City, IA, USA.
Educ Psychol Meas. 2025 Mar 30:00131644251329524. doi: 10.1177/00131644251329524.
This study assesses the performance of strategies for handling rapid guessing responses (RGs) within the context of item response theory observed-score equating. Four distinct approaches were evaluated: (1) ignoring RGs, (2) penalizing RGs as incorrect responses, (3) implementing list-wise deletion (LWD), and (4) treating RGs as missing data followed by imputation using logistic regression-based methodologies. These strategies were examined across a diverse array of testing scenarios. Results indicate that the performance of each strategy varied depending on the specific manipulated factors. Both ignoring and penalizing RGs were found to introduce substantial distortions in equating accuracy. LWD generally exhibited the lowest bias among the strategies evaluated but showed higher standard errors. Data imputation methods, particularly those employing lasso logistic regression and bootstrap techniques, demonstrated superior performance in minimizing equating errors compared to other approaches.
本研究评估了在项目反应理论观察分数等值的背景下处理快速猜测反应(RG)的策略的性能。评估了四种不同的方法:(1)忽略RG,(2)将RG视为错误反应进行惩罚,(3)实施逐行删除(LWD),以及(4)将RG视为缺失数据,随后使用基于逻辑回归的方法进行插补。这些策略在各种测试场景中进行了检验。结果表明,每种策略的性能因具体的操作因素而异。发现忽略和惩罚RG都会在等值准确性方面引入实质性的偏差。在评估的策略中,LWD通常表现出最低的偏差,但标准误差较高。数据插补方法,特别是那些采用套索逻辑回归和自助法技术的方法,与其他方法相比,在最小化等值误差方面表现出卓越的性能。