Institute for Learning Sciences and Teacher Education, Australian Catholic University (Brisbane Campus).
Assessment Research Centre, The Education University of Hong Kong.
Multivariate Behav Res. 2024 Jan-Feb;59(1):62-77. doi: 10.1080/00273171.2023.2211564. Epub 2023 Jun 1.
Many person-fit statistics have been proposed to detect aberrant response behaviors (e.g., cheating, guessing). Among them, is one of the most widely used indices. The computation of assumes the item and person parameters are known. In reality, they often have to be estimated from data. The better the estimation, the better will perform. When aberrant behaviors occur, the person and item parameter estimations are inaccurate, which in turn degrade the performance of . In this study, an iterative procedure was developed to attain more accurate person parameter estimates for improved performance of . A series of simulations were conducted to evaluate the iterative procedure under two conditions of item parameters, known and unknown, and three aberrant response styles of difficulty-sharing cheating, random-sharing cheating, and random guessing. The results demonstrated the superiority of the iterative procedure over the non-iterative one in maintaining control of Type-I error rates and improving the power of detecting aberrant responses. The proposed procedure was applied to a high-stake intelligence test.
许多个体适合度统计量已被提出用于检测异常反应行为(例如,作弊、猜测)。其中,是最广泛使用的指标之一。的计算假设项目和个体参数是已知的。实际上,它们通常必须从数据中估计。估计得越好,的表现就越好。当异常行为发生时,个体和项目参数的估计不准确,这反过来又降低了的性能。在这项研究中,开发了一种迭代程序,以获得更准确的个体参数估计,从而提高的性能。在项目参数已知和未知两种情况下以及三种异常反应模式(难度共享作弊、随机共享作弊和随机猜测)下进行了一系列模拟,以评估迭代程序。结果表明,迭代程序优于非迭代程序,能够更好地控制第一类错误率并提高检测异常反应的能力。该程序已应用于高风险智力测验。