Suppr超能文献

一种用于性能下降和不可忽略缺失数据的混合IRT树模型

A Mixture IRTree Model for Performance Decline and Nonignorable Missing Data.

作者信息

Huang Hung-Yu

机构信息

University of Taipei, Taiwan.

出版信息

Educ Psychol Meas. 2020 Dec;80(6):1168-1195. doi: 10.1177/0013164420914711. Epub 2020 Apr 24.

Abstract

In educational assessments and achievement tests, test developers and administrators commonly assume that test-takers attempt all test items with full effort and leave no blank responses with unplanned missing values. However, aberrant response behavior-such as performance decline, dropping out beyond a certain point, and skipping certain items over the course of the test-is inevitable, especially for low-stakes assessments and speeded tests due to low motivation and time limits, respectively. In this study, test-takers are classified as normal or aberrant using a mixture item response theory (IRT) modeling approach, and aberrant response behavior is described and modeled using item response trees (IRTrees). Simulations are conducted to evaluate the efficiency and quality of the new class of mixture IRTree model using WinBUGS with Bayesian estimation. The results show that the parameter recovery is satisfactory for the proposed mixture IRTree model and that treating missing values as ignorable or incorrect and ignoring possible performance decline results in biased estimation. Finally, the applicability of the new model is illustrated by means of an empirical example based on the Program for International Student Assessment.

摘要

在教育评估和成绩测试中,测试开发者和管理者通常假定考生会全力以赴完成所有测试项目,不会留下无计划缺失值的空白答案。然而,异常作答行为——如成绩下降、在某个时间点后退出以及在测试过程中跳过某些题目——是不可避免的,尤其是对于低风险评估和限时测试,分别是由于动机不足和时间限制。在本研究中,使用混合项目反应理论(IRT)建模方法将考生分类为正常或异常,并使用项目反应树(IRTrees)描述和建模异常作答行为。使用WinBUGS进行贝叶斯估计的模拟,以评估新的混合IRT树模型的效率和质量。结果表明,所提出的混合IRT树模型的参数恢复情况令人满意,将缺失值视为可忽略或错误处理以及忽略可能的成绩下降会导致有偏差的估计。最后,通过基于国际学生评估项目的实证例子说明了新模型的适用性。

相似文献

2
Unfolding IRT Models for Likert-Type Items With a Don't Know Option.具有“不知道”选项的李克特式项目的展开IRT模型
Appl Psychol Meas. 2016 Oct;40(7):517-533. doi: 10.1177/0146621616664047. Epub 2016 Aug 20.
3
Modeling Rapid Guessing Behaviors in Computer-Based Testlet Items.基于计算机的分块试题中快速猜测行为的建模
Appl Psychol Meas. 2023 Jan;47(1):19-33. doi: 10.1177/01466216221125177. Epub 2022 Sep 9.
7
Mixture IRT Model With a Higher-Order Structure for Latent Traits.具有潜在特质高阶结构的混合IRT模型
Educ Psychol Meas. 2017 Apr;77(2):275-304. doi: 10.1177/0013164416640327. Epub 2016 Apr 1.

引用本文的文献

6
Modeling Rapid Guessing Behaviors in Computer-Based Testlet Items.基于计算机的分块试题中快速猜测行为的建模
Appl Psychol Meas. 2023 Jan;47(1):19-33. doi: 10.1177/01466216221125177. Epub 2022 Sep 9.

本文引用的文献

1
Item Position Effects Are Moderated by Changes in Test-Taking Effort.项目位置效应受应试努力变化的调节。
Appl Psychol Meas. 2017 Mar;41(2):115-129. doi: 10.1177/0146621616676791. Epub 2016 Nov 22.
2
Mixture IRT Model With a Higher-Order Structure for Latent Traits.具有潜在特质高阶结构的混合IRT模型
Educ Psychol Meas. 2017 Apr;77(2):275-304. doi: 10.1177/0013164416640327. Epub 2016 Apr 1.
7
Working memory, math performance, and math anxiety.工作记忆、数学成绩与数学焦虑。
Psychon Bull Rev. 2007 Apr;14(2):243-8. doi: 10.3758/bf03194059.
9
Expectancy-Value Theory of Achievement Motivation.成就动机的期望-价值理论
Contemp Educ Psychol. 2000 Jan;25(1):68-81. doi: 10.1006/ceps.1999.1015.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验