Zhan Peida, Jiao Hong, Liao Dandan
Collaborative Innovation Center of Assessment toward Basic Education Quality, Beijing Normal University, China.
Measurement, Statistics and Evaluation, Department of Human Development and Quantitative Methodology, University of Maryland, College Park, Maryland, USA.
Br J Math Stat Psychol. 2018 May;71(2):262-286. doi: 10.1111/bmsp.12114. Epub 2017 Sep 5.
To provide more refined diagnostic feedback with collateral information in item response times (RTs), this study proposed joint modelling of attributes and response speed using item responses and RTs simultaneously for cognitive diagnosis. For illustration, an extended deterministic input, noisy 'and' gate (DINA) model was proposed for joint modelling of responses and RTs. Model parameter estimation was explored using the Bayesian Markov chain Monte Carlo (MCMC) method. The PISA 2012 computer-based mathematics data were analysed first. These real data estimates were treated as true values in a subsequent simulation study. A follow-up simulation study with ideal testing conditions was conducted as well to further evaluate model parameter recovery. The results indicated that model parameters could be well recovered using the MCMC approach. Further, incorporating RTs into the DINA model would improve attribute and profile correct classification rates and result in more accurate and precise estimation of the model parameters.
为了在项目反应时间(RTs)中提供带有附带信息的更精确诊断反馈,本研究提出了一种属性和反应速度的联合建模方法,该方法同时使用项目反应和反应时间进行认知诊断。为了说明这一点,提出了一种扩展的确定性输入、噪声“与”门(DINA)模型用于反应和反应时间的联合建模。使用贝叶斯马尔可夫链蒙特卡罗(MCMC)方法探索模型参数估计。首先对2012年国际学生评估项目(PISA)基于计算机的数学数据进行了分析。在随后的模拟研究中,将这些实际数据估计值视为真实值。还进行了一项具有理想测试条件的后续模拟研究,以进一步评估模型参数恢复情况。结果表明,使用MCMC方法可以很好地恢复模型参数。此外,将反应时间纳入DINA模型将提高属性和轮廓正确分类率,并导致对模型参数的更准确和精确估计。