Zhang Yingbin, Wang Yehui
Collaborative Innovation Center of Assessment for Basic Education Quality, Beijing Normal University, Beijing, China.
The Department of Curriculum and Instruction, College of Education, University of Illinois at Urbana-Champaign, Champaign, IL, United States.
Front Psychol. 2020 Feb 21;11:271. doi: 10.3389/fpsyg.2020.00271. eCollection 2020.
Response styles, the general tendency to use certain categories of rating scales over others, are a threat to the reliability and validity of self-report measures. The mixed partial credit model, the multidimensional nominal response model, and the item response tree model are three widely used models for measuring extreme and midpoint response styles and correcting their effects. This research aimed to examine and compare their validity by fitting them to empirical data and correlating the content-related factors and the response style-related factors in these models to extraneous criteria. The results showed that the content factors yielded by these models were moderately related to the content criterion and not related to the response style criteria. The response style factors were moderately related to the response style criteria and weakly related to the content criterion. Simultaneous analysis of more than one scale could improve their validity for measuring response styles. These findings indicate that the three models could control and measure extreme and midpoint response styles, though the validity of the mPCM for measuring response styles was not good in some cases. Overall, the multidimensional nominal response model performed slightly better than the other two models.
反应风格，即相较于其他类型更倾向于使用特定类别评分量表的总体趋势，是对自我报告测量的信度和效度的一种威胁。混合部分计分模型、多维名义反应模型和项目反应树模型是用于测量极端和中点反应风格并校正其影响的三种广泛使用的模型。本研究旨在通过将这些模型拟合到实证数据，并将这些模型中与内容相关的因素和与反应风格相关的因素与外部标准进行关联，来检验和比较它们的效度。结果表明，这些模型产生的内容因素与内容标准有适度关联，与反应风格标准无关。反应风格因素与反应风格标准有适度关联，与内容标准有弱关联。对多个量表进行同时分析可以提高它们测量反应风格的效度。这些发现表明，这三种模型可以控制和测量极端和中点反应风格，尽管混合部分计分模型在某些情况下测量反应风格的效度不佳。总体而言，多维名义反应模型的表现略优于其他两个模型。
