Curry School of Education and Human Development, University of Virginia.
NWEA.
Multivariate Behav Res. 2021 Nov-Dec;56(6):853-873. doi: 10.1080/00273171.2020.1778440. Epub 2020 Jul 7.
Survey respondents employ different response styles when they use the categories of the Likert scale differently despite having the same true score on the construct of interest. For example, respondents may be more likely to use the extremes of the response scale independent of their true score. Research already shows that differing response styles can create a construct-irrelevant source of bias that distorts fundamental inferences made based on survey data. While some initial studies examine the effect of response styles on survey scores in longitudinal analyses, the issue of how response styles affect estimates of growth is underexamined. In this study, we conducted empirical and simulation analyses in which we scored surveys using item response theory (IRT) models that do and do not account for response styles, and then used those different scores in growth models and compared results. Generally, we found that response styles can affect estimates of growth parameters including the slope, but that the effects vary by psychological construct, response style, and IRT model used.
调查对象在使用利克特量表的类别时可能会采用不同的反应方式，尽管他们在感兴趣的结构上具有相同的真实分数。例如，调查对象可能更倾向于独立于其真实分数使用反应量表的极端值。研究已经表明，不同的反应方式会产生与结构无关的偏差源，从而扭曲基于调查数据做出的基本推断。虽然一些初步研究考察了反应方式对纵向分析中调查分数的影响，但反应方式如何影响增长估计的问题研究得还不够充分。在这项研究中，我们进行了实证和模拟分析，我们使用了考虑和不考虑反应方式的项目反应理论（IRT）模型对调查进行评分，然后在增长模型中使用这些不同的分数并比较结果。一般来说，我们发现反应方式会影响增长参数的估计，包括斜率，但效果因心理结构、反应方式和使用的 IRT 模型而异。
