Hontangas Pedro M, Leenen Iwin, de la Torre Jimmy, Ponsoda Vicente, Morillo Daniel, Abad Francisco J
Universidad de Valencia.
Psicothema. 2016;28(1):76-82. doi: 10.7334/psicothema2015.204.
Forced-choice tests (FCTs) were proposed to minimize response biases associated with Likert format items. It remains unclear whether scores based on traditional methods for scoring FCTs are appropriate for between-subjects comparisons. Recently, Hontangas et al. (2015) explored the extent to which traditional scoring of FCTs relates to the true scores and IRT estimates. The authors found certain conditions under which traditional scores (TS) can be used with FCTs when the underlying IRT model was an unfolding model. In this study, we examine to what extent the results are preserved when the underlying process becomes a dominance model.
The independent variables analyzed in a simulation study are: forced-choice format, number of blocks, discrimination of items, polarity of items, variability of intra-block difficulty, range of difficulty, and correlation between dimensions.
A similar pattern of results was observed for both models; however, correlations between TS and true thetas are higher and the differences between TS and IRT estimates are less discrepant when a dominance model involved.
A dominance model produces a linear relationship between TS and true scores, and the subjects with extreme thetas are better measured.
强制选择测试(FCTs)被提出用于最小化与李克特量表格式项目相关的反应偏差。基于传统方法对FCTs进行评分所得到的分数是否适用于受试者间比较仍不清楚。最近,洪坦加斯等人(2015年)探究了FCTs的传统评分与真实分数和IRT估计值之间的关联程度。作者发现,当潜在的IRT模型为展开模型时,在某些条件下传统分数(TS)可用于FCTs。在本研究中,我们考察了当潜在过程变为优势模型时,这些结果在多大程度上得以保留。
在一项模拟研究中分析的自变量包括:强制选择格式、块数、项目区分度、项目极性、块内难度变异性、难度范围以及维度间的相关性。
两种模型观察到了相似的结果模式;然而,当涉及优势模型时,TS与真实θ值之间的相关性更高,且TS与IRT估计值之间的差异更小。
优势模型在TS与真实分数之间产生线性关系,并且能更好地测量具有极端θ值的受试者。