Ferrando Pere J, Navarro-González David, Morales-Vives Fabia
Research Center for Behavior Assessment, Universitat Rovira i Virgili, Tarragona, Spain.
Universitat de Lleida, Lleida, Spain.
Educ Psychol Meas. 2025 Mar 13:00131644251319286. doi: 10.1177/00131644251319286.
A common problem in the assessment of noncognitive attributes is the presence of items with correlated residuals. Although most studies have focused on their effect at the structural level, they may also have an effect on the accuracy and effectiveness of the scores derived from extended factor analytic (FA) solutions which include correlated residuals. For this reason, several measures of reliability/factor saturation and information were developed in a previous study to assess this effect in sum scores derived from unidimensional measures based on both linear and nonlinear FA solutions. The current article extends these proposals to a second-order solution with a single general factor, and it also extends the added-value principle to the second-order scenario when local dependences are operating. Related to the added-value, a new coefficient is developed (an effect-size index and its confidence intervals). Overall, what is proposed allows first to assess the reliability and relative efficiency of the scores at both the subscale and total scale levels, and second, provides information on the appropriateness of using subscale scores to predict their own factor in comparison to the predictive capacity of the total score. All that is proposed is implemented in a freely available R program. Its usefulness is illustrated with an empirical example, which shows the distortions that correlated residuals may cause and how the various measures included in this proposal should be interpreted.
在非认知属性评估中，一个常见问题是存在具有相关残差的项目。尽管大多数研究关注它们在结构层面的影响，但它们也可能对源自包含相关残差的扩展因子分析（FA）解决方案的分数的准确性和有效性产生影响。因此，在先前的一项研究中开发了几种可靠性/因子饱和度和信息量度，以评估基于线性和非线性FA解决方案的单维测量得出的总分中的这种影响。本文将这些提议扩展到具有单个一般因子的二阶解决方案，并且当存在局部依赖性时，还将增值原则扩展到二阶情形。与增值相关，开发了一个新系数（一个效应大小指数及其置信区间）。总体而言，所提出的方法首先允许评估子量表和总量表层面分数的可靠性和相对效率，其次提供关于与总分的预测能力相比，使用子量表分数预测其自身因子的适当性的信息。所提出的所有内容都在一个免费的R程序中实现。通过一个实证例子说明了其有用性，该例子展示了相关残差可能导致的扭曲以及该提议中包含的各种量度应如何解释。
