Texas A&M University, USA.
University of Missouri-Kansas City, USA.
J Sch Psychol. 2022 Aug;93:1-27. doi: 10.1016/j.jsp.2022.05.001. Epub 2022 Jun 23.
There has been little research investigating the predictive validity of modern intelligence tests for racially and ethnically diverse students. The validity of test score interpretation within educational and psychological assessment assumes that test scores predict educationally relevant phenomena equally well for individuals, regardless of group membership (American Educational Research Association et al., 2014; Messick, 1995; Warne et al., 2014). We used multiple group latent variable structural equation modeling (SEM) to investigate Cattell-Horn-Carroll general (g) and broad cognitive abilities on reading and mathematics achievement and whether these differed between racial (African American, Asian, and Caucasian) and ethnic (Hispanic, non-Hispanic) children and adolescents within the Woodcock-Johnson IV norming sample (N = 3127). After establishing construct equivalence across racial and ethnic groups, supporting the consistent calculation of composite scores regardless of group membership, we then examined the predictive validity of intelligence on achievement. After controlling for parent education, findings suggested two instances of differential predictive relations: (a) general intelligence had larger influences on basic reading skills for Caucasians when compared to Asian peers, and (b) comprehension-knowledge had larger influences on basic reading skills for Asians when compared to Caucasian peers. The overall pattern of findings suggests there is little to no predictive bias with the WJ IV. However, the findings indicate that when latent mean differences exist (after establishing strong factorial invariance), then bias will be introduced into the estimation of regression parameters used to identify differential predictive validity. Thus, even when measurement invariance is supported, differential prediction bias is inevitable when there are mean differences in the scores used as predictors. Future test bias research should consider latent ability differences and how that may impact findings of bias, and possibly, socioeconomic status-related indicators when assessing for measurement or prediction bias in intelligence and achievement tests.
针对不同种族和族裔的学生,现代智力测验的预测效度研究甚少。在教育和心理评估中,测验分数的解释有效性假设,无论个体所属群体如何,测验分数都能同等准确地预测与教育相关的现象(美国教育研究协会等,2014 年;Messick,1995 年;Warne 等人,2014 年)。我们使用多群组潜在变量结构方程模型(SEM)来研究 Cattell-Horn-Carroll 一般(g)和广泛认知能力对阅读和数学成绩的影响,以及这些能力在 Woodcock-Johnson IV 常模样本(N=3127)中的不同种族(非裔美国人、亚洲人和白种人)和族裔(西班牙裔和非西班牙裔)儿童和青少年之间是否存在差异。在建立了跨种族和族裔群体的结构等效性之后,支持了无论群体成员如何,都可以一致地计算综合分数,然后我们研究了智力对成绩的预测效度。在控制了父母教育之后,发现表明存在两种不同的预测关系:(a)与亚洲同龄人相比,一般智力对白人学生的基本阅读技能有更大的影响,(b)理解-知识对亚洲学生的基本阅读技能有更大的影响,而对白人学生的影响较小。总体研究结果表明,WJ IV 几乎没有预测偏差。但是,研究结果表明,当存在潜在的均值差异时(在建立了强大的因子不变性之后),则会在用于识别差异预测效度的回归参数估计中引入偏差。因此,即使支持测量不变性,当用于预测的分数存在均值差异时,差异预测偏差也是不可避免的。未来的测试偏差研究应考虑潜在能力差异,以及这可能如何影响偏差的发现,并且在评估智力和成就测试中的测量或预测偏差时,可能还需要考虑与社会经济地位相关的指标。