Department of Psychology, University of British Columbia, Vancouver, British Columbia, Canada.
Department of Psychology and Human Development, Vanderbilt University, Nashville, Tennessee.
New Dir Child Adolesc Dev. 2021 Jan;2021(175):65-110. doi: 10.1002/cad.20387. Epub 2021 Jan 29.
Developmental researchers commonly utilize multilevel models (MLMs) to describe and predict individual differences in change over time. In such growth model applications, researchers have been widely encouraged to supplement reporting of statistical significance with measures of effect size, such as R-squareds (R ) that convey variance explained by terms in the model. An integrative framework for computing R-squareds in MLMs with random intercepts and/or slopes was recently introduced by Rights and Sterba and it subsumed pre-existing MLM R-squareds as special cases. However, this work focused on cross-sectional applications, and hence did not address how the computation and interpretation of MLM R-squareds are affected by modeling considerations typically arising in longitudinal settings: (a) alternative centering choices for time (e.g., centering-at-a-constant vs. person-mean-centering), (b) nonlinear effects of predictors such as time, (c) heteroscedastic level-1 errors and/or (d) autocorrelated level-1 errors. This paper addresses these gaps by extending the Rights and Sterba R-squared framework to longitudinal contexts. We: (a) provide a full framework of total and level-specific R-squared measures for MLMs that utilize any type of centering, and contrast these with Rights and Sterba's measures assuming cluster-mean-centering, (b) explain and derive which measures are applicable for MLMs with nonlinear terms, and extend the R-squared computation to accommodate (c) heteroscedastic and/or (d) autocorrelated errors. Additionally, we show how to use differences in R-squared (ΔR ) measures between growth models (adding, for instance, time-varying covariates as level-1 predictors or time-invariant covariates as level-2 predictors) to obtain effects sizes for individual terms. We provide R software (r2MLMlong) and a running pedagogical example analyzing growth in adolescent self-efficacy to illustrate these methodological developments. With these developments, researchers will have greater ability to consider effect size when analyzing and predicting change using MLMs.
发展研究人员通常使用多层次模型 (MLMs) 来描述和预测随时间变化的个体差异。在这种增长模型应用中,研究人员广泛鼓励在报告统计显著性的同时,使用效应大小的度量标准,例如 R 平方 (R²),以传达模型中术语解释的方差。最近,Rights 和 Sterba 提出了一个用于具有随机截距和/或斜率的 MLMs 的 R 平方综合计算框架,它将先前存在的 MLM R 平方作为特例包含在内。然而,这项工作侧重于横断面应用,因此没有解决在纵向环境中建模考虑因素如何影响 MLM R 平方的计算和解释:(a) 时间的替代中心化选择(例如,固定点中心化与个体均值中心化),(b) 预测器的非线性效应,如时间,(c) 异方差水平 1 误差和/或 (d) 自相关水平 1 误差。本文通过将 Rights 和 Sterba 的 R 平方框架扩展到纵向环境来解决这些差距。我们:(a) 为使用任何类型中心化的 MLMs 提供了总 R 平方和特定水平 R 平方度量的完整框架,并与 Rights 和 Sterba 的假设群集均值中心化的度量标准进行了对比,(b) 解释并推导出哪些度量标准适用于具有非线性项的 MLMs,并扩展 R 平方计算以适应 (c) 异方差和/或 (d) 自相关误差。此外,我们展示了如何使用增长模型之间的 R 平方差异(例如,将时变协变量作为水平 1 预测因子添加或将时不变协变量作为水平 2 预测因子添加)来获得个体术语的效应大小。我们提供了 R 软件 (r2MLMlong) 和一个分析青少年自我效能增长的运行教学示例,以说明这些方法的发展。有了这些发展,研究人员在使用 MLMs 分析和预测变化时,将能够更好地考虑效应大小。