Department of Psychological Methods, University of Amsterdam, the Netherlands.
Department of Psychiatry, Massachusetts General Hospital & Harvard Medical School, USA; Department of Applied Psychology, Northeastern University, USA.
Behav Res Ther. 2022 Oct;157:104163. doi: 10.1016/j.brat.2022.104163. Epub 2022 Aug 3.
Network psychometric models are often estimated using a single indicator for each node in the network, thus failing to consider potential measurement error. In this study, we investigate the impact of measurement error on cross-sectional network models. First, we conduct a simulation study to evaluate the performance of models based on single indicators as well as models that utilize information from multiple indicators per node, including average scores, factor scores, and latent variables. Our results demonstrate that measurement error impairs the reliability and performance of network models, especially when using single indicators. The reliability and performance of network models improves substantially with increasing sample size and when using methods that combine information from multiple indicators per node. Second, we use empirical data from the STARD trial (n = 3,731) to further evaluate the impact of measurement error. In the STARD trial, depression symptoms were assessed via three questionnaires, providing multiple indicators per symptom. Consistent with our simulation results, we find that when using sub-samples of this dataset, the discrepancy between the three single-indicator networks (one network per questionnaire) diminishes with increasing sample size. Together, our simulated and empirical findings provide evidence that measurement error can hinder network estimation when working with smaller samples and offers guidance on methods to mitigate measurement error.
网络心理计量模型通常使用网络中每个节点的单个指标进行估计,因此未能考虑潜在的测量误差。在本研究中,我们研究了测量误差对横截面网络模型的影响。首先,我们进行了一项模拟研究,以评估基于单个指标的模型以及利用每个节点的多个指标(包括平均分数、因子分数和潜在变量)的模型的性能。我们的结果表明,测量误差会损害网络模型的可靠性和性能,特别是在使用单个指标时。随着样本量的增加和使用每个节点结合多个指标信息的方法,网络模型的可靠性和性能会有显著提高。其次,我们使用 STARD 试验(n=3731)的实证数据进一步评估测量误差的影响。在 STARD 试验中,通过三个问卷评估抑郁症状,每个症状提供多个指标。与我们的模拟结果一致,我们发现,当使用该数据集的子样本时,三个单指标网络(每个问卷一个网络)之间的差异随着样本量的增加而减小。综上所述,我们的模拟和实证研究结果表明,当使用较小的样本量时,测量误差可能会阻碍网络估计,并为减轻测量误差的方法提供了指导。