Jamali Jamshid, Ayatollahi Seyyed Mohammad Taghi, Jafari Peyman
Department of Biostatistics and Epidemiology, School of Health, Mashhad University of Medical Sciences, Mashhad, Iran.
Social Determinants of Health Research Center, Mashhad University of Medical Sciences, Mashhad, Iran.
Mater Sociomed. 2018 Jun;30(2):121-126. doi: 10.5455/msm.2018.30.121-126.
In recent years, Multiple Indicators Multiple Causes (MIMIC) model has been widely used to assess measurement in variance, called Differential Item Functioning (DIF) analyses, in psychological and medical studies.
This simulation study aimed at assessing the effect of sample size, scale length, and magnitude of the uniform-DIF on detecting uniform-DIF with the MIMIC model when it has cross-loading in multidimensional scales.
In this Monte Carlo simulation study, we calculated power, Type I error rates, the bias of parameters estimation, Coverage Probability (CP), and Convergence Rate (CR) was used to assess the performance of the MIMIC model. The means of RMSEA, SRMR, CFI, and TLI, as indices of the goodness-of-fit for the MIMIC model, were computed across 1000 replications for each simulation condition.
Approximately, in all scenarios simulated, the bias of DIF parameters estimation was negligible. The existence of cross-loading caused a decrease of approximately 11.8% in the power and increase of 0.04-unit in bias parameter estimation. By increasing the relationship between dimensions, the power and CP of MIMIC model decreased, however, bias and CR were increased. In all scenarios that were performed in this study, all goodness-of-fit indices were at an acceptable level.
Our results indicated that the performance of the MIMIC model improved, when sample size, the number of items, and the magnitude of DIF increased. When the scale is multidimensional and model have cross-loading, the performance of the MIMIC model becomes questionable.
近年来,多指标多原因(MIMIC)模型已广泛应用于心理和医学研究中,用于评估方差测量,即差异项目功能(DIF)分析。
本模拟研究旨在评估样本量、量表长度和均匀DIF的大小对在多维量表中存在交叉负荷时使用MIMIC模型检测均匀DIF的影响。
在本蒙特卡洛模拟研究中,我们计算了功效、I型错误率、参数估计偏差、覆盖概率(CP)和收敛率(CR),以评估MIMIC模型的性能。在每个模拟条件下,通过1000次重复计算MIMIC模型拟合优度指标RMSEA、SRMR、CFI和TLI的均值。
在所有模拟场景中,DIF参数估计的偏差大致可忽略不计。交叉负荷的存在导致功效下降约11.8%,偏差参数估计增加0.04个单位。通过增加维度之间的相关性,MIMIC模型的功效和CP降低,然而偏差和CR增加。在本研究执行的所有场景中,所有拟合优度指标均处于可接受水平。
我们的结果表明,当样本量、项目数量和DIF大小增加时,MIMIC模型的性能得到改善。当量表是多维的且模型存在交叉负荷时,MIMIC模型的性能变得值得怀疑。