Department of Psychology, Faculty of Social Sciences, University of Macau, Avenida da Universidade, Taipa, Macau, China.
Department of Psychology, Chinese University of Hong Kong, Hong Kong, China.
Behav Res Methods. 2019 Apr;51(2):793-810. doi: 10.3758/s13428-018-1111-y.
Previous procedures for meta-analyzing dependent correlations have been found to overestimate or underestimate the true variation in effect sizes. Samplewise-adjusted procedures have been shown to perform better than simple within-study means when meta-analyzing dependent correlations. However, such procedures cannot be applied when correction for artifacts such as unreliability is desired. In the present study, we extended the procedures to correct for attenuation due to artifacts when meta-analyzing dependent correlations. Monte Carlo simulation was conducted in order to examine conditions with various degrees of dependence, degrees of heterogeneity, sample sizes, and numbers of studies, among other factors. The previous procedures, including the samplewise-adjusted procedures without correction, yielded biased point estimates and confidence intervals with low coverage probabilities of the population mean correlation and degree of heterogeneity. More importantly, the bias and undercoverage of the confidence interval increased with the mean sample size and number of studies in many conditions. The new samplewise-adjusted procedures with correction for attenuation yielded negligible biases when estimating the mean population correlation, even in the presence of dependent correlations. Given that the need for correction for attenuation due to artifacts is becoming more recognized in meta-analysis, our findings highlight the importance of such considerations when meta-analyzing dependent correlations. Conditions under which these procedures can be further improved are also discussed.
之前用于元分析相关系数的方法被发现会高估或低估效应大小的真实变异。当元分析相关系数时,样本调整后的方法比简单的单研究平均值表现更好。然而,当需要校正不准确性等人工制品时,这些方法就无法应用了。在本研究中,我们扩展了这些程序,以在元分析相关系数时校正由于人工制品引起的衰减。为了检验各种依存关系、异质性程度、样本量和研究数量等因素的条件,进行了蒙特卡罗模拟。之前的程序,包括未经校正的样本调整程序,产生了有偏差的点估计值和置信区间,其对总体相关系数和异质性程度的覆盖率概率较低。更重要的是,在许多情况下,置信区间的偏差和覆盖率不足随着平均样本量和研究数量的增加而增加。新的样本调整后的程序,在校正衰减时,即使在存在相关关系的情况下,对估计总体相关系数的偏差也可以忽略不计。鉴于在元分析中越来越认识到需要校正由于人工制品引起的衰减,我们的研究结果强调了当元分析相关关系时需要考虑这些因素的重要性。还讨论了这些程序可以进一步改进的条件。