Department of Quantitative Methods, The Danish Center for Social Science Research, VIVE, Aarhus, Denmark.
University of Wisconsin-Madison, Madison, Wisconsin, USA.
Res Synth Methods. 2024 Nov;15(6):1214-1230. doi: 10.1002/jrsm.1752. Epub 2024 Sep 18.
Sample size and statistical power are important factors to consider when planning a research synthesis. Power analysis methods have been developed for fixed effect or random effects models, but until recently these methods were limited to simple data structures with a single, independent effect per study. Recent work has provided power approximation formulas for meta-analyses involving studies with multiple, dependent effect size estimates, which are common in syntheses of social science research. Prior work focused on developing and validating the approximations but did not address the practice challenges encountered in applying them for purposes of planning a synthesis involving dependent effect sizes. We aim to facilitate the application of these recent developments by providing practical guidance on how to conduct power analysis for planning a meta-analysis of dependent effect sizes and by introducing a new R package, POMADE, designed for this purpose. We present a comprehensive overview of resources for finding information about the study design features and model parameters needed to conduct power analysis, along with detailed worked examples using the POMADE package. For presenting power analysis findings, we emphasize graphical tools that can depict power under a range of plausible assumptions and introduce a novel plot, the traffic light power plot, for conveying the degree of certainty in one's assumptions.
样本量和统计功效是规划研究综合时需要考虑的重要因素。功效分析方法已经为固定效应或随机效应模型开发,但直到最近,这些方法仅限于每个研究具有单一独立效应的简单数据结构。最近的工作为涉及多个依赖于效应量估计的研究的荟萃分析提供了功效近似公式,这在社会科学研究的综合中很常见。之前的工作侧重于开发和验证这些近似值,但没有解决在为涉及依赖于效应量的综合目的应用它们时遇到的实践挑战。我们旨在通过提供有关如何针对依赖于效应量的荟萃分析进行功效分析的实用指导,以及引入一个新的专为该目的设计的 R 包 POMADE,来促进这些最新发展的应用。我们全面概述了查找有关进行功效分析所需的研究设计特征和模型参数的信息的资源,并使用 POMADE 包提供了详细的工作示例。为了呈现功效分析结果,我们强调了可以描绘在一系列合理假设下的功效的图形工具,并引入了一种新颖的图形,即红绿灯功效图,用于传达对假设的确定性程度。