International Development Division, American Institutes for Research, Arlington, VA, USA.
Principal Economist, American Institutes for Research, Washington, DC, USA.
Eval Rev. 2023 Oct;47(5):786-819. doi: 10.1177/0193841X231154714. Epub 2023 Feb 2.
The sharp increase in the number of experimental studies evaluating development programs raises the need for accurate intraclass correlations (ICC) to conduct power calculations so that researchers can design studies to detect meaningful effects with sufficient statistical power. The intraclass correlation is an important parameter for determining the statistical power of cluster-randomized trials. The parameter is rarely available to researchers planning a study until after the design is set and data are already collected. This paper takes an important step towards helping researchers working in sub-Saharan Africa to accurately estimate appropriate sample sizes for their clustered RCTs. The study draws from rich data sets in Kenya, Malawi, Zambia, and Zimbabwe. We present ICCs for a wide range of domains common for development research. Our results suggest that ICCs for commonly studied indicators in sub-Saharan Africa are lower than is often assumed in power calculations. ICC values are especially low for indicators associated with child nutrition and food security, suggesting that cluster-RCTs might be a viable design even when faced with limited budgets because sample size requirements are not much different from an individual random assignment design.
数量急剧增加的实验研究评估发展计划提出了需要准确的组内相关系数(ICC)进行功效计算,以便研究人员可以设计出具有足够统计功效的研究来检测有意义的效果。组内相关系数是确定集群随机试验统计功效的重要参数。该参数很少在研究人员计划研究时提供,直到设计确定并且已经收集了数据。本文朝着帮助在撒哈拉以南非洲工作的研究人员准确估计其聚类 RCT 的适当样本量迈出了重要一步。该研究借鉴了肯尼亚、马拉维、赞比亚和津巴布韦的丰富数据集。我们提出了一系列常见的发展研究领域的 ICC。我们的研究结果表明,在撒哈拉以南非洲常见的研究指标的 ICC 比功效计算中通常假设的要低。与儿童营养和粮食安全相关的指标的 ICC 值特别低,这表明即使面对有限的预算,集群 RCT 也可能是一种可行的设计,因为样本量要求与个体随机分配设计没有太大区别。