Department of Statistics, Northwestern University, Evanston, IL, USA.
University of California, Merced, CA, USA.
Behav Res Methods. 2023 Oct;55(7):3494-3503. doi: 10.3758/s13428-022-01971-9. Epub 2022 Oct 12.
Currently, the design standards for single-case experimental designs (SCEDs) are based on validity considerations as prescribed by the What Works Clearinghouse. However, there is a need for design considerations such as power based on statistical analyses. We compute and derive power using computations for (AB) designs with multiple cases which are common in SCEDs. Our computations show that effect size has the maximum impact on power followed by the number of subjects and then the number of phase reversals. An effect size of 0.75 or higher, at least one set of phase reversals (i.e., where k > 1), and at least three subjects showed high power. The latter two conditions agree with current standards about either having at least an ABAB design or a multiple baseline design with three subjects to meet design standards. An effect size of 0.75 or higher is not uncommon in SCEDs either. Autocorrelations, the number of time-points per phase, and intraclass correlations had a smaller but non-negligible impact on power. In sum, power analyses in the present study show that conditions to meet power requirements are not unreasonable in SCEDs. The software code to compute power is available on GitHub for the use of the reader.
目前,单案例实验设计 (SCED) 的设计标准基于 What Works Clearinghouse 规定的有效性考虑因素。但是,需要考虑基于统计分析的设计考虑因素,例如功效。我们使用常见于 SCED 的具有多个案例的 (AB) 设计进行计算和推导功效。我们的计算表明,效果大小对功效的影响最大,其次是受试者数量,然后是反转阶段的数量。效果大小为 0.75 或更高,至少一组阶段反转(即 k > 1),至少三个受试者具有高功效。后两个条件符合当前标准,即至少有一个 ABAB 设计或具有三个受试者的多个基线设计,以满足设计标准。在 SCED 中,效果大小为 0.75 或更高也并不罕见。自相关、每个阶段的时间点数量和组内相关对功效的影响较小,但不可忽视。总之,本研究中的功效分析表明,满足功效要求的条件在 SCED 中并非不合理。计算功效的软件代码可在 GitHub 上供读者使用。