Moeyaert Mariola, Yang Panpan, Xu Xinyun
School of Education, Department of Educational and Counseling Psychology, Division of Educational Psychology and Methodology, The University at Albany-SUNY, 1400 Washington Avenue, Albany, NY 12222 USA.
Perspect Behav Sci. 2021 Sep 1;45(1):13-35. doi: 10.1007/s40614-021-00304-z. eCollection 2022 Mar.
This study investigated the power of two-level hierarchical linear modeling (HLM) to explain variability in intervention effectiveness between participants in context of single-case experimental design (SCED) research. HLM is a flexible technique that allows the inclusion of participant characteristics (e.g., age, gender, and disability types) as moderators, and as such supplements visual analysis findings. First, this study empirically investigated the power to estimate intervention and moderator effects using Monte Carlo simulation techniques. The results indicate that larger values for the true effects and the number of participants resulted in a higher power. The more moderators added to the model, the more participants needed to detect the effects with sufficient power (i.e., power ≥.80). When a model includes three moderators, at least 20 participants are required to capture the intervention effect and moderator effects with sufficient power. For that same condition, but only including one moderator, seven participants are sufficient. Specific recommendations for designing a SCED study with sufficient power to estimate intervention and moderator effects were provided. Second, this study introduced a newly developed user-friendly point and click Shiny tool, . This tool assists applied SCED researchers in designing a SCED study that has sufficient power to detect intervention and moderator effects. To end, the use of HLM with the inclusion of moderators was demonstrated using two previously published SCED studies in the journal
本研究调查了二级分层线性模型(HLM)在单病例实验设计(SCED)研究背景下解释参与者间干预效果变异性的能力。HLM是一种灵活的技术,它允许将参与者特征(如年龄、性别和残疾类型)作为调节变量纳入,从而补充视觉分析结果。首先,本研究使用蒙特卡罗模拟技术实证研究了估计干预和调节效应的能力。结果表明,真实效应值和参与者数量越大,检验效能越高。模型中添加的调节变量越多,就需要越多的参与者才能以足够的检验效能(即检验效能≥0.80)检测到效应。当模型包含三个调节变量时,至少需要20名参与者才能以足够的检验效能捕捉干预效应和调节效应。对于相同条件,但只包含一个调节变量的情况,七名参与者就足够了。本研究还提供了关于设计具有足够检验效能以估计干预和调节效应的SCED研究的具体建议。其次,本研究引入了一个新开发的用户友好型的点击式Shiny工具。该工具可协助应用SCED研究人员设计一项具有足够检验效能以检测干预和调节效应的SCED研究。最后,通过期刊上两篇先前发表的SCED研究展示了包含调节变量的HLM的使用情况。