Smithson Michael, Shou Yiyun
Research School of Psychology, The Australian National University, Bldg 39, Canberra, ACT, 2601, Australia.
Behav Res Methods. 2017 Apr;49(2):747-757. doi: 10.3758/s13428-016-0735-z.
This paper discusses largely ignored issues regarding moderation of effect-sizes. We show that, under commonly-occurring conditions, popular alternatives for effect-size measures in ANOVA and multiple regression are not moderated identically across independent samples. Effects may appear to be unmoderated according to one effect-size measure but not according to another, or may even be moderated in opposite directions. We identify the conditions under which differential effect-size moderation can occur, and show that they are commonplace. We then review techniques for detecting and dealing with differential moderation of alternative effect-size measures. Finally, we discuss implications for research practice, reporting, replication, and meta-analysis.
本文讨论了在很大程度上被忽视的效应量调节问题。我们表明，在常见条件下，方差分析和多元回归中效应量测量的常用替代方法在不同独立样本中的调节情况并不相同。根据一种效应量测量方法，效应可能看似未被调节，但根据另一种方法则不然，甚至可能在相反方向上被调节。我们确定了可能出现效应量差异调节的条件，并表明这些条件很常见。然后，我们回顾了检测和处理替代效应量测量方法差异调节的技术。最后，我们讨论了对研究实践、报告、复制和元分析的影响。
