Simonsohn Uri
The Wharton School, University of Pennsylvania
Psychol Sci. 2015 May;26(5):559-69. doi: 10.1177/0956797614567341. Epub 2015 Mar 23.
This article introduces a new approach for evaluating replication results. It combines effect-size estimation with hypothesis testing, assessing the extent to which the replication results are consistent with an effect size big enough to have been detectable in the original study. The approach is demonstrated by examining replications of three well-known findings. Its benefits include the following: (a) differentiating "unsuccessful" replication attempts (i.e., studies yielding p > .05) that are too noisy from those that actively indicate the effect is undetectably different from zero, (b) "protecting" true findings from underpowered replications, and (c) arriving at intuitively compelling inferences in general and for the revisited replications in particular.
本文介绍了一种评估重复研究结果的新方法。它将效应量估计与假设检验相结合,评估重复研究结果与在原始研究中足以被检测到的效应量的一致程度。通过检验三个著名研究结果的重复情况来展示该方法。其优点包括:(a) 区分因噪声过大而 “不成功” 的重复尝试(即p>.05的研究)与那些表明效应与零无显著差异的重复尝试;(b) 保护真实结果不被功效不足的重复研究所掩盖;(c) 总体上得出直观上令人信服的推断,特别是对于重新审视的重复研究而言。