Centre for the Psychology of Learning and Experimental Psychopathology, Faculty of Psychology & Educational Sciences, KU Leuven, Belgium; Leuven Brain Institute, KU Leuven, Belgium.
Leuven Brain Institute, KU Leuven, Belgium; Laboratory for Brain-Gut Axis Studies (LaBGAS), Translational Research Centre for Gastrointestinal Disorders (TARGID), Department of Chronic Diseases, KU Leuven, Belgium.
Cortex. 2020 Aug;129:510-525. doi: 10.1016/j.cortex.2020.03.031. Epub 2020 Jun 18.
In a highly influential report, Schiller et al. (2010) demonstrated long-lasting fear reduction in humans when conducting extinction training shortly following fear memory reactivation. While trying to experimentally replicate the critical conditions of Schiller et al. (2010, Experiment 1), we discovered several irregularities in their paper. Criteria for participant exclusion and the number of excluded participants were misreported; qualitative experimenter decisions actually determined their participant inclusions. Moreover, their statistical analyses were internally inconsistent. After corresponding with the original authors, we received their original data files, allowing us to replicate the reported analyses to verify their results. Here, we report the results of seven separate sets of analyses, three replicating the analyses reported by Schiller et al. (2010) and four applying more principled approaches to participant exclusion, thus including different subsets of the total datasets available, to deduce the influence of specific exclusions and experimenter decisions on the results. For Experiment 1, we were mostly able to replicate the analyses contained in the original report when applying the same qualitative exclusions. However, we found that all of the differences in fear recovery between reactivation-extinction and regular extinction reported by Schiller et al. (2010) were dependent on the qualitative exclusions that they made. With any of the principled approaches to participant exclusion, the degree of fear recovery was highly similar between groups. For Experiment 2, a similar analysis was not possible due to a lack of available data for the excluded participants. Hence, we conducted a verification analysis on the original sample only, which failed to confirm the differences in fear recovery reported by Schiller et al. (2010). Together with the re-analyses, we report a number of additional issues with the way Schiller et al. (2010) processed, analyzed, and reported their data that indicate that their results are unreliable and flawed.
在一篇极具影响力的报告中,Schiller 等人(2010)表明,在恐惧记忆重新激活后不久进行消退训练,可在人类中产生持久的恐惧减少。在尝试实验复制 Schiller 等人(2010,实验 1)的关键条件时,我们发现他们的论文中有几处不规范。参与者排除标准和排除的参与者人数被错误报告;定性实验者决策实际上决定了他们的参与者纳入。此外,他们的统计分析是内部不一致的。在与原作者通信后,我们收到了他们的原始数据文件,使我们能够复制报告的分析来验证他们的结果。在这里,我们报告了七组独立分析的结果,其中三组复制了 Schiller 等人(2010)报告的分析,另外四组采用了更严谨的方法来排除参与者,因此纳入了可用总数据集的不同子集,以推断特定排除和实验者决策对结果的影响。对于实验 1,当应用相同的定性排除时,我们大多能够复制原始报告中的分析。然而,我们发现,Schiller 等人(2010)报告的重新激活-消退和常规消退之间的恐惧恢复差异都依赖于他们所做的定性排除。对于任何基于原则的参与者排除方法,组间的恐惧恢复程度都非常相似。对于实验 2,由于排除参与者的数据不可用,因此无法进行类似的分析。因此,我们仅对原始样本进行了验证分析,该分析未能证实 Schiller 等人(2010)报告的恐惧恢复差异。结合重新分析,我们报告了 Schiller 等人(2010)处理、分析和报告数据的一些其他问题,这些问题表明他们的结果不可靠且存在缺陷。