Department of Behavioural Biology, University of Münster, Badestraße 13, 48149 Münster, Germany.
Department of Behavioural Biology, University of Münster, Badestraße 13, 48149 Münster, Germany.
J Neurosci Methods. 2024 Jan 1;401:109992. doi: 10.1016/j.jneumeth.2023.109992. Epub 2023 Oct 24.
Life sciences are currently facing a reproducibility crisis. Originally, the crisis was born out of single alarming failures to reproduce findings at different times and locations. Nowadays, systematic studies indicate that the prevalence of irreproducible research does in fact exceed 50%. Viewed from a rather cynical perspective, Fett's law of the lab "Never replicate a successful experiment" has thus taken on a completely new meaning. In this respect, animal research has come under particular scrutiny, as the stakes are high in terms of both research ethics and societal impact. To counteract this, it is essential to identify sources of poor reproducibility as well as to iron out these failures. We here review the current debate, briefly discuss potential reasons, and summarize steps that have already been undertaken to improve reproducibility in animal research. By the example of classical behavioural phenotyping studies, we particularly highlight the role strict standardization plays in exacerbating the crisis, and review the concept of systematic heterogenization as an alternative strategy to deal with variation in animal studies. Briefly, we argue that systematic variation rather than strict homogenization of experimental conditions benefits the robustness of research findings, and hence their reproducibility. To this end, we will present concrete examples for systematically heterogenized experiments and provide a practical guide on how to apply systematic heterogenization in experimental practice.
生命科学目前正面临着可重复性危机。最初,这场危机源于不同时间和地点对研究结果的单一、令人震惊的不可重复性。如今,系统研究表明,事实上不可重复研究的普遍性确实超过了 50%。从相当愤世嫉俗的角度来看,Fett 实验室的定律“切勿复制成功的实验”因此具有了全新的含义。在这方面,动物研究受到了特别的关注,因为在研究伦理和社会影响方面,风险都很高。为了应对这一问题,必须确定导致可重复性差的原因,并消除这些失败。在这里,我们回顾了当前的争论,简要讨论了潜在的原因,并总结了已经采取的步骤,以提高动物研究的可重复性。通过经典行为表型研究的例子,我们特别强调了严格标准化在加剧危机方面所起的作用,并综述了系统异质化作为应对动物研究中变异的替代策略的概念。简而言之,我们认为系统变异而不是严格同质化实验条件有利于研究结果的稳健性,从而提高其可重复性。为此,我们将为系统异质化实验提供具体示例,并提供一个实用指南,说明如何在实验实践中应用系统异质化。