Profectus Pharma Consulting Inc., San Jose 95125, United States.
Department of Pharmacology, Feinberg School of Medicine, Northwestern University, Chicago 60611, United States.
Biochem Pharmacol. 2015 Sep 15;97(2):133-6. doi: 10.1016/j.bcp.2015.07.002. Epub 2015 Jul 31.
The credibility and consequent sustainability of the biomedical research "ecosystem" is in jeopardy, in part due to an inability to reproduce data from the peer-reviewed literature. Despite obvious and relatively inexpensive solutions to improve reproducibility-ensuring that experimental reagents, specifically cancer cell lines and antibodies, are authenticated/validated before use and that best practices in statistical usage are incorporated into the design, analysis, and reporting of experiments-these are routinely ignored, a reflection of hubris and a comfort with the status quo on the part of many investigators. New guidelines for the peer review of publications and grant applications introduced in the past year, while well-intended, lack the necessary consequences, e.g., denial of funding, that would result in sustained improvements when scientific rigor is lacking and/or transparency is, at best, opaque. An additional factor contributing to irreproducibility is a reductionist mindset that prioritizes certainty in research outcomes over the ambiguity intrinsic to biological systems that is often reflected in "unknown unknowns". This has resulted in a tendency towards codifying "rules" that can provide "yes-no" outcomes that represent a poor substitute for the intellectual challenge and skepticism that leads to an awareness and consideration of "unknown unknowns". When acknowledged as potential causes of unexpected experimental outcomes, these can often transition into the "knowns" that facilitate positive, disruptive innovation in biomedical research like the human microbiome. Changes in investigator mindset, both in terms of validating reagents and embracing ambiguity, are necessary to aid in reducing issues with reproducibility.
生物医学研究“生态系统”的可信度及其可持续性正面临威胁,部分原因是无法重现同行评议文献中的数据。尽管有明显且相对廉价的解决方案可以提高可重复性——确保在使用实验试剂(特别是癌细胞系和抗体)之前对其进行认证/验证,并在实验的设计、分析和报告中纳入统计使用的最佳实践——但这些通常被忽视了,这反映了许多研究人员的傲慢和对现状的自满。过去一年中引入的出版物和资助申请同行评审新指南,虽然初衷良好,但缺乏必要的后果,例如拒绝资助,当科学严谨性不足且/或透明度充其量不透明时,这将导致持续改进。导致不可重现性的另一个因素是还原论思维,它优先考虑研究结果的确定性,而不是生物系统固有的模糊性,这通常反映在“未知的未知”中。这导致了一种倾向,即将“规则”编纂起来,这些“规则”可以提供“是/否”的结果,这是对导致对“未知的未知”的认识和考虑的智力挑战和怀疑的糟糕替代品。当这些被承认为意外实验结果的潜在原因时,它们通常可以转变为“已知”,从而促进生物医学研究中的积极、颠覆性创新,如人类微生物组。研究人员思维方式的改变,无论是在验证试剂还是接受模糊性方面,都有助于减少可重复性问题。