Suppr超能文献

“可重复性危机”:行为分析研究中常用的方法会有所帮助吗?

The "Reproducibility Crisis:" Might the Methods Used Frequently in Behavior-Analysis Research Help?

作者信息

Branch Marc N

机构信息

Psychology Department, University of Florida, Gainesville, FL 32611 USA.

出版信息

Perspect Behav Sci. 2018 Jun 4;42(1):77-89. doi: 10.1007/s40614-018-0158-5. eCollection 2019 Mar.

Abstract

Mainstream biomedical and behavioral sciences are facing what has been dubbed "the reproducibility crisis." The crisis is borne out of failures to replicate the results of published research at an average rate of somewhere near 50%. In this paper I make a case that the prime culprit leading to this unsatisfactory state of affairs has been the widespread use of -values from tests of statistical significance as a criterion for publication. Even though it has been known, and made public, for decades that -values provide no quantitative information about the likelihood that experimental results are likely to be repeatable, they remain a fundamental criterion for publication. A growing realization among researchers that -values do not provide information that bears on repeatability may offer an opportunity for wider application of research methods frequently used in the research specialty known as Behavior Analysis, as well as a few other research traditions. These alternative approaches are founded on within- and between-participant replication as integral parts of research designs. The erosion of public confidence in science, which is bolstered by the reproducibility crisis, is a serious threat. Anything that the field of Behavior Analysis can offer as assistance in ameliorating the problem should be welcomed.

摘要

主流生物医学和行为科学正面临着所谓的“可重复性危机”。这场危机源于已发表研究结果的平均重复率仅接近50%这一事实。在本文中,我认为导致这种不尽人意状况的主要罪魁祸首是广泛将统计显著性检验的p值用作发表标准。尽管几十年来人们都知道且已公开,p值并不能提供关于实验结果可重复性可能性的定量信息,但它们仍然是发表的基本标准。研究人员越来越意识到p值并不能提供与可重复性相关的信息,这可能为行为分析这一研究专业以及其他一些研究传统中常用的研究方法的更广泛应用提供机会。这些替代方法基于参与者内部和参与者之间的重复,将其作为研究设计的组成部分。可重复性危机加剧了公众对科学的信心侵蚀,这是一个严重威胁。行为分析领域能提供的任何有助于缓解该问题的帮助都应受到欢迎。

相似文献

1
The "Reproducibility Crisis:" Might the Methods Used Frequently in Behavior-Analysis Research Help?
Perspect Behav Sci. 2018 Jun 4;42(1):77-89. doi: 10.1007/s40614-018-0158-5. eCollection 2019 Mar.
3
An Overview of Scientific Reproducibility: Consideration of Relevant Issues for Behavior Science/Analysis.
Perspect Behav Sci. 2019 Mar 22;42(1):33-57. doi: 10.1007/s40614-019-00193-3. eCollection 2019 Mar.
4
The Evolution of Behavior Analysis: Toward a Replication Crisis?
Perspect Behav Sci. 2020 Aug 12;43(4):655-675. doi: 10.1007/s40614-020-00264-w. eCollection 2020 Dec.
5
Replicator degrees of freedom allow publication of misleading failures to replicate.
Proc Natl Acad Sci U S A. 2019 Dec 17;116(51):25535-25545. doi: 10.1073/pnas.1910951116. Epub 2019 Nov 25.
6
Open science, the replication crisis, and environmental public health.
Account Res. 2023 Jan;30(1):34-62. doi: 10.1080/08989621.2021.1962713. Epub 2021 Aug 17.
7
Guidelines, editors, pharma and the biological paradigm shift.
Mens Sana Monogr. 2007 Jan;5(1):27-30. doi: 10.4103/0973-1229.32176.
9
Publication bias and the canonization of false facts.
Elife. 2016 Dec 20;5:e21451. doi: 10.7554/eLife.21451.
10
How I Learned to Stop Worrying and Love Replication Failures.
Perspect Behav Sci. 2018 May 9;42(1):91-108. doi: 10.1007/s40614-018-0153-x. eCollection 2019 Mar.

引用本文的文献

2
Levels of Replication.
Perspect Behav Sci. 2025 Jan 27;48(1):41-58. doi: 10.1007/s40614-024-00431-3. eCollection 2025 Mar.
4
Technical pitfalls when collecting, cryopreserving, thawing, and stimulating human T-cells.
Front Immunol. 2024 May 15;15:1382192. doi: 10.3389/fimmu.2024.1382192. eCollection 2024.
5
Evolution of fertilization ability in obligatorily outcrossing populations of .
PeerJ. 2023 Sep 8;11:e15825. doi: 10.7717/peerj.15825. eCollection 2023.
6
Monte Carlo Analyses for Single-Case Experimental Designs: An Untapped Resource for Applied Behavioral Researchers and Practitioners.
Perspect Behav Sci. 2021 Nov 24;45(1):209-237. doi: 10.1007/s40614-021-00318-7. eCollection 2022 Mar.
7
Meta-Analytic Methods to Detect Publication Bias in Behavior Science Research.
Perspect Behav Sci. 2021 Jul 21;45(1):37-52. doi: 10.1007/s40614-021-00303-0. eCollection 2022 Mar.
9
The Evolution of Behavior Analysis: Toward a Replication Crisis?
Perspect Behav Sci. 2020 Aug 12;43(4):655-675. doi: 10.1007/s40614-020-00264-w. eCollection 2020 Dec.

本文引用的文献

1
PSYCHOLOGY. Estimating the reproducibility of psychological science.
Science. 2015 Aug 28;349(6251):aac4716. doi: 10.1126/science.aac4716.
2
The extent and consequences of p-hacking in science.
PLoS Biol. 2015 Mar 13;13(3):e1002106. doi: 10.1371/journal.pbio.1002106. eCollection 2015 Mar.
3
Reproducibility in science: improving the standard for basic and preclinical research.
Circ Res. 2015 Jan 2;116(1):116-26. doi: 10.1161/CIRCRESAHA.114.303819.
4
Introduction to the special issue on reliability and replication in cognitive and affective neuroscience research.
Cogn Affect Behav Neurosci. 2013 Dec;13(4):687-9. doi: 10.3758/s13415-013-0201-7.
5
Perils of evidence-based medicine.
Perspect Biol Med. 2010 Winter;53(1):106-20. doi: 10.1353/pbm.0.0132.
8
Why most published research findings are false.
PLoS Med. 2005 Aug;2(8):e124. doi: 10.1371/journal.pmed.0020124. Epub 2005 Aug 30.
9
Large-scale randomised trials--a misguided approach to clinical research.
Med Hypotheses. 2005;64(3):651-7. doi: 10.1016/j.mehy.2004.09.006.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验