Suppr超能文献

认知神经科学在开放性、透明度和可重复性方面的进展。

Progress toward openness, transparency, and reproducibility in cognitive neuroscience.

作者信息

Gilmore Rick O, Diaz Michele T, Wyble Brad A, Yarkoni Tal

机构信息

Department of Psychology, the Pennsylvania State University, University Park, Pennsylvania.

Social, Life, & Engineering Sciences Imaging Center, the Pennsylvania State University, University Park, Pennsylvania.

出版信息

Ann N Y Acad Sci. 2017 May;1396(1):5-18. doi: 10.1111/nyas.13325. Epub 2017 May 2.

Abstract

Accumulating evidence suggests that many findings in psychological science and cognitive neuroscience may prove difficult to reproduce; statistical power in brain imaging studies is low and has not improved recently; software errors in analysis tools are common and can go undetected for many years; and, a few large-scale studies notwithstanding, open sharing of data, code, and materials remain the rare exception. At the same time, there is a renewed focus on reproducibility, transparency, and openness as essential core values in cognitive neuroscience. The emergence and rapid growth of data archives, meta-analytic tools, software pipelines, and research groups devoted to improved methodology reflect this new sensibility. We review evidence that the field has begun to embrace new open research practices and illustrate how these can begin to address problems of reproducibility, statistical power, and transparency in ways that will ultimately accelerate discovery.

摘要

越来越多的证据表明,心理科学和认知神经科学中的许多研究结果可能难以重现;脑成像研究的统计效力较低,且最近没有得到改善;分析工具中的软件错误很常见,并且可能多年都未被发现;此外,尽管有一些大规模研究,但数据、代码和材料的开放共享仍然是罕见的例外情况。与此同时,人们重新将可重复性、透明度和开放性视为认知神经科学的基本核心价值。数据档案库、元分析工具、软件管道以及致力于改进方法的研究小组的出现和迅速发展反映了这种新的认知。我们回顾了该领域已开始采用新的开放研究实践的证据,并说明了这些实践如何能够开始以最终加速发现的方式解决可重复性、统计效力和透明度问题。

相似文献

1
Progress toward openness, transparency, and reproducibility in cognitive neuroscience.
Ann N Y Acad Sci. 2017 May;1396(1):5-18. doi: 10.1111/nyas.13325. Epub 2017 May 2.
2
Opportunities for increased reproducibility and replicability of developmental neuroimaging.
Dev Cogn Neurosci. 2021 Feb;47:100902. doi: 10.1016/j.dcn.2020.100902. Epub 2020 Dec 17.
3
Is neuroimaging measuring information in the brain?
Psychon Bull Rev. 2016 Oct;23(5):1415-1428. doi: 10.3758/s13423-016-1002-0.
4
NeuroPycon: An open-source python toolbox for fast multi-modal and reproducible brain connectivity pipelines.
Neuroimage. 2020 Oct 1;219:117020. doi: 10.1016/j.neuroimage.2020.117020. Epub 2020 Jun 6.
5
Ghosts in machine learning for cognitive neuroscience: Moving from data to theory.
Neuroimage. 2018 Oct 15;180(Pt A):88-100. doi: 10.1016/j.neuroimage.2017.08.019. Epub 2017 Aug 6.
6
The RUMBA software: tools for neuroimaging data analysis.
Neuroinformatics. 2004;2(1):71-100. doi: 10.1385/NI:2:1:071.
7
The present and future use of functional near-infrared spectroscopy (fNIRS) for cognitive neuroscience.
Ann N Y Acad Sci. 2020 Mar;1464(1):5-29. doi: 10.1111/nyas.13948. Epub 2018 Aug 7.
8
Laminar fMRI: Applications for cognitive neuroscience.
Neuroimage. 2019 Aug 15;197:785-791. doi: 10.1016/j.neuroimage.2017.07.004. Epub 2017 Jul 4.
9
Functional neuroimaging as a catalyst for integrated neuroscience.
Nature. 2023 Nov;623(7986):263-273. doi: 10.1038/s41586-023-06670-9. Epub 2023 Nov 8.
10
A Practical Guide for Improving Transparency and Reproducibility in Neuroimaging Research.
PLoS Biol. 2016 Jul 7;14(7):e1002506. doi: 10.1371/journal.pbio.1002506. eCollection 2016 Jul.

引用本文的文献

1
Spatial Frequency Maps in Human Visual Cortex: A Replication and Extension.
bioRxiv. 2025 Feb 5:2025.01.21.634150. doi: 10.1101/2025.01.21.634150.
3
Topological cluster statistic (TCS): Toward structural connectivity-guided fMRI cluster enhancement.
Netw Neurosci. 2024 Oct 1;8(3):902-925. doi: 10.1162/netn_a_00375. eCollection 2024.
6
Transparency and Reproducibility in the Adolescent Brain Cognitive Development (ABCD) Study.
medRxiv. 2024 May 31:2024.05.30.24308222. doi: 10.1101/2024.05.30.24308222.
7
A scoping review on what constitutes a good research culture.
F1000Res. 2024 Oct 14;13:324. doi: 10.12688/f1000research.147599.1. eCollection 2024.
8
A research agenda for understanding how social inequality is linked to brain structure and function.
Nat Hum Behav. 2024 Jan;8(1):20-31. doi: 10.1038/s41562-023-01774-8. Epub 2024 Jan 3.
10
Hemispheric Asymmetry in TMS-Induced Effects on Spatial Attention: A Meta-Analysis.
Neuropsychol Rev. 2024 Sep;34(3):838-849. doi: 10.1007/s11065-023-09614-2. Epub 2023 Sep 22.

本文引用的文献

1
A manifesto for reproducible science.
Nat Hum Behav. 2017 Jan 10;1(1):0021. doi: 10.1038/s41562-016-0021.
2
I tried a bunch of things: The dangers of unexpected overfitting in classification of brain data.
Neurosci Biobehav Rev. 2020 Dec;119:456-467. doi: 10.1016/j.neubiorev.2020.09.036. Epub 2020 Oct 6.
3
Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning.
Perspect Psychol Sci. 2017 Nov;12(6):1100-1122. doi: 10.1177/1745691617693393. Epub 2017 Aug 25.
4
Fixing the stimulus-as-fixed-effect fallacy in task fMRI.
Wellcome Open Res. 2016 Dec 9;1:23. doi: 10.12688/wellcomeopenres.10298.2.
5
FMRI Clustering in AFNI: False-Positive Rates Redux.
Brain Connect. 2017 Apr;7(3):152-171. doi: 10.1089/brain.2016.0475.
6
BIDS apps: Improving ease of use, accessibility, and reproducibility of neuroimaging data analysis methods.
PLoS Comput Biol. 2017 Mar 9;13(3):e1005209. doi: 10.1371/journal.pcbi.1005209. eCollection 2017 Mar.
7
Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature.
PLoS Biol. 2017 Mar 2;15(3):e2000797. doi: 10.1371/journal.pbio.2000797. eCollection 2017 Mar.
8
Best practices in data analysis and sharing in neuroimaging using MRI.
Nat Neurosci. 2017 Feb 23;20(3):299-303. doi: 10.1038/nn.4500.
9
Scanning the horizon: towards transparent and reproducible neuroimaging research.
Nat Rev Neurosci. 2017 Feb;18(2):115-126. doi: 10.1038/nrn.2016.167. Epub 2017 Jan 5.
10
Assessing and tuning brain decoders: Cross-validation, caveats, and guidelines.
Neuroimage. 2017 Jan 15;145(Pt B):166-179. doi: 10.1016/j.neuroimage.2016.10.038. Epub 2016 Oct 29.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验