Suppr超能文献

《禅与多重比较的艺术》

Zen and the art of multiple comparisons.

作者信息

Lindquist Martin A, Mejia Amanda

机构信息

From the Department of Biostatistics, Johns Hopkins University, Baltimore, Maryland.

出版信息

Psychosom Med. 2015 Feb-Mar;77(2):114-25. doi: 10.1097/PSY.0000000000000148.

Abstract

OBJECTIVE

The need for appropriate multiple comparisons correction when performing statistical inference is not a new problem. However, it has come to the forefront in many new modern data-intensive disciplines. For example, researchers in areas such as imaging and genetics are routinely required to simultaneously perform thousands of statistical tests. Ignoring this multiplicity can cause severe problems with false positives, thereby introducing nonreproducible results into the literature.

METHODS

This article serves as an introduction to hypothesis testing and multiple comparisons for practical research applications, with a particular focus on its use in the analysis of functional magnetic resonance imaging data.

RESULTS

We discuss hypothesis testing and a variety of principled techniques for correcting for multiple tests. We also illustrate potential pitfalls problems that can occur if the multiple comparisons issue is not dealt with properly. We conclude, by discussing effect size estimation, an issue often linked with the multiple comparisons problem.

CONCLUSIONS

Failure to properly account for multiple comparisons will ultimately lead to heightened risks for false positives and erroneous conclusions.

摘要

目的

在进行统计推断时,需要进行适当的多重比较校正并非一个新问题。然而,它在许多新的现代数据密集型学科中已成为前沿问题。例如,成像和遗传学等领域的研究人员经常需要同时进行数千次统计检验。忽略这种多重性会导致严重的假阳性问题,从而将不可重复的结果引入文献中。

方法

本文作为假设检验和多重比较在实际研究应用中的介绍,特别关注其在功能磁共振成像数据分析中的应用。

结果

我们讨论假设检验以及多种用于校正多重检验的原则性技术。我们还说明了如果多重比较问题处理不当可能出现的潜在陷阱问题。通过讨论效应量估计,我们得出结论,效应量估计是一个经常与多重比较问题相关联的问题。

结论

未能正确考虑多重比较最终将导致假阳性和错误结论的风险增加。

相似文献

1
Zen and the art of multiple comparisons.
Psychosom Med. 2015 Feb-Mar;77(2):114-25. doi: 10.1097/PSY.0000000000000148.
2
The principled control of false positives in neuroimaging.
Soc Cogn Affect Neurosci. 2009 Dec;4(4):417-22. doi: 10.1093/scan/nsp053.
3
Statistical practices: the seven deadly sins.
Child Neuropsychol. 2003 Sep;9(3):221-33. doi: 10.1076/chin.9.3.221.16455.
4
Strategies in adjusting for multiple comparisons: A primer for pediatric surgeons.
J Pediatr Surg. 2020 Sep;55(9):1699-1705. doi: 10.1016/j.jpedsurg.2020.01.003. Epub 2020 Jan 23.
5
Multiple comparisons: philosophies and illustrations.
Am J Physiol Regul Integr Comp Physiol. 2000 Jul;279(1):R1-8. doi: 10.1152/ajpregu.2000.279.1.R1.
7
A comparison of multiple testing adjustment methods with block-correlation positively-dependent tests.
PLoS One. 2017 Apr 28;12(4):e0176124. doi: 10.1371/journal.pone.0176124. eCollection 2017.
8
Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates.
Proc Natl Acad Sci U S A. 2016 Jul 12;113(28):7900-5. doi: 10.1073/pnas.1602413113. Epub 2016 Jun 28.
9
Scientific rigour in psycho-oncology trials: why and how to avoid common statistical errors.
Psychooncology. 2013 Mar;22(3):499-505. doi: 10.1002/pon.3046. Epub 2012 Feb 7.
10
MultipleTesting.com: A tool for life science researchers for multiple hypothesis testing correction.
PLoS One. 2021 Jun 9;16(6):e0245824. doi: 10.1371/journal.pone.0245824. eCollection 2021.

引用本文的文献

2
Neural correlates of approach-avoidance tendencies toward physical activity and sedentary stimuli: An MRI study.
Imaging Neurosci (Camb). 2025 Jun 6;3. doi: 10.1162/IMAG.a.28. eCollection 2025.
3
Dopamine alters functional gradients in Parkinson's disease.
Imaging Neurosci (Camb). 2025 May 6;3. doi: 10.1162/imag_a_00564. eCollection 2025.
4
Altered striatal functional gradients in obsessive-compulsive disorder.
medRxiv. 2025 Jul 16:2025.07.15.25331605. doi: 10.1101/2025.07.15.25331605.
5
Dimensions of music use motivations: Genetic and environmental underpinnings, and associations with Big Five and Empathy traits.
PLoS One. 2025 Aug 8;20(8):e0329808. doi: 10.1371/journal.pone.0329808. eCollection 2025.
6
fNIRS reproducibility varies with data quality, analysis pipelines, and researcher experience.
Commun Biol. 2025 Aug 4;8(1):1149. doi: 10.1038/s42003-025-08412-1.
7
The diagnostic potential of resting state functional MRI: Statistical concerns.
Neuroimage. 2025 Aug 15;317:121334. doi: 10.1016/j.neuroimage.2025.121334. Epub 2025 Jun 17.
8
Image analysis research in neuroradiology: bridging clinical and technical domains.
Neuroradiology. 2025 May 28. doi: 10.1007/s00234-025-03633-x.
9
Whole-body networks: a holistic approach for studying aging.
Geroscience. 2025 Jan 29. doi: 10.1007/s11357-025-01540-w.

本文引用的文献

1
Correlations and Multiple Comparisons in Functional Imaging: A Statistical Perspective (Commentary on Vul et al., 2009).
Perspect Psychol Sci. 2009 May;4(3):310-3. doi: 10.1111/j.1745-6924.2009.01130.x.
2
Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition.
Perspect Psychol Sci. 2009 May;4(3):274-90. doi: 10.1111/j.1745-6924.2009.01125.x.
3
Cluster-extent based thresholding in fMRI analyses: pitfalls and recommendations.
Neuroimage. 2014 May 1;91:412-9. doi: 10.1016/j.neuroimage.2013.12.058. Epub 2014 Jan 8.
4
Power failure: why small sample size undermines the reliability of neuroscience.
Nat Rev Neurosci. 2013 May;14(5):365-76. doi: 10.1038/nrn3475. Epub 2013 Apr 10.
5
Estimating and testing variance components in a multi-level GLM.
Neuroimage. 2012 Jan 2;59(1):490-501. doi: 10.1016/j.neuroimage.2011.07.077. Epub 2011 Jul 31.
6
Everything you never wanted to know about circular analysis, but were afraid to ask.
J Cereb Blood Flow Metab. 2010 Sep;30(9):1551-7. doi: 10.1038/jcbfm.2010.86. Epub 2010 Jun 23.
7
Circular analysis in systems neuroscience: the dangers of double dipping.
Nat Neurosci. 2009 May;12(5):535-40. doi: 10.1038/nn.2303.
8
Meta-analysis of functional neuroimaging data: current and future directions.
Soc Cogn Affect Neurosci. 2007 Jun;2(2):150-8. doi: 10.1093/scan/nsm015.
9
Why most published research findings are false.
PLoS Med. 2005 Aug;2(8):e124. doi: 10.1371/journal.pmed.0020124. Epub 2005 Aug 30.
10
Unified univariate and multivariate random field theory.
Neuroimage. 2004;23 Suppl 1:S189-95. doi: 10.1016/j.neuroimage.2004.07.026.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验