Suppr超能文献

视觉与听觉特征之间的自然跨模态映射。

Natural cross-modal mappings between visual and auditory features.

作者信息

Evans Karla K, Treisman Anne

机构信息

Brigham and Women's Hospital and Harvard Medical School, Cambridge, MA 02139, USA.

出版信息

J Vis. 2010 Jan 12;10(1):6.1-12. doi: 10.1167/10.1.6.

Abstract

The brain may combine information from different sense modalities to enhance the speed and accuracy of detection of objects and events, and the choice of appropriate responses. There is mounting evidence that perceptual experiences that appear to be modality-specific are also influenced by activity from other sensory modalities, even in the absence of awareness of this interaction. In a series of speeded classification tasks, we found spontaneous mappings between the auditory feature of pitch and the visual features of vertical location, size, and spatial frequency but not contrast. By dissociating the task variables from the features that were cross-modally related, we find that the interactions happen in an automatic fashion and are possibly located at the perceptual level.

摘要

大脑可能会整合来自不同感觉模态的信息,以提高检测物体和事件的速度与准确性,以及做出适当反应的能力。越来越多的证据表明,看似特定于某种模态的感知体验也会受到来自其他感觉模态活动的影响,即使在没有意识到这种相互作用的情况下也是如此。在一系列快速分类任务中,我们发现音高的听觉特征与垂直位置、大小和空间频率的视觉特征之间存在自发映射,但与对比度无关。通过将任务变量与跨模态相关的特征分离,我们发现这些相互作用以自动方式发生,并且可能位于感知层面。

相似文献

1
Natural cross-modal mappings between visual and auditory features.
J Vis. 2010 Jan 12;10(1):6.1-12. doi: 10.1167/10.1.6.
2
Beyond colour perception: auditory-visual synaesthesia induces experiences of geometric objects in specific locations.
Cortex. 2013 Jun;49(6):1750-63. doi: 10.1016/j.cortex.2012.04.006. Epub 2012 Apr 27.
3
Visual cues release the temporal coherence of auditory objects in auditory scene analysis.
Brain Res. 2009 Dec 1;1300:125-34. doi: 10.1016/j.brainres.2009.08.086. Epub 2009 Sep 9.
4
The co-occurrence of multisensory facilitation and cross-modal conflict in the human brain.
J Neurophysiol. 2011 Dec;106(6):2896-909. doi: 10.1152/jn.00303.2011. Epub 2011 Aug 31.
5
Does cross-modal correspondence modulate modality-specific perceptual processing? Study using timing judgment tasks.
Atten Percept Psychophys. 2024 Jan;86(1):273-284. doi: 10.3758/s13414-023-02812-3. Epub 2023 Nov 6.
6
The Role of Selective Attention in Cross-modal Interactions between Auditory and Visual Features.
Cognition. 2020 Mar;196:104119. doi: 10.1016/j.cognition.2019.104119. Epub 2019 Nov 18.
7
Contributions of pitch and bandwidth to sound-induced enhancement of visual cortex excitability in humans.
Cortex. 2013 Nov-Dec;49(10):2728-34. doi: 10.1016/j.cortex.2013.01.001. Epub 2013 Jan 19.
8
Neural practice effect during cross-modal selective attention: Supra-modal and modality-specific effects.
Cortex. 2018 Sep;106:47-64. doi: 10.1016/j.cortex.2018.05.003. Epub 2018 May 16.
10
Parallel perceptual enhancement and hierarchic relevance evaluation in an audio-visual conjunction task.
Brain Res. 2008 Oct 21;1236:126-39. doi: 10.1016/j.brainres.2008.07.104. Epub 2008 Aug 6.

引用本文的文献

1
Science of music-based citizen science: How seeing influences hearing.
PLoS One. 2025 Sep 10;20(9):e0325019. doi: 10.1371/journal.pone.0325019. eCollection 2025.
2
Augmenting art crossmodally: possibilities and pitfalls.
Front Psychol. 2025 Jul 14;16:1605110. doi: 10.3389/fpsyg.2025.1605110. eCollection 2025.
3
Exploring the effects of audiovisual incongruence on working memory performance in the combined 2-back+ Go/NoGo paradigm.
Front Psychol. 2025 Jun 4;16:1578391. doi: 10.3389/fpsyg.2025.1578391. eCollection 2025.
4
The diatonic sound of scent imagery.
Perception. 2025 Sep;54(9):689-714. doi: 10.1177/03010066251342011. Epub 2025 Jun 3.
5
Development of color learning protocol based on music-color association for people with visual impairment.
Ann Med. 2025 Dec;57(1):2476728. doi: 10.1080/07853890.2025.2476728. Epub 2025 Mar 10.
6
Auditory and tactile frequency mapping for visual distance perception: A step forward in sensory substitution and augmentation.
PLoS One. 2025 Mar 3;20(3):e0318354. doi: 10.1371/journal.pone.0318354. eCollection 2025.
7
Invited reply: Comment on 'Left-right asymmetry of the Maxwell spot centroids in adults without and with dyslexia'.
Proc Biol Sci. 2025 Feb;292(2040):20243036. doi: 10.1098/rspb.2024.3036. Epub 2025 Feb 12.
8
Color and tone color: audiovisual crossmodal correspondences with musical instrument timbre.
Front Psychol. 2025 Jan 7;15:1520131. doi: 10.3389/fpsyg.2024.1520131. eCollection 2024.
10
Crossmodal correspondence of elevation/pitch and size/pitch is driven by real-world features.
Atten Percept Psychophys. 2024 Nov;86(8):2821-2833. doi: 10.3758/s13414-024-02975-7. Epub 2024 Oct 26.

本文引用的文献

2
Multisensory synesthetic interactions in the speeded classification of visual size.
Percept Psychophys. 2006 Oct;68(7):1191-203. doi: 10.3758/bf03193720.
3
Spatial representation of pitch height: the SMARC effect.
Cognition. 2006 Mar;99(2):113-29. doi: 10.1016/j.cognition.2005.01.004. Epub 2005 May 31.
4
Do small white balls squeak? Pitch-object correspondences in young children.
Cogn Affect Behav Neurosci. 2004 Jun;4(2):133-6. doi: 10.3758/cabn.4.2.133.
5
Garner and congruence effects in the speeded classification of bimodal signals.
J Exp Psychol Hum Percept Perform. 2002 Aug;28(4):755-75.
6
Psychophysical investigations into the neural basis of synaesthesia.
Proc Biol Sci. 2001 May 7;268(1470):979-83. doi: 10.1098/rspb.2000.1576.
8
Measuring individual differences in implicit cognition: the implicit association test.
J Pers Soc Psychol. 1998 Jun;74(6):1464-80. doi: 10.1037//0022-3514.74.6.1464.
10
The Psychophysics Toolbox.
Spat Vis. 1997;10(4):433-6.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验