Suppr超能文献

听觉和视觉皮层早期的跨模态相互作用是一种声音诱发视觉错觉的基础。

Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion.

作者信息

Mishra Jyoti, Martinez Antigona, Sejnowski Terrence J, Hillyard Steven A

机构信息

Division of Biological , University of California, San Diego, La Jolla, California 92093, USA.

出版信息

J Neurosci. 2007 Apr 11;27(15):4120-31. doi: 10.1523/JNEUROSCI.4912-06.2007.

Abstract

When a single flash of light is presented interposed between two brief auditory stimuli separated by 60-100 ms, subjects typically report perceiving two flashes (Shams et al., 2000, 2002). We investigated the timing and localization of the cortical processes that underlie this illusory flash effect in 34 subjects by means of 64-channel recordings of event-related potentials (ERPs). A difference ERP calculated to isolate neural activity associated with the illusory second flash revealed an early modulation of visual cortex activity at 30-60 ms after the second sound, which was larger in amplitude in subjects who saw the illusory flash more frequently. These subjects also showed this early modulation in response to other combinations of auditory and visual stimuli, thus pointing to consistent individual differences in the neural connectivity that underlies cross-modal integration. The overall pattern of cortical activity associated with the cross-modally induced illusory flash, however, differed markedly from that evoked by a real second flash. A trial-by-trial analysis showed that short-latency ERP activity localized to auditory cortex and polymodal cortex of the temporal lobe, concurrent with gamma bursts in visual cortex, were associated with perception of the double-flash illusion. These results provide evidence that perception of the illusory second flash is based on a very rapid dynamic interplay between auditory and visual cortical areas that is triggered by the second sound.

摘要

当在间隔60 - 100毫秒的两个短暂听觉刺激之间呈现单个闪光时,受试者通常报告感知到两次闪光(沙姆斯等人,2000年,2002年)。我们通过64通道事件相关电位(ERP)记录,对34名受试者中这种虚幻闪光效应背后的皮层过程的时间和定位进行了研究。为分离与虚幻的第二次闪光相关的神经活动而计算的差异ERP显示,在第二次声音后30 - 60毫秒时视觉皮层活动出现早期调制,在更频繁看到虚幻闪光的受试者中,这种调制的幅度更大。这些受试者在对其他听觉和视觉刺激组合的反应中也表现出这种早期调制,从而表明在跨模态整合基础的神经连接中存在一致的个体差异。然而,与跨模态诱导的虚幻闪光相关的皮层活动总体模式与真实的第二次闪光所诱发的模式明显不同。逐次试验分析表明,定位于颞叶听觉皮层和多模态皮层的短潜伏期ERP活动,与视觉皮层中的伽马暴同时出现,与双闪光错觉的感知相关。这些结果提供了证据,表明对虚幻第二次闪光的感知是基于由第二次声音触发的听觉和视觉皮层区域之间非常快速的动态相互作用。

相似文献

1
Early cross-modal interactions in auditory and visual cortex underlie a sound-induced visual illusion.
J Neurosci. 2007 Apr 11;27(15):4120-31. doi: 10.1523/JNEUROSCI.4912-06.2007.
2
Effect of attention on early cortical processes associated with the sound-induced extra flash illusion.
J Cogn Neurosci. 2010 Aug;22(8):1714-29. doi: 10.1162/jocn.2009.21295.
3
Cortical processes underlying sound-induced flash fusion.
Brain Res. 2008 Nov 25;1242:102-15. doi: 10.1016/j.brainres.2008.05.023. Epub 2008 May 20.
4
Oscillatory Properties of Functional Connections Between Sensory Areas Mediate Cross-Modal Illusory Perception.
J Neurosci. 2019 Jul 17;39(29):5711-5718. doi: 10.1523/JNEUROSCI.3184-18.2019. Epub 2019 May 20.
5
The Dynamic Double Flash Illusion: Auditory Triggered Replay of Illusory Visual Expansion.
Multisens Res. 2020 Jul 1;33(1):87-108. doi: 10.1163/22134808-20191392.
6
Pre- and post-stimulus EEG patterns associated with the touch-induced illusory flash.
Neurosci Lett. 2014 Mar 6;562:79-84. doi: 10.1016/j.neulet.2014.01.010. Epub 2014 Jan 15.
7
Sound-induced illusory flash perception: role of gamma band responses.
Neuroreport. 2002 Oct 7;13(14):1727-30. doi: 10.1097/00001756-200210070-00007.
8
A dynamic fMRI study of illusory double-flash effect on human visual cortex.
Exp Brain Res. 2006 Jun;172(1):57-66. doi: 10.1007/s00221-005-0304-7. Epub 2005 Dec 21.
9
Sound alters visual evoked potentials in humans.
Neuroreport. 2001 Dec 4;12(17):3849-52. doi: 10.1097/00001756-200112040-00049.
10
A neurocomputational analysis of the sound-induced flash illusion.
Neuroimage. 2014 May 15;92:248-66. doi: 10.1016/j.neuroimage.2014.02.001. Epub 2014 Feb 9.

引用本文的文献

1
Assessing the reliability of an online measure of the temporal binding window of audiovisual integration.
Behav Res Methods. 2025 Aug 18;57(9):261. doi: 10.3758/s13428-025-02791-3.
2
Altered multisensory integration in pilots: Examining susceptibility to fission and fusion sound-induced flash illusions.
Iperception. 2025 Aug 6;16(4):20416695251364202. doi: 10.1177/20416695251364202. eCollection 2025 Jul-Aug.
3
Exploring the effects of audiovisual incongruence on working memory performance in the combined 2-back+ Go/NoGo paradigm.
Front Psychol. 2025 Jun 4;16:1578391. doi: 10.3389/fpsyg.2025.1578391. eCollection 2025.
4
The Administration of Ketamine Is Associated with Dose-Dependent Stabilization of Cortical Dynamics in Humans.
J Neurosci. 2025 May 14;45(20):e1545242025. doi: 10.1523/JNEUROSCI.1545-24.2025.
5
The role of beta band phase resetting in audio-visual temporal order judgment.
Cogn Neurodyn. 2025 Dec;19(1):28. doi: 10.1007/s11571-024-10183-0. Epub 2025 Jan 15.
6
Multisensory perceptual and causal inference is largely preserved in medicated post-acute individuals with schizophrenia.
PLoS Biol. 2024 Sep 10;22(9):e3002790. doi: 10.1371/journal.pbio.3002790. eCollection 2024 Sep.
8
Attentional demands in the visual field modulate audiovisual interactions in the temporal domain.
Hum Brain Mapp. 2024 Aug 15;45(12):e70009. doi: 10.1002/hbm.70009.
9
The dissociation of semantically congruent and incongruent cross-modal effects on the visual attentional blink.
Front Neurosci. 2023 Dec 14;17:1295010. doi: 10.3389/fnins.2023.1295010. eCollection 2023.
10
A Study and Analysis of the Relationship between Visual-Auditory Logos and Consumer Behavior.
Behav Sci (Basel). 2023 Jul 24;13(7):613. doi: 10.3390/bs13070613.

本文引用的文献

1
Enhancement of perceived visual intensity by auditory stimuli: a psychophysical analysis.
J Cogn Neurosci. 1996 Nov;8(6):497-506. doi: 10.1162/jocn.1996.8.6.497.
3
What does the illusory-flash look like?
Vision Res. 2008 Jan;48(1):63-9. doi: 10.1016/j.visres.2007.10.010. Epub 2007 Dec 3.
4
Auditory-visual multisensory interactions attenuate subsequent visual responses in humans.
Neuroimage. 2007 Mar;35(1):244-54. doi: 10.1016/j.neuroimage.2006.11.033. Epub 2007 Jan 9.
6
Multisensory interactions within human primary cortices revealed by BOLD dynamics.
Cereb Cortex. 2007 Jul;17(7):1672-9. doi: 10.1093/cercor/bhl077. Epub 2006 Sep 12.
7
Multisensory processing in sensory-specific cortical areas.
Neuroscientist. 2006 Aug;12(4):327-38. doi: 10.1177/1073858406287908.
8
Is neocortex essentially multisensory?
Trends Cogn Sci. 2006 Jun;10(6):278-85. doi: 10.1016/j.tics.2006.04.008. Epub 2006 May 18.
9
Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration?
Cereb Cortex. 2007 Mar;17(3):679-90. doi: 10.1093/cercor/bhk016. Epub 2006 May 17.
10
Neural substrates for dividing and focusing attention between simultaneous auditory and visual events.
Neuroimage. 2006 Jul 15;31(4):1673-81. doi: 10.1016/j.neuroimage.2006.02.026. Epub 2006 Apr 17.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验