Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom.
J Neurosci. 2021 Aug 18;41(33):7065-7075. doi: 10.1523/JNEUROSCI.2980-20.2021. Epub 2021 Jul 14.
At any given moment our sensory systems receive multiple, often rhythmic, inputs from the environment. Processing of temporally structured events in one sensory modality can guide both behavioral and neural processing of events in other sensory modalities, but whether this occurs remains unclear. Here, we used human electroencephalography (EEG) to test the cross-modal influences of a continuous auditory frequency-modulated (FM) sound on visual perception and visual cortical activity. We report systematic fluctuations in perceptual discrimination of brief visual stimuli in line with the phase of the FM-sound. We further show that this rhythmic modulation in visual perception is related to an accompanying rhythmic modulation of neural activity recorded over visual areas. Importantly, in our task, perceptual and neural visual modulations occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. As such, the results provide a critical validation for the existence and functional role of cross-modal entrainment and demonstrates its utility for organizing the perception of multisensory stimulation in the natural environment. Our sensory environment is filled with rhythmic structures that are often multi-sensory in nature. Here, we show that the alignment of neural activity to the phase of an auditory frequency-modulated (FM) sound has cross-modal consequences for vision: yielding systematic fluctuations in perceptual discrimination of brief visual stimuli that are mediated by accompanying rhythmic modulation of neural activity recorded over visual areas. These cross-modal effects on visual neural activity and perception occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. The current work shows that continuous auditory fluctuations in the natural environment can provide a pacing signal for neural activity and perception across the senses.
在任何给定的时刻,我们的感觉系统都会从环境中接收到多个、通常是有节奏的输入。对一种感觉模态中时间结构事件的处理可以指导其他感觉模态中事件的行为和神经处理,但这种情况是否发生尚不清楚。在这里,我们使用人类脑电图(EEG)来测试连续听觉调频(FM)声音对视觉感知和视觉皮层活动的跨感觉影响。我们报告了与 FM 声音相位一致的短暂视觉刺激的感知辨别系统波动。我们进一步表明,这种视觉感知中的节律调制与视觉区域记录的神经活动的伴随节律调制有关。重要的是,在我们的任务中,感知和神经视觉调制发生在听觉刺激的能量没有任何突然和明显的开始,并且视觉刺激没有任何节律结构的情况下。因此,这些结果为跨感觉的同步存在和功能作用提供了关键验证,并证明了其在组织自然环境中多感觉刺激感知方面的效用。我们的感觉环境充满了有节奏的结构,这些结构通常是多感官的。在这里,我们表明,听觉调频(FM)声音相位的神经活动对准对视觉具有跨感觉的后果:产生对短暂视觉刺激的感知辨别系统波动,这是由视觉区域记录的伴随节律调制介导的。这些跨模态对视觉神经活动和感知的影响发生在听觉刺激的能量没有任何突然和明显的开始,并且视觉刺激没有任何节律结构的情况下。目前的工作表明,自然环境中连续的听觉波动可以为跨感觉的神经活动和感知提供一个节奏信号。