Yan Dongyang, Seki Ayumi
Graduate School of Education, Hokkaido University, Sapporo, Japan.
Faculty of Education, Hokkaido University, Sapporo, Japan.
Eur J Neurosci. 2024 Dec;60(11):6720-6733. doi: 10.1111/ejn.16563. Epub 2024 Oct 29.
The integration of visual letters and speech sounds is a crucial part of learning to read. Previous studies investigating this integration have revealed a modulation by audiovisual (AV) congruency, commonly known as the congruency effect. To investigate the cortical oscillations of the congruency effects across different oscillatory frequency bands, we conducted a Japanese priming task in which a visual letter was followed by a speech sound. We analyzed the power and phase properties of oscillatory activities in the theta and beta bands between congruent and incongruent letter-speech sound (L-SS) pairs. Our results revealed stronger theta-band (5-7 Hz) power in the congruent condition and cross-modal phase resetting within the auditory cortex, accompanied by enhanced inter-trial phase coherence (ITPC) in the auditory-related areas in response to the congruent condition. The observed congruency effect of theta-band power may reflect increased neural activities in the left auditory region during L-SS integration. Additionally, theta ITPC findings suggest that visual letters amplify neuronal responses to the following corresponding auditory stimulus, which may reflect the differential cross-modal influences in the primary auditory cortex. In contrast, decreased beta-band (20-35 Hz) oscillatory power was observed in the right centroparietal regions for the congruent condition. The reduced beta power seems to be unrelated to the processing of AV integration, but may be interpreted as the brain response to predicting auditory sounds during language processing. Our data provide valuable insights by indicating that oscillations in different frequency bands contribute to the disparate aspects of L-SS integration.
视觉字母与语音的整合是学习阅读的关键部分。以往研究这一整合过程的实验揭示了视听(AV)一致性的调节作用,即通常所说的一致性效应。为了研究不同振荡频段一致性效应的皮层振荡情况,我们进行了一项日语启动任务,其中视觉字母后接语音。我们分析了一致和不一致的字母 - 语音(L - SS)对之间θ和β频段振荡活动的功率和相位特性。我们的结果显示,在一致条件下θ频段(5 - 7Hz)功率更强,且听觉皮层内存在跨模态相位重置,同时在听觉相关区域,对一致条件的反应试验间相位相干性(ITPC)增强。观察到的θ频段功率的一致性效应可能反映了L - SS整合过程中左听觉区域神经活动的增加。此外,θ频段ITPC的结果表明,视觉字母增强了神经元对后续相应听觉刺激的反应,这可能反映了初级听觉皮层中不同的跨模态影响。相比之下,在一致条件下,右侧中央顶叶区域观察到β频段(20 - 35Hz)振荡功率降低。β功率的降低似乎与AV整合的处理无关,但可能被解释为语言处理过程中大脑对预测听觉声音的反应。我们的数据通过表明不同频段的振荡对L - SS整合的不同方面有贡献,提供了有价值的见解。