Department of Neurology,
Center for Neurological Disorders.
J Neurosci. 2018 Nov 7;38(45):9679-9688. doi: 10.1523/JNEUROSCI.3650-17.2018. Epub 2018 Sep 24.
Observing mouth movements has strikingly effects on the perception of speech. Any mismatch between sound and mouth movements will result in listeners perceiving illusory consonants (McGurk effect), whereas matching mouth movements assist with the correct recognition of speech sounds. Recent neuroimaging studies have yielded evidence that the motor areas are involved in speech processing, yet their contributions to multisensory illusion remain unclear. Using functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS) in an event-related design, we aimed to identify the functional roles of the motor network in the occurrence of multisensory illusion in female and male brains. fMRI showed bilateral activation of the inferior frontal gyrus (IFG) in audiovisually incongruent trials. Activity in the left IFG was negatively correlated with occurrence of the McGurk effect. The effective connectivity between the left IFG and the bilateral precentral gyri was stronger in incongruent than in congruent trials. The McGurk effect was reduced in incongruent trials by applying single-pulse TMS to motor cortex (M1) lip areas, indicating that TMS facilitates the left IFG-precentral motor network to reduce the McGurk effect. TMS of the M1 lip areas was effective in reducing the McGurk effect within the specific temporal range from 100 ms before to 200 ms after the auditory onset, and TMS of the M1 foot area did not influence the McGurk effect, suggesting topographical specificity. These results provide direct evidence that the motor network makes specific temporal and topographical contributions to the processing of multisensory integration of speech to avoid illusion. The human motor network, including the inferior frontal gyrus and primary motor cortex lip area, appears to be involved in speech perception, but the functional contribution to the McGurk effect is unknown. Functional magnetic resonance imaging revealed that activity in these areas of the motor network increased when the audiovisual stimuli were incongruent, and that the increased activity was negatively correlated with perception of the McGurk effect. Furthermore, applying transcranial magnetic stimulation to the motor areas reduced the McGurk effect. These two observations provide evidence that the motor network contributes to the avoidance of multisensory illusory perception.
观察口部运动对言语感知有显著影响。任何声音和口部运动之间的不匹配都会导致听众感知到幻觉辅音(麦格克效应),而匹配的口部运动有助于正确识别语音。最近的神经影像学研究表明,运动区域参与了言语处理,但它们对口部运动多感觉错觉的贡献尚不清楚。我们使用事件相关设计的功能磁共振成像(fMRI)和经颅磁刺激(TMS),旨在确定运动网络在女性和男性大脑中多感觉错觉发生中的功能作用。fMRI 显示在视听不一致试验中双侧额下回(IFG)激活。左 IFG 的活动与麦格克效应的发生呈负相关。在不一致试验中,左 IFG 与双侧中央前回之间的有效连接比在一致试验中更强。在应用单脉冲 TMS 到运动皮层(M1)唇区的情况下,在不一致试验中麦格克效应减小,表明 TMS 促进左 IFG-中央前运动网络以减小麦格克效应。在听觉起始前 100 毫秒至后 200 毫秒的特定时间范围内,M1 唇区的 TMS 对麦格克效应的抑制作用有效,而 M1 足部区的 TMS 对麦格克效应没有影响,提示具有空间特异性。这些结果提供了直接证据,表明运动网络对言语多感觉整合处理做出了特定的时间和空间贡献,以避免错觉。人类运动网络,包括额下回和初级运动皮层唇区,似乎参与言语感知,但对麦格克效应的功能贡献尚不清楚。功能磁共振成像显示,当视听刺激不一致时,运动网络这些区域的活动增加,并且增加的活动与麦格克效应的感知呈负相关。此外,应用经颅磁刺激到运动区可减小麦格克效应。这两个观察结果提供了证据,表明运动网络有助于避免多感觉错觉感知。