Kawase Tetsuaki, Yahata Izumi, Kanno Akitake, Sakamoto Shuichi, Takanashi Yoshitaka, Takata Shiho, Nakasato Nobukazu, Kawashima Ryuta, Katori Yukio
Department of Otolaryngology-Head and Neck Surgery, Tohoku University Graduate School of Medicine, Sendai, Miyagi, Japan.
Laboratory of Rehabilitative Auditory Science, Tohoku University Graduate School of Biomedical Engineering, Sendai, Miyagi, Japan.
PLoS One. 2016 Dec 28;11(12):e0168740. doi: 10.1371/journal.pone.0168740. eCollection 2016.
The effects of asynchrony between audio and visual (A/V) stimuli on the N100m responses of magnetoencephalography in the left hemisphere were compared with those on the psychophysical responses in 11 participants. The latency and amplitude of N100m were significantly shortened and reduced in the left hemisphere by the presentation of visual speech as long as the temporal asynchrony between A/V stimuli was within 100 ms, but were not significantly affected with audio lags of -500 and +500 ms. However, some small effects were still preserved on average with audio lags of 500 ms, suggesting similar asymmetry of the temporal window to that observed in psychophysical measurements, which tended to be more robust (wider) for audio lags; i.e., the pattern of visual-speech effects as a function of A/V lag observed in the N100m in the left hemisphere grossly resembled that in psychophysical measurements on average, although the individual responses were somewhat varied. The present results suggest that the basic configuration of the temporal window of visual effects on auditory-speech perception could be observed from the early auditory processing stage.
在11名参与者中，比较了视听（A/V）刺激异步对左半球脑磁图N100m反应的影响与对心理物理反应的影响。只要A/V刺激之间的时间异步在100毫秒以内，视觉语音的呈现会使左半球N100m的潜伏期和波幅显著缩短和降低，但-500和+500毫秒的音频延迟对其没有显著影响。然而，500毫秒的音频延迟平均仍有一些小的影响，这表明时间窗口的不对称性与心理物理测量中观察到的相似，心理物理测量中音频延迟的时间窗口往往更宽；也就是说，尽管个体反应有所不同，但左半球N100m中观察到的视觉语音效应作为A/V延迟的函数的模式总体上与心理物理测量中的模式相似。目前的结果表明，在早期听觉处理阶段就可以观察到视觉对听觉语音感知影响的时间窗口的基本配置。
