注视说话者的眼睛可以提供足够的视觉信息来调节早期听觉处理。
Fixating the eyes of a speaker provides sufficient visual information to modulate early auditory processing.
机构信息
Department of Psychological and Brain Sciences, University of Massachusetts, 135 Hicks Way, Amherst, MA, 01003, USA.
Department of Psychological and Brain Sciences, University of Massachusetts, 135 Hicks Way, Amherst, MA, 01003, USA.
出版信息
Biol Psychol. 2019 Sep;146:107724. doi: 10.1016/j.biopsycho.2019.107724. Epub 2019 Jul 16.
In face-to-face conversations, when listeners process and combine information obtained from hearing and seeing a speaker, they mostly look at the eyes rather than at the more informative mouth region. Measuring event-related potentials, we tested whether fixating the speaker's eyes is sufficient for gathering enough visual speech information to modulate early auditory processing, or whether covert attention to the speaker's mouth is needed. Results showed that when listeners fixated the eye region of the speaker, the amplitudes of the auditory evoked N1 and P2 were reduced when listeners heard and saw the speaker than when they only heard her. These cross-modal interactions also occurred when, in addition, attention was restricted to the speaker's eye region. Fixating the speaker's eyes thus provides listeners with sufficient visual information to facilitate early auditory processing. The spread of covert attention to the mouth area is not needed to observe audiovisual interactions.
在面对面的对话中，当听者处理和组合从听到和看到说话者那里获得的信息时，他们大多会注视眼睛，而不是更具信息量的嘴部区域。通过测量事件相关电位，我们测试了注视说话者的眼睛是否足以获取足够的视觉言语信息来调节早期听觉处理，还是需要将注意力隐藏在说话者的嘴部。结果表明，当听者注视说话者的眼部区域时，当听者听到并看到说话者时，他们的听觉诱发 N1 和 P2 的幅度比仅听到说话者时要小。当注意力也仅限于说话者的眼部区域时，这些跨模态相互作用也会发生。因此，注视说话者的眼睛为听者提供了足够的视觉信息，从而有助于早期的听觉处理。将注意力隐藏地转移到嘴部区域不需要观察视听交互。
Zotero 插件