Leibniz Research Centre for Working Environment and Human Factors, TU Dortmund, Germany.
Leibniz Research Centre for Working Environment and Human Factors, TU Dortmund, Germany.
Behav Brain Res. 2021 Aug 27;412:113436. doi: 10.1016/j.bbr.2021.113436. Epub 2021 Jun 24.
In natural conversations, visible mouth and lip movements play an important role in speech comprehension. There is evidence that visual speech information improves speech comprehension, especially for older adults and under difficult listening conditions. However, the neurocognitive basis is still poorly understood. The present EEG experiment investigated the benefits of audiovisual speech in a dynamic cocktail-party scenario with 22 (aged 20-34 years) younger and 20 (aged 55-74 years) older participants. We presented three simultaneously talking faces with a varying amount of visual speech input (still faces, visually unspecific and audiovisually congruent). In a two-alternative forced-choice task, participants had to discriminate target words ("yes" or "no") among two distractors (one-digit number words). In half of the experimental blocks, the target was always presented from a central position, in the other half, occasional switches to a lateral position could occur. We investigated behavioral and electrophysiological modulations due to age, location switches and the content of visual information, analyzing response times and accuracy as well as the P1, N1, P2, N2 event-related potentials (ERPs) and the contingent negative variation (CNV) in the EEG. We found that audiovisually congruent speech information improved performance and modulated ERP amplitudes in both age groups, suggesting enhanced preparation and integration of the subsequent auditory input. In the older group, larger amplitude measures were found in early phases of processing (P1-N1). Here, amplitude measures were reduced in response to audiovisually congruent stimuli. In later processing phases (P2-N2) we found decreased amplitude measures in the older group, while an amplitude reduction for audiovisually congruent compared to visually unspecific stimuli was still observable. However, these benefits were only observed as long as no location switches occurred, leading to enhanced amplitude measures in later processing phases (P2-N2). To conclude, meaningful visual information in a multi-talker setting, when presented from the expected location, is shown to be beneficial for both younger and older adults.
在自然对话中,可见的口部和唇部运动在言语理解中起着重要作用。有证据表明,视觉言语信息可以提高言语理解能力,尤其是对老年人和在困难的听力条件下。然而,其神经认知基础仍知之甚少。本 EEG 实验调查了在具有 22 名(年龄 20-34 岁)年轻参与者和 20 名(年龄 55-74 岁)年长参与者的动态鸡尾酒会场景中视听言语的益处。我们呈现了三个同时说话的人脸,他们的可视言语输入量不同(静止人脸、视觉非特定和视听一致)。在二选一强制选择任务中,参与者必须在两个干扰项(一位数字词)中辨别目标词(“是”或“否”)。在一半的实验块中,目标始终出现在中央位置,另一半偶尔会出现到侧位的切换。我们研究了由于年龄、位置切换和视觉信息内容引起的行为和电生理调制,分析了反应时间和准确性以及 EEG 中的 P1、N1、P2、N2 事件相关电位(ERP)和条件负变(CNV)。我们发现,视听一致的言语信息提高了两个年龄组的表现,并调节了 ERP 幅度,表明对后续听觉输入的增强准备和整合。在老年组中,在处理的早期阶段(P1-N1)发现更大的幅度测量值。在这里,对视听一致的刺激,幅度测量值减小。在稍后的处理阶段(P2-N2),我们发现老年组的幅度测量值减小,而与视觉非特定刺激相比,视听一致刺激的幅度减小仍然可以观察到。然而,这些益处只有在没有位置切换的情况下才会出现,从而在稍后的处理阶段(P2-N2)增强幅度测量值。总之,在多说话者环境中提供有意义的视觉信息,当从预期的位置呈现时,对年轻和年长的成年人都是有益的。