Leibniz Research Centre for Working Environment and Human Factors at the Technical University of Dortmund (IfADo), Ardeystraße 67, Dortmund D-44139, Germany.
Leibniz Research Centre for Working Environment and Human Factors at the Technical University of Dortmund (IfADo), Ardeystraße 67, Dortmund D-44139, Germany.
Hear Res. 2022 Dec;426:108636. doi: 10.1016/j.heares.2022.108636. Epub 2022 Oct 23.
The comprehension of spoken language benefits from visual speech information. One reason for this is the temporal lead of mouth and lip movements over the onset of acoustic speech utterance. Here, we investigated EEG event-related potentials preceding acoustic speech, focusing on a fronto-central contingent negative variation (CNV) prior to the onset of acoustic speech. We explored influences of expectation and visual speech content as well as age-related differences. In a multi-talker two-alternative speech discrimination task, younger and older subjects responded to short words presented simultaneously to competing speech under free-field conditions. Subjects were always presented with audiovisual speech stimuli, while the modality containing the task-relevant information was modulated in a block-wise fashion. Thus, task-relevant speech information was either available as audio-visually congruent stimuli or only in the visual (visual-valid) or the auditory (auditory-valid) modality. Subjects were instructed to fixate a pre-specified position in the left or right hemispace. In each task block, task-relevant stimuli appeared either at the pre-specified position (standard trials, 80%) or at a rare deviant position (20%). Target words were recognized faster and more accurately when visual speech information was available. The CNV prior to the acoustic speech onset was more pronounced with visual-informative than with visually non-informative speech. Especially in the younger group, a less pronounced CNV occurred with purely visual speech in deviant trials, that is, when a task-irrelevant speech stimulus appeared instead of the expected target stimulus. The results indicate that processes preceding the onset of acoustic speech are modulated by expectations and visual speech content, while age differences are rather small.
口语理解得益于视觉语音信息。原因之一是口部和唇部运动的时间领先于语音发声的起始。在这里,我们研究了在语音起始之前的 EEG 事件相关电位,重点关注在语音起始之前出现的额中央伴随负变(CNV)。我们探索了预期和视觉语音内容的影响以及与年龄相关的差异。在多说话人二选一语音辨别任务中,年轻和年长的被试者在自由场条件下对同时呈现的竞争语音中的短词做出反应。被试者始终呈现视听语音刺激,而包含任务相关信息的模态以块方式进行调制。因此,任务相关的语音信息以视听一致的刺激或以视觉(视觉有效)或听觉(听觉有效)模态的形式提供。被试者被指示注视左或右半空间中的指定位置。在每个任务块中,任务相关的刺激要么出现在指定位置(标准试验,80%),要么出现在罕见的偏差位置(20%)。当视觉语音信息可用时,目标词的识别更快且更准确。与视觉非信息性语音相比,视觉信息性语音在语音起始之前的 CNV 更为明显。特别是在年轻组中,在偏差试验中,即当出现与预期目标刺激无关的语音刺激而不是预期目标刺激时,仅出现视觉语音时的 CNV 不太明显。结果表明,在语音起始之前的过程受到预期和视觉语音内容的调节,而年龄差异则相对较小。