Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland.
Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland.
Neuroimage. 2021 Jan 1;224:117365. doi: 10.1016/j.neuroimage.2020.117365. Epub 2020 Sep 14.
Recent studies utilizing electrophysiological speech envelope reconstruction have sparked renewed interest in the cocktail party effect by showing that auditory neurons entrain to selectively attended speech. Yet, the neural networks of attention to speech in naturalistic audiovisual settings with multiple sound sources remain poorly understood. We collected functional brain imaging data while participants viewed audiovisual video clips of lifelike dialogues with concurrent distracting speech in the background. Dialogues were presented in a full-factorial design, comprising task (listen to the dialogues vs. ignore them), audiovisual quality and semantic predictability. We used univariate analyses in combination with multivariate pattern analysis (MVPA) to study modulations of brain activity related to attentive processing of audiovisual speech. We found attentive speech processing to cause distinct spatiotemporal modulation profiles in distributed cortical areas including sensory and frontal-control networks. Semantic coherence modulated attention-related activation patterns in the earliest stages of auditory cortical processing, suggesting that the auditory cortex is involved in high-level speech processing. Our results corroborate views that emphasize the dynamic nature of attention, with task-specificity and context as cornerstones of the underlying neuro-cognitive mechanisms.
最近利用电生理语音包络重建的研究通过显示听觉神经元对选择性注意的语音进行同步，重新激发了对鸡尾酒会效应的兴趣。然而，在具有多个声源的自然视听环境中，对语音注意力的神经网络仍知之甚少。我们在参与者观看逼真对话的视听视频剪辑时收集了功能大脑成像数据，同时背景中还有干扰性的演讲。对话以全因子设计呈现，包括任务（听对话与忽略它们）、视听质量和语义可预测性。我们使用单变量分析结合多元模式分析（MVPA）来研究与视听语音的注意力处理相关的大脑活动调制。我们发现，注意力语音处理会导致分布式皮质区域（包括感觉和前额控制网络）中独特的时空调制模式。语义连贯性调节了听觉皮质处理早期阶段与注意力相关的激活模式，表明听觉皮质参与了高级语音处理。我们的结果证实了那些强调注意力动态性质的观点，认为任务特异性和上下文是潜在神经认知机制的基石。
