Suppr超能文献

语音特征处理的神经动力学:从声学处理到句子处理的特征递进证据

Neural Dynamics of the Processing of Speech Features: Evidence for a Progression of Features from Acoustic to Sentential Processing.

作者信息

Karunathilake I M Dushyanthi, Brodbeck Christian, Bhattasali Shohini, Resnik Philip, Simon Jonathan Z

机构信息

Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, 20742.

Department of Computing and Software, McMaster University, Hamilton, ON, Canada.

出版信息

bioRxiv. 2024 Dec 10:2024.02.02.578603. doi: 10.1101/2024.02.02.578603.

Abstract

When we listen to speech, our brain's neurophysiological responses "track" its acoustic features, but it is less well understood how these auditory responses are enhanced by linguistic content. Here, we recorded magnetoencephalography (MEG) responses while subjects listened to four types of continuous-speech-like passages: speech-envelope modulated noise, English-like non-words, scrambled words, and a narrative passage. Temporal response function (TRF) analysis provides strong neural evidence for the emergent features of speech processing in cortex, from acoustics to higher-level linguistics, as incremental steps in neural speech processing. Critically, we show a stepwise hierarchical progression of progressively higher order features over time, reflected in both bottom-up (early) and top-down (late) processing stages. Linguistically driven top-down mechanisms take the form of late N400-like responses, suggesting a central role of predictive coding mechanisms at multiple levels. As expected, the neural processing of lower-level acoustic feature responses is bilateral or right lateralized, with left lateralization emerging only for lexical-semantic features. Finally, our results identify potential neural markers, linguistic level late responses, derived from TRF components modulated by linguistic content, suggesting that these markers are indicative of speech rather than mere speech perception.

摘要

当我们听言语时,大脑的神经生理反应会“追踪”其声学特征,但对于这些听觉反应如何通过语言内容得到增强,我们的了解还比较少。在这里,我们在受试者聆听四种类似连续言语的段落时记录了脑磁图(MEG)反应:言语包络调制噪声、类似英语的非词、打乱顺序的词以及一篇叙述性段落。时间响应函数(TRF)分析为皮质中言语处理的新兴特征提供了有力的神经证据,从声学特征到高级语言学特征,这些特征是神经言语处理中的渐进步骤。至关重要的是,我们展示了随着时间推移逐渐出现的更高阶特征的逐步分层进展,这在自下而上(早期)和自上而下(晚期)的处理阶段均有体现。语言驱动的自上而下机制表现为类似晚期N400的反应,这表明预测编码机制在多个层面发挥着核心作用。正如预期的那样,较低级声学特征反应的神经处理是双侧的或右侧化的,只有词汇语义特征的处理会出现左侧化。最后,我们的研究结果确定了潜在的神经标记,即由语言内容调制的TRF成分所产生的语言水平晚期反应,这表明这些标记指示的是言语,而不仅仅是言语感知。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/da54/11639312/f825974edb42/nihpp-2024.02.02.578603v2-f0007.jpg

相似文献

4
Neural source dynamics of brain responses to continuous stimuli: Speech processing from acoustics to comprehension.
Neuroimage. 2018 May 15;172:162-174. doi: 10.1016/j.neuroimage.2018.01.042. Epub 2018 Feb 3.
5
Leading and following: Noise differently affects semantic and acoustic processing during naturalistic speech comprehension.
Neuroimage. 2023 Nov 15;282:120404. doi: 10.1016/j.neuroimage.2023.120404. Epub 2023 Oct 6.
6
Neural tracking measures of speech intelligibility: Manipulating intelligibility while keeping acoustics unchanged.
Proc Natl Acad Sci U S A. 2023 Dec 5;120(49):e2309166120. doi: 10.1073/pnas.2309166120. Epub 2023 Nov 30.
7
Neural tracking of linguistic and acoustic speech representations decreases with advancing age.
Neuroimage. 2023 Feb 15;267:119841. doi: 10.1016/j.neuroimage.2022.119841. Epub 2022 Dec 28.
10
Linguistic Structure and Meaning Organize Neural Oscillations into a Content-Specific Hierarchy.
J Neurosci. 2020 Dec 2;40(49):9467-9475. doi: 10.1523/JNEUROSCI.0302-20.2020. Epub 2020 Oct 23.

本文引用的文献

1
A predictive coding model of the N400.
Cognition. 2024 May;246:105755. doi: 10.1016/j.cognition.2024.105755. Epub 2024 Feb 29.
2
Neural tracking measures of speech intelligibility: Manipulating intelligibility while keeping acoustics unchanged.
Proc Natl Acad Sci U S A. 2023 Dec 5;120(49):e2309166120. doi: 10.1073/pnas.2309166120. Epub 2023 Nov 30.
6
Auditory Word Comprehension Is Less Incremental in Isolated Words.
Neurobiol Lang (Camb). 2023 Jan 18;4(1):29-52. doi: 10.1162/nol_a_00084. eCollection 2023.
7
Delta-Band Neural Responses to Individual Words Are Modulated by Sentence Processing.
J Neurosci. 2023 Jun 28;43(26):4867-4883. doi: 10.1523/JNEUROSCI.0964-22.2023. Epub 2023 May 23.
8
Lexical Frequency and Sentence Context Influence the Brain's Response to Single Words.
Neurobiol Lang (Camb). 2022 Feb 10;3(1):149-179. doi: 10.1162/nol_a_00054. eCollection 2022.
9
Semantic Representations during Language Comprehension Are Affected by Context.
J Neurosci. 2023 Apr 26;43(17):3144-3158. doi: 10.1523/JNEUROSCI.2459-21.2023. Epub 2023 Mar 27.
10
Joint, distributed and hierarchically organized encoding of linguistic features in the human auditory cortex.
Nat Hum Behav. 2023 May;7(5):740-753. doi: 10.1038/s41562-023-01520-0. Epub 2023 Mar 2.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验