Donders Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, The Netherlands.
Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands.
Nat Commun. 2024 Oct 14;15(1):8850. doi: 10.1038/s41467-024-53128-1.
Humans excel at extracting structurally-determined meaning from speech despite inherent physical variability. This study explores the brain's ability to predict and understand spoken language robustly. It investigates the relationship between structural and statistical language knowledge in brain dynamics, focusing on phase and amplitude modulation. Using syntactic features from constituent hierarchies and surface statistics from a transformer model as predictors of forward encoding models, we reconstructed cross-frequency neural dynamics from MEG data during audiobook listening. Our findings challenge a strict separation of linguistic structure and statistics in the brain, with both aiding neural signal reconstruction. Syntactic features have a more temporally spread impact, and both word entropy and the number of closing syntactic constituents are linked to the phase-amplitude coupling of neural dynamics, implying a role in temporal prediction and cortical oscillation alignment during speech processing. Our results indicate that structured and statistical information jointly shape neural dynamics during spoken language comprehension and suggest an integration process via a cross-frequency coupling mechanism.
人类在从言语中提取结构决定的意义方面表现出色,尽管存在固有的物理可变性。本研究探索了大脑强大的预测和理解口语的能力。它研究了结构和统计语言知识在大脑动力学中的关系,重点是相位和幅度调制。使用来自成分层次结构的句法特征和来自转换器模型的表面统计信息作为前向编码模型的预测因子,我们从 MEG 数据中重建了在听有声读物时的跨频神经动力学。我们的发现挑战了大脑中语言结构和统计的严格分离,两者都有助于神经信号的重建。句法特征具有更分散的时间影响,并且词熵和闭合句法成分的数量都与神经动力学的相位-幅度耦合相关,这表明在言语处理过程中在时间预测和皮质振荡对准方面发挥作用。我们的结果表明,在理解口语时,有组织的和统计的信息共同塑造了神经动力学,并通过跨频耦合机制暗示了一种整合过程。