Cai Jing, Hadjinicolaou Alex E, Paulk Angelique C, Soper Daniel J, Xia Tian, Wang Alexander F, Rolston John D, Richardson R Mark, Williams Ziv M, Cash Sydney S
Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
Nat Commun. 2025 Apr 9;16(1):3376. doi: 10.1038/s41467-025-58620-w.
Through conversation, humans engage in a complex process of alternating speech production and comprehension to communicate. The neural mechanisms that underlie these complementary processes through which information is precisely conveyed by language, however, remain poorly understood. Here, we used pre-trained deep learning natural language processing models in combination with intracranial neuronal recordings to discover neural signals that reliably reflected speech production, comprehension, and their transitions during natural conversation between individuals. Our findings indicate that the neural activities that reflected speech production and comprehension were broadly distributed throughout frontotemporal areas across multiple frequency bands. We also find that these activities were specific to the words and sentences being conveyed and that they were dependent on the word's specific context and order. Finally, we demonstrate that these neural patterns partially overlapped during language production and comprehension and that listener-speaker transitions were associated with specific, time-aligned changes in neural activity. Collectively, our findings reveal a dynamical organization of neural activities that subserve language production and comprehension during natural conversation and harness the use of deep learning models in understanding the neural mechanisms underlying human language.
通过对话,人类参与了一个复杂的过程,即交替进行言语产生和理解以实现交流。然而,语言通过这些互补过程精确传达信息背后的神经机制仍知之甚少。在这里,我们使用预训练的深度学习自然语言处理模型结合颅内神经元记录,以发现能可靠反映言语产生、理解以及个体间自然对话中它们的转换的神经信号。我们的研究结果表明,反映言语产生和理解的神经活动广泛分布于多个频段的额颞叶区域。我们还发现这些活动特定于所传达的单词和句子,并且它们依赖于单词的特定语境和顺序。最后,我们证明这些神经模式在语言产生和理解过程中部分重叠,并且听者 - 说者的转换与神经活动中特定的、时间对齐的变化相关。总体而言,我们的研究结果揭示了在自然对话中服务于语言产生和理解的神经活动的动态组织,并利用深度学习模型来理解人类语言背后的神经机制。