Ivanova Anna A, Mineroff Zachary, Zimmerer Vitor, Kanwisher Nancy, Varley Rosemary, Fedorenko Evelina
Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
Neurobiol Lang (Camb). 2021 Mar 17;2(2):176-201. doi: 10.1162/nol_a_00030. eCollection 2021.
The ability to combine individual concepts of objects, properties, and actions into complex representations of the world is often associated with language. Yet combinatorial event-level representations can also be constructed from nonverbal input, such as visual scenes. Here, we test whether the language network in the human brain is involved in and necessary for semantic processing of events presented nonverbally. In Experiment 1, we scanned participants with fMRI while they performed a semantic plausibility judgment task versus a difficult perceptual control task on sentences and line drawings that describe/depict simple agent-patient interactions. We found that the language network responded robustly during the semantic task performed on both sentences and pictures (although its response to sentences was stronger). Thus, language regions in healthy adults are engaged during a semantic task performed on pictorial depictions of events. But is this engagement necessary? In Experiment 2, we tested two individuals with global aphasia, who have sustained massive damage to perisylvian language areas and display severe language difficulties, against a group of age-matched control participants. Individuals with aphasia were severely impaired on the task of matching sentences to pictures. However, they performed close to controls in assessing the plausibility of pictorial depictions of agent-patient interactions. Overall, our results indicate that the left frontotemporal language network is recruited but not necessary for semantic processing of nonverbally presented events.
将关于物体、属性和动作的个体概念组合成复杂的世界表征的能力通常与语言相关联。然而,组合性事件层面的表征也可以从非语言输入(如视觉场景)中构建。在此,我们测试人类大脑中的语言网络是否参与非语言呈现事件的语义处理以及该处理是否需要语言网络。在实验1中,我们使用功能磁共振成像(fMRI)对参与者进行扫描,同时他们对描述/描绘简单施动者 - 受动者互动的句子和线条图执行语义合理性判断任务与一项困难的知觉控制任务。我们发现,在对句子和图片执行语义任务期间,语言网络都有强烈反应(尽管其对句子的反应更强)。因此,健康成年人的语言区域在对事件的图片描绘执行语义任务时会被激活。但这种激活是必要的吗?在实验2中,我们对两名患有全球性失语症的个体进行测试,他们的周缘语言区域遭受了大面积损伤并表现出严重的语言困难,同时测试了一组年龄匹配的对照参与者。失语症患者在将句子与图片匹配的任务上严重受损。然而,在评估施动者 - 受动者互动的图片描绘的合理性方面,他们的表现与对照组接近。总体而言,我们的结果表明,左额颞叶语言网络会被调用,但对于非语言呈现事件的语义处理并非必需。