Redcay Elizabeth, Velnoskey Kayla R, Rowe Meredith L
Department of Psychology, University of Maryland, College Park, Maryland.
Graduate School of Education, Harvard University, Cambridge, Massachusetts.
Hum Brain Mapp. 2016 Oct;37(10):3444-61. doi: 10.1002/hbm.23251. Epub 2016 May 30.
Behavioral evidence and theory suggest gesture and language processing may be part of a shared cognitive system for communication. While much research demonstrates both gesture and language recruit regions along perisylvian cortex, relatively less work has tested functional segregation within these regions on an individual level. Additionally, while most work has focused on a shared semantic network, less has examined shared regions for processing communicative intent. To address these questions, functional and structural MRI data were collected from 24 adult participants while viewing videos of an experimenter producing communicative, Participant-Directed Gestures (PDG) (e.g., "Hello, come here"), noncommunicative Self-adaptor Gestures (SG) (e.g., smoothing hair), and three written text conditions: (1) Participant-Directed Sentences (PDS), matched in content to PDG, (2) Third-person Sentences (3PS), describing a character's actions from a third-person perspective, and (3) meaningless sentences, Jabberwocky (JW). Surface-based conjunction and individual functional region of interest analyses identified shared neural activation between gesture (PDGvsSG) and language processing using two different language contrasts. Conjunction analyses of gesture (PDGvsSG) and Third-person Sentences versus Jabberwocky revealed overlap within left anterior and posterior superior temporal sulcus (STS). Conjunction analyses of gesture and Participant-Directed Sentences to Third-person Sentences revealed regions sensitive to communicative intent, including the left middle and posterior STS and left inferior frontal gyrus. Further, parametric modulation using participants' ratings of stimuli revealed sensitivity of left posterior STS to individual perceptions of communicative intent in gesture. These data highlight an important role of the STS in processing participant-directed communicative intent through gesture and language. Hum Brain Mapp 37:3444-3461, 2016. © 2016 Wiley Periodicals, Inc.
行为证据和理论表明,手势和语言处理可能是共享交流认知系统的一部分。虽然大量研究表明,手势和语言均会激活颞周皮质周围区域,但相对较少的研究在个体层面测试这些区域内的功能分离。此外,虽然大多数研究聚焦于共享语义网络,但较少有研究考察处理交流意图的共享区域。为解决这些问题,我们收集了24名成年参与者在观看实验者做出交流性、指向参与者的手势(PDG)(如“你好,过来”)、非交流性自我调整手势(SG)(如捋头发)的视频时的功能和结构MRI数据,以及三种书面文本条件下的数据:(1)指向参与者的句子(PDS),内容与PDG匹配;(2)第三人称句子(3PS),从第三人称视角描述一个角色的行为;(3)无意义句子,《胡说歌》(JW)。基于表面的联合分析和个体感兴趣功能区分析,使用两种不同的语言对比确定了手势(PDG与SG)和语言处理之间的共享神经激活。手势(PDG与SG)与第三人称句子和《胡说歌》的联合分析显示,在左前颞上沟和后颞上沟(STS)内存在重叠。手势与指向参与者的句子和第三人称句子的联合分析揭示了对交流意图敏感的区域,包括左中颞上沟和后颞上沟以及左下额回。此外,使用参与者对刺激的评分进行参数调制,显示左后颞上沟对个体对手势中交流意图的感知敏感。这些数据突出了颞上沟在通过手势和语言处理指向参与者的交流意图中的重要作用。《人类大脑图谱》37:3444 - 3461, 2016。© 2016威利期刊公司。