Wu Ying Choon, Coulson Seana
Institute for Neural Computation.
Department of Cognitive Science, University of California, San Diego
Psychol Sci. 2015 Nov;26(11):1717-27. doi: 10.1177/0956797615597671. Epub 2015 Sep 17.
To understand a speaker's gestures, people may draw on kinesthetic working memory (KWM)-a system for temporarily remembering body movements. The present study explored whether sensitivity to gesture meaning was related to differences in KWM capacity. KWM was evaluated through sequences of novel movements that participants viewed and reproduced with their own bodies. Gesture sensitivity was assessed through a priming paradigm. Participants judged whether multimodal utterances containing congruent, incongruent, or no gestures were related to subsequent picture probes depicting the referents of those utterances. Individuals with low KWM were primarily inhibited by incongruent speech-gesture primes, whereas those with high KWM showed facilitation-that is, they were able to identify picture probes more quickly when preceded by congruent speech and gestures than by speech alone. Group differences were most apparent for discourse with weakly congruent speech and gestures. Overall, speech-gesture congruency effects were positively correlated with KWM abilities, which may help listeners match spatial properties of gestures to concepts evoked by speech.
为了理解说话者的手势,人们可能会借助动觉工作记忆(KWM)——一种用于临时记忆身体动作的系统。本研究探讨了对手势意义的敏感度是否与KWM容量的差异有关。通过参与者观看并亲自重现的新颖动作序列来评估KWM。通过启动范式评估手势敏感度。参与者判断包含一致、不一致或无手势的多模态话语是否与随后描绘这些话语所指对象的图片探测有关。KWM较低的个体主要受到不一致的言语-手势启动的抑制,而KWM较高的个体则表现出促进作用——也就是说,当一致的言语和手势先于单独的言语出现时,他们能够更快地识别图片探测。对于言语和手势一致性较弱的话语,组间差异最为明显。总体而言,言语-手势一致性效应与KWM能力呈正相关,这可能有助于听众将手势的空间属性与言语唤起的概念相匹配。