Max Planck Institute for Psycholinguistics, PO Box 310, 6500 AH Nijmegen, The Netherlands.
Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.
Proc Biol Sci. 2021 Jan 27;288(1943):20202419. doi: 10.1098/rspb.2020.2419.
Beat gestures-spontaneously produced biphasic movements of the hand-are among the most frequently encountered co-speech gestures in human communication. They are closely temporally aligned to the prosodic characteristics of the speech signal, typically occurring on lexically stressed syllables. Despite their prevalence across speakers of the world's languages, how beat gestures impact spoken word recognition is unclear. Can these simple 'flicks of the hand' influence speech perception? Across a range of experiments, we demonstrate that beat gestures influence the explicit and implicit perception of lexical stress (e.g. distinguishing from ), and in turn can influence what vowels listeners hear. Thus, we provide converging evidence for a manual McGurk effect: relatively simple and widely occurring hand movements influence which speech sounds we hear.
打拍子手势——手的自发产生的双相运动——是人类交流中最常遇到的伴随言语手势之一。它们与语音信号的韵律特征密切时间对准，通常发生在词汇重读音节上。尽管在世界各种语言的说话者中都很常见，但打拍子手势如何影响口语识别尚不清楚。这些简单的“挥手”会影响语音感知吗？在一系列实验中，我们证明打拍子手势会影响词汇重音的显式和隐式感知（例如，区分 和 ），进而会影响听众听到的元音。因此，我们为手动麦格克效应提供了确凿的证据：相对简单且广泛存在的手部运动影响我们听到的语音。
