Departament de Tecnologies de la Informació i les Comunicacions, Universitat Pompeu Fabra, Barcelona, Spain.
Brain Lang. 2013 Feb;124(2):143-52. doi: 10.1016/j.bandl.2012.10.008. Epub 2013 Jan 19.
Spontaneous beat gestures are an integral part of the paralinguistic context during face-to-face conversations. Here we investigated the time course of beat-speech integration in speech perception by measuring ERPs evoked by words pronounced with or without an accompanying beat gesture, while participants watched a spoken discourse. Words accompanied by beats elicited a positive shift in ERPs at an early sensory stage (before 100 ms) and at a later time window coinciding with the auditory component P2. The same word tokens produced no ERP differences when participants listened to the discourse without view of the speaker. We conclude that beat gestures are integrated with speech early on in time and modulate sensory/phonological levels of processing. The present results support the possible role of beats as a highlighter, helping the listener to direct the focus of attention to important information and modulate the parsing of the speech stream.
自发的节拍手势是面对面交谈中副语言语境的一个组成部分。在这里，我们通过测量参与者观看口语语篇时，伴随或不伴随节拍手势发音的单词所引起的 ERP，来研究节拍-言语整合在言语感知中的时间进程。与节拍伴随的单词在早期感觉阶段（100ms 之前）和与听觉成分 P2 相吻合的较晚时间窗口引起 ERP 的正偏移。当参与者在没有看到说话者的情况下听话语时，相同的单词标记没有产生 ERP 差异。我们得出结论，节拍手势与言语在时间上很早就被整合在一起，并调节感觉/语音处理水平。目前的结果支持节拍作为突出显示的可能作用，帮助听众将注意力集中到重要信息上，并调节言语流的解析。
