University College London, London, United Kingdom.
Universitat Oberta de Catalunya, Barcelona, Spain.
J Acoust Soc Am. 2024 Sep 1;156(3):1720-1733. doi: 10.1121/10.0028585.
Previous research has shown that prosodic structure can regulate the relationship between co-speech gestures and speech itself. Most co-speech studies have focused on manual gestures, but head movements have also been observed to accompany speech events by Munhall, Jones, Callan, Kuratate, and Vatikiotis-Bateson [(2004). Psychol. Sci. 15(2), 133-137], and these co-verbal gestures may be linked to prosodic prominence, as shown by Esteve-Gibert, Borrás-Comes, Asor, Swerts, and Prieto [(2017). J. Acoust. Soc. Am. 141(6), 4727-4739], Hadar, Steiner, Grant, and Rose [(1984). Hum. Mov. Sci. 3, 237-245], and House, Beskow, and Granström [(2001). Lang. Speech 26(2), 117-129]. This study examines how the timing and magnitude of head nods may be related to degrees of prosodic prominence connected to different focus conditions. Using electromagnetic articulometry, a time-varying signal of vertical head movement for 12 native French speakers was generated to examine the relationship between head nod gestures and F0 peaks. The results suggest that speakers use two different alignment strategies, which integrate both temporal and magnitudinal aspects of the gesture. Some evidence of inter-speaker preferences in the use of the two strategies was observed, although the inter-speaker variability is not categorical. Importantly, prosodic prominence itself is not the cause of the difference between the two strategies, but instead magnifies their inherent differences. In this way, the use of co-speech head nod gestures under French focus conditions can be considered as a method of prosodic enhancement.
先前的研究表明，韵律结构可以调节伴随言语的协同手势与言语本身之间的关系。大多数协同言语研究都集中在手动手势上，但 Munhall、Jones、Callan、Kuratate 和 Vatikiotis-Bateson [(2004). Psychol. Sci. 15(2), 133-137] 也曾观察到头的运动伴随着言语事件，并且这些协同言语手势可能与韵律重音有关，Esteve-Gibert、Borrás-Comes、Asor、Swerts 和 Prieto [(2017). J. Acoust. Soc. Am. 141(6), 4727-4739]、Hadar、Steiner、Grant 和 Rose [(1984). Hum. Mov. Sci. 3, 237-245] 以及 House、Beskow 和 Granström [(2001). Lang. Speech 26(2), 117-129] 的研究表明了这一点。本研究考察了点头的时间和幅度如何与与不同焦点条件相关的韵律重音程度相关。本研究使用电磁发音测量法，对 12 位母语为法语的说话者的垂直头部运动的时变信号进行了分析，以检验头部点头手势与 F0 峰值之间的关系。结果表明，说话者使用了两种不同的对齐策略，这些策略整合了手势的时间和幅度方面。尽管存在说话者之间的可变性，但观察到了两种策略的使用存在一些说话者偏好的证据。重要的是，韵律重音本身并不是两种策略之间差异的原因，而是放大了它们的固有差异。通过这种方式，在法语焦点条件下使用协同言语点头手势可以被视为韵律增强的一种方法。
