GIPSA-lab, CNRS, Grenoble Institute of Technology, University of Grenoble Alpes, Grenoble, France.
Leibniz-Centre General Linguistics (ZAS), Berlin, Germany.
J Neurophysiol. 2022 Nov 1;128(5):1106-1116. doi: 10.1152/jn.00282.2022. Epub 2022 Sep 21.
Coordination between speech acoustics and manual gestures has been conceived as "not biologically mandated" (McClave E. 27(1): 69-89, 1998). However, recent work suggests a biomechanical entanglement between the upper limbs and the respiratory-vocal system (Pouw W, de Jonge-Hoekstra D, Harrison SJ, Paxton A, Dixon JA. 1491(1): 89-105, 2021). Pouw et al. found that for movements with a high physical impulse, speech acoustics co-occur with the physical impulses of upper limb movements. They interpret this result in terms of biomechanical coupling between arm motion and speech via the breathing system. This coupling could support the synchrony observed between speech prosody and arm gestures during communication. The present study investigates whether the effect of physical impulse on speech acoustics can be extended to leg motion, assumed to be controlled independently from oral communication. The study involved 25 native speakers of German who recalled short stories while biking with their arms or their legs. These conditions were compared with a static condition in which participants could not move their arms. Our analyses are similar to that of Pouw et al. (Pouw W, de Jonge-Hoekstra D, Harrison SJ, Paxton A, Dixon JA. 1491(1): 89-105, 2021). Results reveal that the presence of intensity peaks in the acoustic signal co-occur with the time of peak acceleration of legs' biking movements. However, this was not observed when biking with the arms, which corresponded to lower acceleration peaks. In contrast to intensity, F0 was not affected in the arm and leg conditions. These results suggest that ) the biomechanical entanglements between the respiratory-vocal system and the lower limbs may also impact speech; ) the physical impulse may have to reach a threshold to impact speech acoustics. The link between speech and limb motion is an interdisciplinary challenge and a core issue in motor control and language research. Our research aims to disentangle the potential biomechanical links between lower limbs and the speech apparatus, by investigating the effect of leg movements on speech acoustics.
语音声学与手动手势的协调被认为是“非生物强制”的(McClave E. 27(1): 69-89, 1998)。然而,最近的研究表明上肢和呼吸-发声系统之间存在生物力学上的纠缠(Pouw W, de Jonge-Hoekstra D, Harrison SJ, Paxton A, Dixon JA. 1491(1): 89-105, 2021)。Pouw 等人发现,对于物理冲量较高的运动,语音声学与上肢运动的物理冲量同时出现。他们根据呼吸系统中手臂运动和语音之间的生物力学耦合来解释这一结果。这种耦合可以支持在交流过程中观察到的语音韵律和手臂手势之间的同步性。本研究旨在调查物理冲量对语音声学的影响是否可以扩展到腿部运动,腿部运动被认为是独立于口腔交流控制的。该研究涉及 25 名母语为德语的参与者,他们在骑自行车时回忆起简短的故事,同时用手臂或腿部运动。这些条件与参与者无法移动手臂的静态条件进行了比较。我们的分析与 Pouw 等人的分析相似(Pouw W, de Jonge-Hoekstra D, Harrison SJ, Paxton A, Dixon JA. 1491(1): 89-105, 2021)。结果表明,在腿部骑行运动的加速度峰值时间与声学信号中强度峰值的出现同时出现。然而,当用手臂骑自行车时,这并没有观察到,因为手臂的加速度峰值较低。与强度相反,F0 在手臂和腿部条件下不受影响。这些结果表明,)呼吸-发声系统和下肢之间的生物力学纠缠也可能影响语音;)物理冲量必须达到一定阈值才能影响语音声学。语音和肢体运动之间的联系是一个跨学科的挑战,也是运动控制和语言研究的核心问题。我们的研究旨在通过研究腿部运动对语音声学的影响,来解开下肢和语音器官之间潜在的生物力学联系。