LIMSI-CNRS (Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur - Centre National de la Recherche Scientifique), BP 133, Orsay 91403, France.
J Acoust Soc Am. 2011 Mar;129(3):1594-604. doi: 10.1121/1.3531802.
Intonation stylization is studied using "chironomy," i.e., the analogy between hand gestures and prosodic movements. An intonation mimicking paradigm is used. The task of the ten subjects is to copy the intonation pattern of sentences with the help of a stylus on a graphic tablet, using a system for real-time manual intonation modification. Gestural imitation is compared to vocal imitation of the same sentences (seven for a male speaker, seven for a female speaker). Distance measures between gestural copies, vocal imitations, and original sentences are computed for performance assessment. Perceptual testing is also used for assessing the quality of gestural copies. The perceptual difference between natural and stylized contours is measured using a mean opinion score paradigm for 15 subjects. The results indicate that intonation contours can be stylized with accuracy by chironomic imitation. The results of vocal imitation and chironomic imitation are comparable, but subjects show better imitation results in vocal imitation. The best stylized contours using chironomy seems perceptually indistinguishable or almost indistinguishable from natural contours, particularly for female speech. This indicates that chironomic stylization is effective, and that hand movements can be analogous to intonation movements.
使用“手势模仿”研究语调风格化,即手势和韵律运动之间的类比。采用了一种语调模仿范例。十个实验对象的任务是借助图形平板上的手写笔,使用实时手动语调修改系统来复制句子的语调模式。对同一句子的手势模仿和语音模仿(七位男性说话者,七位女性说话者)进行比较。为了评估性能,计算了手势复制、语音模仿和原始句子之间的距离度量。感知测试也用于评估手势复制的质量。使用 15 位受试者的平均意见得分范例来测量自然轮廓和风格化轮廓之间的感知差异。结果表明,通过手势模仿可以准确地进行语调风格化。语音模仿和手势模仿的结果相当,但在语音模仿中,实验对象的模仿结果更好。使用手势模仿的最佳风格化轮廓在感知上与自然轮廓难以区分或几乎难以区分,尤其是对于女性语音。这表明手势模仿是有效的,手的运动可以与语调运动类似。