Bishop Laura, Goebl Werner
Austrian Research Institute for Artificial Intelligence (OFAI), Freyung 6/6, 1010, Vienna, Austria.
Department of Music Acoustics-Wiener Klangstil (IWK), University of Music and Performing Arts Vienna, Anton-von-Webern-Platz 1, 1030, Vienna, Austria.
Psychol Res. 2018 Nov;82(6):1177-1194. doi: 10.1007/s00426-017-0893-3. Epub 2017 Jul 21.
Ensemble musicians often exchange visual cues in the form of body gestures (e.g., rhythmic head nods) to help coordinate piece entrances. These cues must communicate beats clearly, especially if the piece requires interperformer synchronization of the first chord. This study aimed to (1) replicate prior findings suggesting that points of peak acceleration in head gestures communicate beat position and (2) identify the kinematic features of head gestures that encourage successful synchronization. It was expected that increased precision of the alignment between leaders' head gestures and first note onsets, increased gesture smoothness, magnitude, and prototypicality, and increased leader ensemble/conducting experience would improve gesture synchronizability. Audio/MIDI and motion capture recordings were made of piano duos performing short musical passages under assigned leader/follower conditions. The leader of each trial listened to a particular tempo over headphones, then cued their partner in at the given tempo, without speaking. A subset of motion capture recordings were then presented as point-light videos with corresponding audio to a sample of musicians who tapped in synchrony with the beat. Musicians were found to align their first taps with the period of deceleration following acceleration peaks in leaders' head gestures, suggesting that acceleration patterns communicate beat position. Musicians' synchronization with leaders' first onsets improved as cueing gesture smoothness and magnitude increased and prototypicality decreased. Synchronization was also more successful with more experienced leaders' gestures. These results might be applied to interactive systems using gesture recognition or reproduction for music-making tasks (e.g., intelligent accompaniment systems).
室内乐演奏者经常通过身体手势（如节奏性点头）来交换视觉信号，以帮助协调乐曲的起奏。这些信号必须清晰地传达节拍，特别是在乐曲要求演奏者同步第一个和弦的情况下。本研究旨在：（1）复制先前的研究结果，即头部手势中的加速度峰值点传达节拍位置；（2）识别有助于成功同步的头部手势的运动学特征。预计领导者头部手势与第一个音符起奏之间对齐的精度提高、手势的流畅度、幅度和典型性增加，以及领导者的合奏/指挥经验增加，将提高手势的同步性。在指定的领导者/跟随者条件下，对演奏短音乐段落的钢琴二重奏进行了音频/ MIDI和动作捕捉录制。每次试验的领导者通过耳机听特定的节奏，然后在给定的节奏下提示他们的搭档，不说话。然后，将一部分动作捕捉录制作为光点视频与相应音频呈现给与节拍同步敲击的音乐家样本。结果发现，音乐家会将他们的第一次敲击与领导者头部手势加速度峰值后的减速期对齐，这表明加速度模式传达了节拍位置。随着提示手势的流畅度和幅度增加以及典型性降低，音乐家与领导者第一次起奏的同步性得到改善。经验更丰富的领导者的手势同步也更成功。这些结果可能应用于使用手势识别或再现进行音乐制作任务的交互式系统（如智能伴奏系统）。
