Bishop Laura, Goebl Werner
Austrian Research Institute for Artificial Intelligence (OFAI), Vienna, Austria.
Department of Music Acoustics (IWK), University of Music and Performing Arts Vienna, Austria.
Psychol Music. 2018 Jan;46(1):84-106. doi: 10.1177/0305735617702971. Epub 2017 Apr 27.
Ensemble musicians typically exchange visual cues to coordinate piece entrances. "Cueing-in" gestures indicate when to begin playing and at what tempo. This study investigated how timing information is encoded in musicians' cueing-in gestures. Gesture acceleration patterns were expected to indicate beat position, while gesture periodicity, duration, and peak gesture velocity were expected to indicate tempo. Same-instrument ensembles (e.g., piano-piano) were expected to synchronize more successfully than mixed-instrument ensembles (e.g., piano-violin). Duos performed short passages as their head and (for violinists) bowing hand movements were tracked with accelerometers and Kinect sensors. Performers alternated between leader/follower roles; leaders heard a tempo via headphones and cued their partner in nonverbally. Violin duos synchronized more successfully than either piano duos or piano-violin duos, possibly because violinists were more experienced in ensemble playing than pianists. Peak acceleration indicated beat position in leaders' head-nodding gestures. Gesture duration and periodicity in leaders' head and bowing hand gestures indicated tempo. The results show that the spatio-temporal characteristics of cueing-in gestures guide beat perception, enabling synchronization with visual gestures that follow a range of spatial trajectories.
室内乐演奏者通常会通过视觉线索来协调乐曲的起奏。“提示”手势表明何时开始演奏以及以何种速度演奏。本研究调查了时间信息是如何在音乐家的提示手势中编码的。手势加速模式预计可表明节拍位置,而手势的周期性、持续时间和峰值手势速度预计可表明速度。预计同乐器组合(如两架钢琴)比混合乐器组合(如钢琴与小提琴)能更成功地实现同步。二重奏演奏简短乐段,同时用加速度计和Kinect传感器追踪(小提琴演奏者的)头部和运弓手部动作。演奏者在领奏/跟奏角色之间交替;领奏者通过耳机听到速度,并以非语言方式向其搭档发出提示。小提琴二重奏比钢琴二重奏或钢琴与小提琴二重奏同步得更成功,这可能是因为小提琴演奏者在室内乐演奏方面比钢琴演奏者更有经验。峰值加速度在领奏者点头手势中表明节拍位置。领奏者头部和运弓手部手势的持续时间和周期性表明速度。结果表明,提示手势的时空特征引导节拍感知,从而能够与遵循一系列空间轨迹的视觉手势实现同步。