Department of Movement Science, Faculty of Sport and Health Sciences, Technical University of Munich, Georg-Brauche-Ring 62, 80992, Munich, Germany.
Psychon Bull Rev. 2018 Aug;25(4):1416-1422. doi: 10.3758/s13423-018-1480-3.
Although music and dance are often experienced simultaneously, it is unclear what modulates their perceptual integration. This study investigated how two factors related to music-dance correspondences influenced audiovisual binding of their rhythms: the metrical match between the music and dance, and the kinematic familiarity of the dance movement. Participants watched a point-light figure dancing synchronously to a triple-meter rhythm that they heard in parallel, whereby the dance communicated a triple (congruent) or a duple (incongruent) visual meter. The movement was either the participant's own or that of another participant. Participants attended to both streams while detecting a temporal perturbation in the auditory beat. The results showed lower sensitivity to the auditory deviant when the visual dance was metrically congruent to the auditory rhythm and when the movement was the participant's own. This indicated stronger audiovisual binding and a more coherent bimodal rhythm in these conditions, thus making a slight auditory deviant less noticeable. Moreover, binding in the metrically incongruent condition involving self-generated visual stimuli was correlated with self-recognition of the movement, suggesting that action simulation mediates the perceived coherence between one's own movement and a mismatching auditory rhythm. Overall, the mechanisms of rhythm perception and action simulation could inform the perceived compatibility between music and dance, thus modulating the temporal integration of these audiovisual stimuli.
虽然音乐和舞蹈通常是同时体验的，但不清楚是什么调节了它们的感知整合。本研究调查了与音乐舞蹈对应相关的两个因素如何影响它们节奏的视听绑定：音乐和舞蹈的韵律匹配，以及舞蹈运动的运动熟悉度。参与者观看一个光点人物同步跳舞，同时听到平行的三拍子节奏，其中舞蹈传达了三拍子（一致）或两拍子（不一致）的视觉拍子。运动要么是参与者自己的，要么是另一个参与者的。参与者在检测听觉节拍的时间干扰时同时关注两个流。结果表明，当视觉舞蹈与听觉节奏在韵律上一致，并且运动是参与者自己的时，对听觉偏差的敏感性降低。这表明在这些条件下，视听绑定更强，双模态节奏更连贯，因此使轻微的听觉偏差不太明显。此外，涉及自身产生的视觉刺激的在韵律上不一致的条件下的绑定与对运动的自我识别相关，这表明动作模拟介导了对自身运动和不匹配的听觉节奏之间的感知一致性。总的来说，节奏感知和动作模拟的机制可以为音乐和舞蹈之间的感知兼容性提供信息，从而调节这些视听刺激的时间整合。
