Department of Music, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany; Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands.
Department of Music, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany; Max Planck-NYU Center for Language, Music, and Emotion, Frankfurt am Main, Germany.
Cognition. 2023 Oct;239:105537. doi: 10.1016/j.cognition.2023.105537. Epub 2023 Jul 22.
Compared to audio only (AO) conditions, audiovisual (AV) information can enhance the aesthetic experience of a music performance. However, such beneficial multimodal effects have yet to be studied in naturalistic music performance settings. Further, peripheral physiological correlates of aesthetic experiences are not well-understood. Here, participants were invited to a concert hall for piano performances of Bach, Messiaen, and Beethoven, which were presented in two conditions: AV and AO. They rated their aesthetic experience (AE) after each piece (Experiment 1 and 2), while peripheral signals (cardiorespiratory measures, skin conductance, and facial muscle activity) were continuously measured (Experiment 2). Factor scores of AE were significantly higher in the AV condition in both experiments. LF/HF ratio, a heart rhythm that represents activation of the sympathetic nervous system, was higher in the AO condition, suggesting increased arousal, likely caused by less predictable sound onsets in the AO condition. We present partial evidence that breathing was faster and facial muscle activity was higher in the AV condition, suggesting that observing a performer's movements likely enhances motor mimicry in these more voluntary peripheral measures. Further, zygomaticus ('smiling') muscle activity was a significant predictor of AE. Thus, we suggest physiological measures are related to AE, but at different levels: the more involuntary measures (i.e., heart rhythms) may reflect more sensory aspects, while the more voluntary measures (i.e., muscular control of breathing and facial responses) may reflect the liking aspect of an AE. In summary, we replicate and extend previous findings that AV information enhances AE in a naturalistic music performance setting. We further show that a combination of self-report and peripheral measures benefit a meaningful assessment of AE in naturalistic music performance settings.
与仅音频（AO）条件相比，视听（AV）信息可以增强音乐表演的审美体验。然而，这种有益的多模态效应尚未在自然主义音乐表演环境中进行研究。此外，审美体验的周边生理相关性还不太清楚。在这里，参与者被邀请到音乐厅观看巴赫、梅西安和贝多芬的钢琴演奏，这些演奏在两种条件下进行：AV 和 AO。他们在每首作品结束后（实验 1 和 2）对自己的审美体验（AE）进行评分，同时连续测量周边信号（心肺测量、皮肤电导和面部肌肉活动）。在两个实验中，AE 的因子评分在 AV 条件下均显著更高。LF/HF 比，代表交感神经系统激活的心率，在 AO 条件下更高，这表明 AO 条件下声音起始的不可预测性导致唤醒增加。我们提供了部分证据表明，在 AV 条件下呼吸更快，面部肌肉活动更高，这表明观察表演者的动作可能会增强这些更自主的周边测量中的运动模仿。此外，颧大肌（“微笑”）肌肉活动是 AE 的一个显著预测指标。因此，我们认为生理测量与 AE 有关，但在不同的水平上：更不自主的测量（即心率）可能反映了更感官的方面，而更自主的测量（即呼吸和面部反应的肌肉控制）可能反映了 AE 的喜欢方面。总之，我们复制并扩展了先前的发现，即在自然主义音乐表演环境中，视听信息增强了 AE。我们进一步表明，自我报告和周边测量的结合有助于对自然主义音乐表演环境中的 AE 进行有意义的评估。
