Department of Psychology and Human Evolution and Cognition (IFISC-CSIC), University of the Balearic Islands Palma de Mallorca, Spain.
Department of Psychology, School of Arts and Social Science, City University London London, UK.
Front Hum Neurosci. 2014 Oct 6;8:757. doi: 10.3389/fnhum.2014.00757. eCollection 2014.
It is well established that emotional responses to stimuli presented to one perceptive modality (e.g., visual) are modulated by the concurrent presentation of affective information to another modality (e.g., auditory)-an effect known as the cross-modal bias. However, the affective mechanisms mediating this effect are still not fully understood. It remains unclear what role different dimensions of stimulus valence and arousal play in mediating the effect, and to what extent cross-modal influences impact not only our perception and conscious affective experiences, but also our psychophysiological emotional response. We addressed these issues by measuring participants' subjective emotion ratings and their Galvanic Skin Responses (GSR) in a cross-modal affect perception paradigm employing videos of ballet dance movements and instrumental classical music as the stimuli. We chose these stimuli to explore the cross-modal bias in a context of stimuli (ballet dance movements) that most participants would have relatively little prior experience with. Results showed (i) that the cross-modal bias was more pronounced for sad than for happy movements, whereas it was equivalent when contrasting high vs. low arousal movements; and (ii) that movement valence did not modulate participants' GSR, while movement arousal did, such that GSR was potentiated in the case of low arousal movements with sad music and when high arousal movements were paired with happy music. Results are discussed in the context of the affective dimension of neuroentrainment and with regards to implications for the art community.
已证实，当同一感知模式（例如视觉）呈现的刺激伴有另一种模式（例如听觉）呈现的情感信息时，人们对这些刺激的情绪反应会发生变化——这种效应被称为跨模态偏见。然而，介导这种效应的情感机制仍未被完全理解。目前还不清楚刺激效价和唤醒度的不同维度在介导这种效应中扮演了什么角色，以及跨模态影响在何种程度上不仅影响我们的感知和有意识的情感体验，还影响我们的心理生理情绪反应。我们通过在一个跨模态情感感知范式中测量参与者的主观情感评分和皮肤电反应（GSR）来解决这些问题，该范式使用芭蕾舞动作和古典器乐视频作为刺激。我们选择这些刺激是为了在一个大多数参与者都相对缺乏先前经验的情境（芭蕾舞动作）中探索跨模态偏见。结果表明：（i）与快乐动作相比，悲伤动作的跨模态偏见更为明显，而在高唤醒与低唤醒动作之间则没有区别；（ii）动作效价不会调节参与者的 GSR，而动作唤醒度会，即当悲伤音乐与低唤醒度的动作搭配，或当快乐音乐与高唤醒度的动作搭配时，GSR 会增强。结果在神经伴随的情感维度背景下进行了讨论，并考虑了对艺术界的影响。
