Ward Jamie, Moore Samantha, Thompson-Lake Daisy, Salih Shireen, Beck Brianna
Department of Psychology, University of Sussex, Falmer, Brighton BN1 9QH, UK.
Perception. 2008;37(8):1285-96. doi: 10.1068/p5815.
The term 'visual music' refers to works of art in which both hearing and vision are directly or indirectly stimulated. Our ability to create, perceive, and appreciate visual music is hypothesised to rely on the same multisensory processes that support auditory visual (AV) integration in other contexts. Whilst these mechanisms have been extensively studied, there has been little research on how these processes affect aesthetic judgments (of liking or preference). Studies of synaesthesia in which sound evokes vision and studies of cross-modal biases in non-synaesthetes have revealed non-arbitrary mappings between visual and auditory properties (eg high-pitch sounds being smaller and brighter). In three experiments, we presented members of the general population with animated AV clips derived from synaesthetic experiences and contrasted them with a number of control conditions. The control conditions consisted of the same clips rotated or with the colour changed, random AV pairings, or animated clips generated by non-synaesthetes. Synaesthetic AV animations were generally preferred over the control conditions. The results suggest that non-arbitrary AV mappings, present in the experiences of synaesthetes, can be readily appreciated by others and may underpin our tendency to engage with certain forms of art.
“视觉音乐”一词指的是那些能直接或间接刺激听觉和视觉的艺术作品。我们创造、感知和欣赏视觉音乐的能力被假定依赖于与在其他情境中支持听觉视觉（AV）整合相同的多感官过程。虽然这些机制已经得到了广泛研究，但关于这些过程如何影响审美判断（喜欢或偏好）的研究却很少。对声音唤起视觉的联觉研究以及对非联觉者跨模态偏向的研究揭示了视觉和听觉属性之间的非任意映射（例如高音调的声音更小且更明亮）。在三个实验中，我们向普通大众展示了源自联觉体验的动态视听片段，并将它们与一些对照条件进行对比。对照条件包括旋转后的相同片段或颜色改变后的片段、随机的视听配对，或由非联觉者生成的动态片段。联觉视听动画通常比对照条件更受青睐。结果表明，联觉者体验中存在的非任意视听映射能够被他人轻易欣赏，并且可能是我们倾向于参与某些艺术形式的基础。
