Lee Minyoung, Blake Randolph, Kim Sujin, Kim Chai-Youn
Department of Psychology, Korea University, Seoul 136701, Korea;
Department of Psychological Sciences, Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN 37240; Department of Brain and Cognitive Sciences, Seoul National University, Seoul 151742, Korea
Proc Natl Acad Sci U S A. 2015 Jul 7;112(27):8493-8. doi: 10.1073/pnas.1509529112. Epub 2015 Jun 15.
Predictive influences of auditory information on resolution of visual competition were investigated using music, whose visual symbolic notation is familiar only to those with musical training. Results from two experiments using different experimental paradigms revealed that melodic congruence between what is seen and what is heard impacts perceptual dynamics during binocular rivalry. This bisensory interaction was observed only when the musical score was perceptually dominant, not when it was suppressed from awareness, and it was observed only in people who could read music. Results from two ancillary experiments showed that this effect of congruence cannot be explained by differential patterns of eye movements or by differential response sluggishness associated with congruent score/melody combinations. Taken together, these results demonstrate robust audiovisual interaction based on high-level, symbolic representations and its predictive influence on perceptual dynamics during binocular rivalry.
利用音乐对听觉信息对视觉竞争分辨率的预测影响进行了研究，其视觉符号表示法只有受过音乐训练的人才能熟悉。使用不同实验范式的两个实验结果表明，所见与所闻之间的旋律一致性会影响双眼竞争期间的感知动态。这种双感觉相互作用仅在乐谱在感知上占主导地位时才被观察到，而不是在其从意识中被抑制时，并且仅在能够识谱的人中被观察到。两个辅助实验的结果表明，这种一致性效应不能用眼球运动的差异模式或与一致的乐谱/旋律组合相关的差异反应迟缓来解释。综上所述，这些结果证明了基于高级符号表征的强大视听交互作用及其对双眼竞争期间感知动态的预测影响。
