Takeshima Yasuhiro, Gyoba Jiro
Department of Psychology, Graduate School of Arts and Letters, Tohoku University, Japan.
Multisens Res. 2013;26(4):317-32.
Several studies have examined the effects of auditory stimuli on visual perception. In studies of cross-modal correspondences, auditory pitch has been shown to modulate visual motion perception. In particular, low-reliability visual motion stimuli tend to be affected by metaphorically or physically congruent or incongruent sounds. In the present study, we examined the modulatory effects of auditory pitch on visual perception of motion trajectory for visual inputs of varying reliability. Our results indicated that an auditory pitch implying the illusory motion toward the outside of the visual field-modulated perceived motion trajectory. In contrast, auditory pitch implying the illusory motion toward the central visual field did not affect the perception of motion trajectory. This asymmetrical effect of auditory stimuli occurred depending on the reliability of the visual input. Moreover, sounds that corresponded in terms of their pitch-elevation mapping altered the perception of the trajectory of visual motion when apparent motion could be perceived smoothly. Therefore, the present results demonstrate that auditory stimuli modulate visual motion perception especially when smooth motion is perceived in the peripheral visual field.
多项研究探讨了听觉刺激对视觉感知的影响。在跨模态对应关系的研究中,已表明听觉音高会调节视觉运动感知。特别是,低可靠性的视觉运动刺激往往会受到隐喻或物理上一致或不一致声音的影响。在本研究中,我们研究了听觉音高对不同可靠性视觉输入的运动轨迹视觉感知的调节作用。我们的结果表明,暗示向视野外虚幻运动的听觉音高会调节感知到的运动轨迹。相比之下,暗示向中央视野虚幻运动的听觉音高不会影响运动轨迹的感知。听觉刺激的这种不对称效应取决于视觉输入的可靠性。此外,当可以平稳地感知表观运动时,在音高- elevation映射方面相对应的声音会改变视觉运动轨迹的感知。因此,目前的结果表明,听觉刺激会调节视觉运动感知,尤其是当在外周视野中感知到平稳运动时。