Kitagawa Norimichi, Ichihara Shigeru
Department of Psychology, Tokyo Metropolitan University, 1-1, Minami-Osawa, Hachioji-shi, Tokyo 192-0397, Japan.
Nature. 2002 Mar 14;416(6877):172-4. doi: 10.1038/416172a.
Auditory spatial perception is strongly affected by visual cues. For example, if auditory and visual stimuli are presented synchronously but from different positions, the auditory event is mislocated towards the locus of the visual stimulus-the ventriloquism effect. This 'visual capture' also occurs in motion perception in which a static auditory stimulus appears to move with the visual moving object. We investigated how the human perceptual system coordinates complementary inputs from auditory and visual senses. Here we show that an auditory aftereffect occurs from adaptation to visual motion in depth. After a few minutes of viewing a square moving in depth, a steady sound was perceived as changing loudness in the opposite direction. Adaptation to a combination of auditory and visual stimuli changing in a compatible direction increased the aftereffect and the effect of visual adaptation almost disappeared when the directions were opposite. On the other hand, listening to a sound changing in intensity did not affect the visual changing-size aftereffect. The results provide psychophysical evidence that, for processing of motion in depth, the auditory system responds to both auditory changing intensity and visual motion in depth.
听觉空间感知受视觉线索的影响很大。例如，如果听觉和视觉刺激同时呈现但来自不同位置，听觉事件会被错误定位到视觉刺激的位置——即口技效应。这种“视觉捕获”也出现在运动感知中，即静态听觉刺激似乎会随着视觉移动对象一起移动。我们研究了人类感知系统如何协调来自听觉和视觉感官的互补输入。在这里我们表明，深度视觉运动适应会引发听觉后效。在观看一个在深度上移动的方块几分钟后，一个稳定的声音会被感知为响度朝着相反方向变化。适应在兼容方向上变化的听觉和视觉刺激组合会增强后效，而当方向相反时，视觉适应的效果几乎消失。另一方面，听强度变化的声音不会影响视觉大小变化后效。这些结果提供了心理物理学证据，即对于深度运动的处理，听觉系统对听觉强度变化和深度视觉运动都会做出反应。
