Soto-Faraco Salvador, Spence Charles, Kingstone Alan
Departament de Psicologia Basica, Universitat de Barcelona, Barcelona, Spain.
J Exp Psychol Hum Percept Perform. 2004 Apr;30(2):330-45. doi: 10.1037/0096-1523.30.2.330.
This study investigated multisensory interactions in the perception of auditory and visual motion. When auditory and visual apparent motion streams are presented concurrently in opposite directions, participants often fail to discriminate the direction of motion of the auditory stream, whereas perception of the visual stream is unaffected by the direction of auditory motion (Experiment 1). This asymmetry persists even when the perceived quality of apparent motion is equated for the 2 modalities (Experiment 2). Subsequently, it was found that this visual modulation of auditory motion is caused by an illusory reversal in the perceived direction of sounds (Experiment 3). This "dynamic capture" effect occurs over and above ventriloquism among static events (Experiments 4 and 5), and it generalizes to continuous motion displays (Experiment 6). These data are discussed in light of related multisensory phenomena and their support for a "modality appropriateness" interpretation of multisensory integration in motion perception.
本研究调查了听觉和视觉运动感知中的多感官交互作用。当听觉和视觉的表观运动流同时以相反方向呈现时,参与者常常无法辨别听觉流的运动方向,而视觉流的感知不受听觉运动方向的影响(实验1)。即使在两种模态的表观运动感知质量相等时,这种不对称性仍然存在(实验2)。随后发现,这种对听觉运动的视觉调制是由声音感知方向的虚幻反转引起的(实验3)。这种“动态捕获”效应超越了静态事件中的腹语术效应(实验4和5),并且可以推广到连续运动显示中(实验6)。根据相关的多感官现象及其对运动感知中多感官整合的“模态适宜性”解释的支持,对这些数据进行了讨论。