McBeath Michael K, Addie Jason D, Krynen R Chandler
Department of Psychology, Arizona State University, United States of America.
Department of Psychology, Arizona State University, United States of America.
Acta Psychol (Amst). 2019 Feb;193:105-112. doi: 10.1016/j.actpsy.2018.12.011. Epub 2018 Dec 30.
Traditional tests of multisensory stimuli typically support that vision dominates spatial judgments and audition dominates temporal ones. Here, we examine if unambiguous auditory spatial cues can capture ambiguous visual ones in judgments of direction of apparent motion. The visual motion judgments include both lateral movement and movement in depth, each when coupled with auditory stimuli moving at one of four rates. Experiment 1 tested lateral visual movement judgments (leftward vs rightward) coupled with auditory stimuli that moved laterally. Experiment 2 tested depth visual movement judgments (approaching vs receding) coupled with auditory stimuli that got louder or quieter. Results of Experiment 1 revealed and replicated an overall leftward motion bias, but with additional acoustic capture to experience visual movement away from the side on which sound initially occurred, and no effect of auditory motion speed. Results of Experiment 2 revealed and replicated an approaching motion bias, but with no effect of initial sound intensity, and an additional systematic capture effect of auditory motion speed. Faster changes in acoustic intensity produced larger visual motion capture consistent with the direction of acoustic intensity change. Findings of both experiments generalized over conditions of listening device (head phones vs speakers) and test-setting (Laboratory vs Web-based data-collection). The leftward and approaching motion bias results replicate previous research. Our principal new findings, the auditory motion capture effects, confirm the multisensory nature of dynamic spatial perception and support that extent of inter-sensory capture is a function of the relative reliability of spatial information acquired by each sensory modality.
传统的多感官刺激测试通常支持视觉主导空间判断,听觉主导时间判断。在此,我们研究在表观运动方向判断中,明确的听觉空间线索是否能捕捉模糊的视觉线索。视觉运动判断包括横向运动和深度运动,每种运动都与以四种速率之一移动的听觉刺激相结合。实验1测试了与横向移动的听觉刺激相结合的横向视觉运动判断(向左与向右)。实验2测试了与声音变大或变小的听觉刺激相结合的深度视觉运动判断(接近与后退)。实验1的结果揭示并重复了整体向左运动偏差,但存在额外的听觉捕捉,即体验到视觉运动远离声音最初出现的一侧,且听觉运动速度没有影响。实验2的结果揭示并重复了接近运动偏差,但初始声音强度没有影响,且存在听觉运动速度的额外系统捕捉效应。声学强度的更快变化产生了与声学强度变化方向一致的更大视觉运动捕捉。两个实验的结果在听力设备条件(耳机与扬声器)和测试设置(实验室与基于网络的数据收集)方面具有普遍性。向左和接近运动偏差的结果重复了先前的研究。我们主要的新发现,即听觉运动捕捉效应,证实了动态空间感知的多感官性质,并支持跨感官捕捉的程度是每种感官模态获取的空间信息相对可靠性的函数。