Bruns Patrick, Maiworm Mario, Röder Brigitte
Biological Psychology and Neuropsychology, University of Hamburg, Von-Melle-Park 11, 20146, Hamburg, Germany,
Atten Percept Psychophys. 2014 Aug;76(6):1815-27. doi: 10.3758/s13414-014-0699-y.
In order to determine the spatial location of an object that is simultaneously seen and heard, the brain assigns higher weights to the sensory inputs that provide the most reliable information. For example, in the well-known ventriloquism effect, the perceived location of a sound is shifted toward the location of a concurrent but spatially misaligned visual stimulus. This perceptual illusion can be explained by the usually much higher spatial resolution of the visual system as compared to the auditory system. Recently, it has been demonstrated that this cross-modal binding process is not fully automatic, but can be modulated by emotional learning. Here we tested whether cross-modal binding is similarly affected by motivational factors, as exemplified by reward expectancy. Participants received a monetary reward for precise and accurate localization of brief auditory stimuli. Auditory stimuli were accompanied by task-irrelevant, spatially misaligned visual stimuli. Thus, the participants' motivational goal of maximizing their reward was put in conflict with the spatial bias of auditory localization induced by the ventriloquist situation. Crucially, the amounts of expected reward differed between the two hemifields. As compared to the hemifield associated with a low reward, the ventriloquism effect was reduced in the high-reward hemifield. This finding suggests that reward expectations modulate cross-modal binding processes, possibly mediated via cognitive control mechanisms. The motivational significance of the stimulus material, thus, constitutes an important factor that needs to be considered in the study of top-down influences on multisensory integration.
为了确定一个同时被看到和听到的物体的空间位置,大脑会给提供最可靠信息的感觉输入赋予更高的权重。例如,在著名的腹语效应中,声音的感知位置会朝着同时出现但空间上错位的视觉刺激的位置偏移。这种感知错觉可以用视觉系统通常比听觉系统高得多的空间分辨率来解释。最近,已经证明这种跨模态绑定过程不是完全自动的,而是可以通过情感学习来调节。在这里,我们测试了跨模态绑定是否同样受到动机因素的影响,以奖励预期为例。参与者因准确精确地定位短暂的听觉刺激而获得金钱奖励。听觉刺激伴随着与任务无关的、空间上错位的视觉刺激。因此,参与者最大化奖励的动机目标与腹语情境引起的听觉定位的空间偏差相冲突。至关重要的是,两个半视野的预期奖励量不同。与与低奖励相关的半视野相比,高奖励半视野中的腹语效应有所降低。这一发现表明,奖励预期会调节跨模态绑定过程,可能是通过认知控制机制介导的。因此,刺激材料的动机意义构成了在研究自上而下对多感官整合的影响时需要考虑的一个重要因素。