Department of Psychology and The State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong.
Department of Psychology, University of Hawai'i at Mānoa, Hawaii, USA; Faculty of Medicine, Systems Neuroscience & Neurotechnology Unit, Saarland University & HTW Saar, Germany.
Neuroimage. 2022 Aug 15;257:119285. doi: 10.1016/j.neuroimage.2022.119285. Epub 2022 May 7.
A widely used example of the intricate (yet poorly understood) intertwining of multisensory signals in the brain is the audiovisual bounce inducing effect (ABE). This effect presents two identical objects moving along the azimuth with uniform motion and towards opposite directions. The perceptual interpretation of the motion is ambiguous and is modulated if a transient (sound) is presented in coincidence with the point of overlap of the two objects' motion trajectories. This phenomenon has long been written-off to simple attentional or decision-making mechanisms, although the neurological underpinnings for the effect are not well understood. Using behavioural metrics concurrently with event-related fMRI, we show that sound-induced modulations of motion perception can be further modulated by changing motion dynamics of the visual targets. The phenomenon engages the posterior parietal cortex and the parieto-insular-vestibular cortical complex, with a close correspondence of activity in these regions with behaviour. These findings suggest that the insular cortex is engaged in deriving a probabilistic perceptual solution through the integration of multisensory data.
大脑中多感官信号错综复杂(但理解甚少)的相互交织的一个典型例子是视听反弹诱导效应(ABE)。该效应呈现出两个相同的物体以匀速沿方位角运动并朝着相反的方向运动。如果在两个物体运动轨迹的重叠点处出现一个短暂的(声音),那么对运动的感知解释是模糊的,并会受到调制。尽管人们对该效应的神经基础了解甚少,但长期以来,人们一直将其归因于简单的注意力或决策机制。我们使用行为学指标和事件相关 fMRI 同时显示,通过改变视觉目标的运动动力学,可以进一步调节声音诱导的运动感知调制。该现象涉及后顶叶皮层和顶-岛-前庭皮质复合体,这些区域的活动与行为密切对应。这些发现表明,通过整合多感官数据,脑岛皮层参与了得出概率性感知解决方案的过程。