Kayser Stephanie J, Philiastides Marios G, Kayser Christoph
Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK.
Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK.
Neuroimage. 2017 Mar 1;148:31-41. doi: 10.1016/j.neuroimage.2017.01.010. Epub 2017 Jan 8.
Sensory discriminations, such as judgements about visual motion, often benefit from multisensory evidence. Despite many reports of enhanced brain activity during multisensory conditions, it remains unclear which dynamic processes implement the multisensory benefit for an upcoming decision in the human brain. Specifically, it remains difficult to attribute perceptual benefits to specific processes, such as early sensory encoding, the transformation of sensory representations into a motor response, or to more unspecific processes such as attention. We combined an audio-visual motion discrimination task with the single-trial mapping of dynamic sensory representations in EEG activity to localize when and where multisensory congruency facilitates perceptual accuracy. Our results show that a congruent sound facilitates the encoding of motion direction in occipital sensory - as opposed to parieto-frontal - cortices, and facilitates later - as opposed to early (i.e. below 100ms) - sensory activations. This multisensory enhancement was visible as an earlier rise of motion-sensitive activity in middle-occipital regions about 350ms from stimulus onset, which reflected the better discriminability of motion direction from brain activity and correlated with the perceptual benefit provided by congruent multisensory information. This supports a hierarchical model of multisensory integration in which the enhancement of relevant sensory cortical representations is transformed into a more accurate choice.
感官辨别,例如对视觉运动的判断,通常受益于多感官证据。尽管有许多关于多感官条件下大脑活动增强的报道,但尚不清楚哪些动态过程为人类大脑中即将做出的决策实现了多感官益处。具体而言,仍然难以将感知益处归因于特定过程,例如早期感官编码、将感官表征转化为运动反应,或者归因于更不特定的过程,如注意力。我们将视听运动辨别任务与脑电图活动中动态感官表征的单次试验映射相结合,以确定多感官一致性在何时何地促进感知准确性。我们的结果表明,一致的声音促进了枕叶感觉皮层(而非顶叶-额叶皮层)中运动方向的编码,并促进了后期(而非早期,即低于100毫秒)的感官激活。这种多感官增强表现为中枕叶区域中运动敏感活动从刺激开始约350毫秒时更早的上升,这反映了从大脑活动中对运动方向更好的辨别能力,并且与一致的多感官信息提供的感知益处相关。这支持了一种多感官整合的层次模型,其中相关感官皮层表征的增强被转化为更准确的选择。