Department of Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden.
Curr Biol. 2013 Jul 22;23(14):1367-72. doi: 10.1016/j.cub.2013.06.012. Epub 2013 Jun 27.
Multisensory interactions are the norm in perception, and an abundance of research on the interaction and integration of the senses has demonstrated the importance of combining sensory information from different modalities on our perception of the external world. However, although research on mental imagery has revealed a great deal of functional and neuroanatomical overlap between imagery and perception, this line of research has primarily focused on similarities within a particular modality and has yet to address whether imagery is capable of leading to multisensory integration. Here, we devised novel versions of classic multisensory paradigms to systematically examine whether imagery is capable of integrating with perceptual stimuli to induce multisensory illusions. We found that imagining an auditory stimulus at the moment two moving objects met promoted an illusory bounce percept, as in the classic cross-bounce illusion; an imagined visual stimulus led to the translocation of sound toward the imagined stimulus, as in the classic ventriloquist illusion; and auditory imagery of speech stimuli led to a promotion of an illusory speech percept in a modified version of the McGurk illusion. Our findings provide support for perceptually based theories of imagery and suggest that neuronal signals produced by imagined stimuli can integrate with signals generated by real stimuli of a different sensory modality to create robust multisensory percepts. These findings advance our understanding of the relationship between imagery and perception and provide new opportunities for investigating how the brain distinguishes between endogenous and exogenous sensory events.
多感觉交互是感知的常态,大量关于感觉交互和整合的研究表明,将不同感觉模式的感觉信息结合起来对我们对外界世界的感知是很重要的。然而,尽管心理意象研究揭示了意象和感知之间存在大量的功能和神经解剖学重叠,但这一研究主要集中在特定感觉模式内的相似性上,尚未解决意象是否能够导致多感觉整合。在这里,我们设计了经典多感觉范式的新颖版本,系统地研究了意象是否能够与感知刺激整合,从而产生多感觉错觉。我们发现,当两个移动的物体相遇时,想象一个听觉刺激会促进一个虚幻的反弹感知,就像经典的交叉反弹错觉一样;想象一个视觉刺激会导致声音向想象中的刺激转移,就像经典的腹语错觉一样;听觉想象言语刺激会在 McGurk 错觉的一个修正版本中促进一个虚幻的言语感知。我们的发现为基于感知的意象理论提供了支持,并表明想象刺激产生的神经元信号可以与不同感觉模式的真实刺激产生的信号整合,从而产生强大的多感觉感知。这些发现推进了我们对意象和感知之间关系的理解,并为研究大脑如何区分内源性和外源性感觉事件提供了新的机会。