Molholm Sophie, Ritter Walter, Javitt Daniel C, Foxe John J
Cognitive Neurophysiology Laboratory, Program in Cognitive Neuroscience and Schizophrenia, Nathan S. Kline Institute for Psychiatric Research, 140 Old Orangeburg Road, Orangeburg, NY 10962, USA.
Cereb Cortex. 2004 Apr;14(4):452-65. doi: 10.1093/cercor/bhh007.
Multisensory object-recognition processes were investigated by examining the combined influence of visual and auditory inputs upon object identification--in this case, pictures and vocalizations of animals. Behaviorally, subjects were significantly faster and more accurate at identifying targets when the picture and vocalization were matched (i.e. from the same animal), than when the target was represented in only one sensory modality. This behavioral enhancement was accompanied by a modulation of the evoked potential in the latency range and general topographic region of the visual evoked N1 component, which is associated with early feature processing in the ventral visual stream. High-density topographic mapping and dipole modeling of this multisensory effect were consistent with generators in lateral occipito-temporal cortices, suggesting that auditory inputs were modulating processing in regions of the lateral occipital cortices. Both the timing and scalp topography of this modulation suggests that there are multisensory effects during what is considered to be a relatively early stage of visual object-recognition processes, and that this modulation occurs in regions of the visual system that have traditionally been held to be unisensory processing areas. Multisensory inputs also modulated the visual 'selection-negativity', an attention dependent component of the evoked potential this is usually evoked when subjects selectively attend to a particular feature of a visual stimulus.
通过研究视觉和听觉输入对物体识别的综合影响，对多感官物体识别过程进行了调查——在本研究中，是动物的图片和叫声。在行为上，当图片和叫声匹配时（即来自同一种动物），与仅以一种感官模式呈现目标相比，受试者识别目标的速度明显更快且更准确。这种行为增强伴随着视觉诱发N1成分的潜伏期范围和总体地形区域中诱发电位的调制，该成分与腹侧视觉流中的早期特征处理相关。这种多感官效应的高密度地形图绘制和偶极子建模与枕颞外侧皮质中的发生器一致，表明听觉输入正在调节枕颞外侧皮质区域的处理。这种调制的时间和头皮地形图都表明，在被认为是视觉物体识别过程相对早期阶段存在多感官效应，并且这种调制发生在传统上被认为是单感官处理区域的视觉系统区域。多感官输入还调制了视觉“选择负波”，这是诱发电位的一个注意力依赖成分，通常在受试者选择性地关注视觉刺激的特定特征时诱发。
