Center for Cognitive Neuroscience, Duke University, Box 90999, Durham, NC 27708-0999, USA.
J Cogn Neurosci. 2013 Apr;25(4):623-35. doi: 10.1162/jocn_a_00336. Epub 2012 Dec 18.
Neuroimaging work on multisensory conflict suggests that the relevant modality receives enhanced processing in the face of incongruency. However, the degree of stimulus processing in the irrelevant modality and the temporal cascade of the attentional modulations in either the relevant or irrelevant modalities are unknown. Here, we employed an audiovisual conflict paradigm with a sensory probe in the task-irrelevant modality (vision) to gauge the attentional allocation to that modality. ERPs were recorded as participants attended to and discriminated spoken auditory letters while ignoring simultaneous bilateral visual letter stimuli that were either fully congruent, fully incongruent, or partially incongruent (one side incongruent, one congruent) with the auditory stimulation. Half of the audiovisual letter stimuli were followed 500-700 msec later by a bilateral visual probe stimulus. As expected, ERPs to the audiovisual stimuli showed an incongruency ERP effect (fully incongruent versus fully congruent) of an enhanced, centrally distributed, negative-polarity wave starting ∼250 msec. More critically here, the sensory ERP components to the visual probes were larger when they followed fully incongruent versus fully congruent multisensory stimuli, with these enhancements greatest on fully incongruent trials with the slowest RTs. In addition, on the slowest-response partially incongruent trials, the P2 sensory component to the visual probes was larger contralateral to the preceding incongruent visual stimulus. These data suggest that, in response to conflicting multisensory stimulus input, the initial cognitive effect is a capture of attention by the incongruent irrelevant-modality input, pulling neural processing resources toward that modality, resulting in rapid enhancement, rather than rapid suppression, of that input.
神经影像学对多感觉冲突的研究表明,在不一致的情况下,相关模式会受到增强的处理。然而,在无关模式中刺激处理的程度以及相关或无关模式中注意力调节的时间级联尚不清楚。在这里,我们采用了一种视听冲突范式,在任务无关的模式(视觉)中使用感官探针来衡量对该模式的注意力分配。当参与者专注于并辨别听觉字母时,记录了 ERPs,同时忽略了同时呈现的双侧视觉字母刺激,这些刺激与听觉刺激完全一致、完全不一致或部分不一致(一侧不一致,一侧一致)。一半的视听字母刺激在 500-700 毫秒后会出现双侧视觉探测刺激。正如预期的那样,视听刺激的 ERP 显示出不一致的 ERP 效应(完全不一致与完全一致),即增强的、中央分布的负极性波,起始于约 250 毫秒。更关键的是,当视觉探测刺激紧随完全不一致的多感觉刺激时,对视觉探测刺激的感觉 ERP 成分会更大,当反应最慢的完全不一致试验中的反应时最长时,这些增强作用最大。此外,在最慢反应的部分不一致试验中,视觉探测刺激的 P2 感觉成分在与先前不一致的视觉刺激相对的一侧更大。这些数据表明,在对冲突的多感觉刺激输入做出反应时,最初的认知效应是由不一致的无关模式输入引起的注意力捕获,将神经处理资源吸引到该模式,导致对该输入的快速增强,而不是快速抑制。