Department of Psychology, School of Education, Soochow University, Suzhou, Jiangsu, China.
Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou, Jiangsu, China.
Psychophysiology. 2024 Mar;61(3):e14527. doi: 10.1111/psyp.14527. Epub 2024 Jan 19.
Multisensory integration and attention can interact in a way that attention to the visual constituent of a multisensory object results in an attentional spreading to its ignored auditory constituent, which can be either stimulus-driven or representation-driven depending on whether the object's visual constituent receives extra representation-based selective attention. Previous research using simple unrelated audiovisual combinations has shown that the stimulus-driven attentional spreading is contingent on audiovisual temporal simultaneity. However, little is known about whether this temporal constraint applies also to the representation-driven attentional spreading, and whether it holds for the stimulus-driven process elicited by real-life multisensory objects. The current event-related potential study investigated these questions by systematically manipulating the visual-to-auditory stimulus onset asynchrony (SOA: 0/100/300 ms) in an object-selective visual recognition task wherein the representation-driven and stimulus-driven spreading processes, measured as two distinct auditory negative difference (Nd) components, could be isolated independently. Our results showed that both the representation-driven and stimulus-driven Nds decreased as the SOA increased. Interestingly, the representation-driven Nd was completely absent, whereas the stimulus-driven Nd was still robust, when the auditory constituents were delayed by 300 ms. These findings not only indicate that the role of audiovisual simultaneity in the representation-driven attentional spreading has been underestimated, but also suggest that learned associations between the unisensory constituents of real-life objects render the stimulus-driven attentional spreading more tolerant of audiovisual asynchrony.
多感觉整合和注意力可以相互作用,注意力集中在多感觉物体的视觉成分上会导致注意力扩散到其被忽略的听觉成分上,这种注意力扩散可以是刺激驱动的,也可以是基于表征的,具体取决于物体的视觉成分是否受到额外的基于表征的选择性注意。先前使用简单无关的视听组合的研究表明,刺激驱动的注意力扩散取决于视听时间同步性。然而,对于基于表征的注意力扩散是否也受到这种时间约束,以及它是否适用于由现实生活中的多感觉物体引起的刺激驱动过程,目前知之甚少。当前的事件相关电位研究通过在一个物体选择性视觉识别任务中系统地操纵视觉到听觉的刺激起始时间差(SOA:0/100/300ms),从而调查了这些问题,在该任务中,可以独立地分离出两种不同的基于听觉负差(Nd)的成分,分别代表基于表征和刺激驱动的扩散过程。我们的研究结果表明,随着 SOA 的增加,基于表征和刺激驱动的 Nd 都减小了。有趣的是,当听觉成分延迟 300ms 时,基于表征的 Nd 完全消失,而刺激驱动的 Nd 仍然很强烈。这些发现不仅表明,视听同步在基于表征的注意力扩散中的作用被低估了,而且还表明,现实生活中物体的单一感觉成分之间的习得关联使刺激驱动的注意力扩散更能容忍视听异步性。