Kaya Utku, Kafaligonul Hulusi
National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey.
Informatics Institute, Middle East Technical University, Ankara, Turkey.
Psychophysiology. 2021 Apr;58(4):e13777. doi: 10.1111/psyp.13777. Epub 2021 Jan 22.
The integration of information from different senses is central to our perception of the external world. Audiovisual interactions have been particularly well studied in this context and various illusions have been developed to demonstrate strong influences of these interactions on the final percept. Using audiovisual paradigms, previous studies have shown that even task-irrelevant information provided by a secondary modality can change the detection and discrimination of a primary target. These modulations have been found to be significantly dependent on the relative timing between auditory and visual stimuli. Although these interactions in time have been commonly reported, we have still limited understanding of the relationship between the modulations of event-related potentials (ERPs) and final behavioral performance. Here, we aimed to shed light on this important issue by using a speeded discrimination paradigm combined with electroencephalogram (EEG). During the experimental sessions, the timing between an auditory click and a visual flash was varied over a wide range of stimulus onset asynchronies and observers were engaged in speeded discrimination of flash location. Behavioral reaction times were significantly changed by click timing. Furthermore, the modulations of evoked activities over medial parietal/parieto-occipital electrodes were associated with this effect. These modulations were within the 126-176 ms time range and more importantly, they were also correlated with the changes in reaction times. These results provide an important functional link between audiovisual interactions at early stages of sensory processing and reaction times. Together with previous research, they further suggest that early crossmodal interactions play a critical role in perceptual performance.
整合来自不同感官的信息对于我们对外界的感知至关重要。在这一背景下,视听交互得到了特别深入的研究,并且已经开发出各种错觉来证明这些交互对最终感知的强大影响。使用视听范式,先前的研究表明,即使是由次要模态提供的与任务无关的信息也可以改变对主要目标的检测和辨别。已发现这些调制显著依赖于听觉和视觉刺激之间的相对时间。尽管这些时间上的交互已被普遍报道,但我们对事件相关电位(ERP)调制与最终行为表现之间的关系仍了解有限。在此,我们旨在通过使用结合脑电图(EEG)的快速辨别范式来阐明这一重要问题。在实验过程中,听觉咔哒声和视觉闪光之间的时间在广泛的刺激起始异步范围内变化,观察者参与对闪光位置的快速辨别。行为反应时间因咔哒声时间而显著改变。此外,内侧顶叶/顶枕电极上诱发活动的调制与这种效应相关。这些调制在126 - 176毫秒的时间范围内,更重要的是,它们也与反应时间的变化相关。这些结果在感觉处理的早期阶段的视听交互与反应时间之间提供了重要的功能联系。与先前的研究一起,它们进一步表明早期跨模态交互在感知表现中起关键作用。