The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia.
Psychological Neuroscience Lab, Center for Investigation in Psychology, University of Minho, Rua da Universidade, 4710-057, Braga, Portugal.
Exp Brain Res. 2023 Mar;241(3):875-887. doi: 10.1007/s00221-023-06569-x. Epub 2023 Feb 14.
Human movement synchronisation with moving objects strongly relies on visual input. However, auditory information also plays an important role, since real environments are intrinsically multimodal. We used electroencephalography (EEG) frequency tagging to investigate the selective neural processing and integration of visual and auditory information during motor tracking and tested the effects of spatial and temporal congruency between audiovisual modalities. EEG was recorded while participants tracked with their index finger a red flickering (rate f = 15 Hz) dot oscillating horizontally on a screen. The simultaneous auditory stimulus was modulated in pitch (rate f = 32 Hz) and lateralised between left and right audio channels to induce perception of a periodic displacement of the sound source. Audiovisual congruency was manipulated in terms of space in Experiment 1 (no motion, same direction or opposite direction), and timing in Experiment 2 (no delay, medium delay or large delay). For both experiments, significant EEG responses were elicited at f and f tagging frequencies. It was also hypothesised that intermodulation products corresponding to the nonlinear integration of visual and auditory stimuli at frequencies f ± f would be elicited, due to audiovisual integration, especially in Congruent conditions However, these components were not observed. Moreover, synchronisation and EEG results were not influenced by congruency manipulations, which invites further exploration of the conditions which may modulate audiovisual processing and the motor tracking of moving objects.
人类与移动物体的运动同步强烈依赖于视觉输入。然而，听觉信息也起着重要的作用，因为真实环境本质上是多模态的。我们使用脑电图 (EEG) 频率标记来研究运动跟踪过程中视觉和听觉信息的选择性神经处理和整合，并测试了视听模式之间的空间和时间一致性的影响。当参与者用食指跟踪屏幕上水平振荡的红色闪烁点（频率 f = 15 Hz）时，记录 EEG。同时，听觉刺激在音高（频率 f = 32 Hz）上进行调制，并在左右音频通道之间进行侧化，以引起声源周期性位移的感知。在实验 1 中，根据空间（无运动、相同方向或相反方向）操纵视听一致性，在实验 2 中根据时间（无延迟、中等延迟或大延迟）操纵视听一致性。对于这两个实验，在 f 和 f 标记频率处都引出了显著的 EEG 反应。还假设由于视听整合，会引出对应于视觉和听觉刺激在频率 f ± f 处非线性整合的互调产物，特别是在一致条件下。然而，这些成分没有被观察到。此外，同步和 EEG 结果不受一致性操纵的影响，这邀请进一步探索可能调节视听处理和移动对象的运动跟踪的条件。
