Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands.
PLoS One. 2018 Aug 20;13(8):e0202414. doi: 10.1371/journal.pone.0202414. eCollection 2018.
The retinal location of visual information changes each time we move our eyes. Although it is now known that visual information is remapped in retinotopic coordinates across eye-movements (saccades), it is currently unclear how head-centered auditory information is remapped across saccades. Keeping track of the location of a sound source in retinotopic coordinates requires a rapid multi-modal reference frame transformation when making saccades. To reveal this reference frame transformation, we designed an experiment where participants attended an auditory or visual cue and executed a saccade. After the saccade had landed, an auditory or visual target could be presented either at the prior retinotopic location or at an uncued location. We observed that both auditory and visual targets presented at prior retinotopic locations were reacted to faster than targets at other locations. In a second experiment, we observed that spatial attention pointers obtained via audition are available in retinotopic coordinates immediately after an eye-movement is made. In a third experiment, we found evidence for an asymmetric cross-modal facilitation of information that is presented at the retinotopic location. In line with prior single cell recording studies, this study provides the first behavioral evidence for immediate auditory and cross-modal transsaccadic updating of spatial attention. These results indicate that our brain has efficient solutions for solving the challenges in localizing sensory input that arise in a dynamic context.
每次我们移动眼睛,视觉信息在视网膜上的位置都会发生变化。虽然现在已经知道在眼球运动(扫视)过程中视觉信息会在视网膜拓扑坐标中重新映射,但目前尚不清楚头相关的听觉信息如何在扫视过程中重新映射。在进行扫视时,要在视网膜拓扑坐标中跟踪声源的位置,需要快速进行多模态参考系变换。为了揭示这种参考系变换,我们设计了一个实验,参与者注意听或看一个提示,并执行扫视。扫视完成后,可以在先前的视网膜位置或未提示的位置呈现听觉或视觉目标。我们观察到,与其他位置相比,在先前的视网膜位置呈现的听觉和视觉目标的反应速度更快。在第二个实验中,我们观察到,通过听觉获得的空间注意指针在眼球运动后立即在视网膜拓扑坐标中可用。在第三个实验中,我们发现了在视网膜位置呈现的信息的跨模态不对称促进的证据。与之前的单细胞记录研究一致,这项研究为听觉和跨模态扫视间的空间注意即时更新提供了首个行为证据。这些结果表明,我们的大脑有有效的解决方案,可以解决在动态环境中定位感官输入所带来的挑战。