Navarra Jordi, Hartcher-O'Brien Jessica, Piazza Elise, Spence Charles
Fundació Sant Joan de Déu, Hospital de Sant Joan de Déu-Serveis de Salut Mental, Esplugues de Llobregat, Barcelona, Spain.
Proc Natl Acad Sci U S A. 2009 Jun 9;106(23):9169-73. doi: 10.1073/pnas.0810486106. Epub 2009 May 20.
The brain adapts to asynchronous audiovisual signals by reducing the subjective temporal lag between them. However, it is currently unclear which sensory signal (visual or auditory) shifts toward the other. According to the idea that the auditory system codes temporal information more precisely than the visual system, one should expect to find some temporal shift of vision toward audition (as in the temporal ventriloquism effect) as a result of adaptation to asynchronous audiovisual signals. Given that visual information gives a more exact estimate of the time of occurrence of distal events than auditory information (due to the fact that the time of arrival of visual information regarding an external event is always closer to the time at which this event occurred), the opposite result could also be expected. Here, we demonstrate that participants' speeded reaction times (RTs) to auditory (but, critically, not visual) stimuli are altered following adaptation to asynchronous audiovisual stimuli. After receiving "baseline" exposure to synchrony, participants were exposed either to auditory-lagging asynchrony (VA group) or to auditory-leading asynchrony (AV group). The results revealed that RTs to sounds became progressively faster (in the VA group) or slower (in the AV group) as participants' exposure to asynchrony increased, thus providing empirical evidence that speeded responses to sounds are influenced by exposure to audiovisual asynchrony.
大脑通过减少异步视听信号之间的主观时间延迟来适应它们。然而,目前尚不清楚哪种感觉信号(视觉或听觉)会向另一种信号偏移。根据听觉系统比视觉系统更精确地编码时间信息这一观点,人们应该预期,由于对异步视听信号的适应,会发现视觉向听觉有某种时间上的偏移(如在时间腹语效应中)。鉴于视觉信息比听觉信息能更准确地估计远端事件发生的时间(因为关于外部事件的视觉信息到达时间总是更接近该事件发生的时间),也可能会得到相反的结果。在这里,我们证明,在适应异步视听刺激后,参与者对听觉(但关键的是,不是视觉)刺激的快速反应时间(RTs)会发生改变。在接受同步的“基线”暴露后,参与者要么暴露于听觉滞后的异步情况(VA组),要么暴露于听觉领先的异步情况(AV组)。结果显示,随着参与者对异步情况的暴露增加,对声音的反应时间在VA组中逐渐变快,在AV组中逐渐变慢,从而提供了经验证据,表明对声音的快速反应受到视听异步暴露的影响。