Fundació Sant Joan de Déu, Hospital de Sant Joan de Déu, Spain; Crossmodal Research Laboratory, Department of Experimental Psychology, University of Oxford, UK.
Brain Res. 2010 Apr 6;1323:84-93. doi: 10.1016/j.brainres.2010.01.059. Epub 2010 Feb 1.
To what extent does our prior experience with the correspondence between audiovisual stimuli influence how we subsequently bind them? We addressed this question by testing English and Spanish speakers (having little prior experience of Spanish and English, respectively) on a crossmodal simultaneity judgment (SJ) task with English or Spanish spoken sentences. The results revealed that the visual speech stream had to lead the auditory speech stream by a significantly larger interval in the participants' native language than in the non-native language for simultaneity to be perceived. Critically, the difference in temporal processing between perceiving native vs. non-native language tends to disappear as the amount of experience with the non-native language increases. We propose that this modulation of multisensory temporal processing as a function of prior experience is a consequence of the constraining role that visual information plays in the temporal alignment of audiovisual speech signals.
我们先前对视听刺激对应关系的经验在多大程度上影响了我们随后对它们的整合？我们通过让英语和西班牙语使用者（分别对西班牙语和英语几乎没有先前的经验）在一个跨模态同时性判断（SJ）任务中测试英语或西班牙语的句子来回答这个问题。结果表明，对于同时性感知，参与者的母语中的视觉言语流必须比非母语中领先听觉言语流一个明显更大的间隔。关键的是，随着对非母语语言经验的增加，感知母语与非母语语言之间的时间处理差异趋于消失。我们提出，这种作为先前经验的函数的多感觉时间处理的调制是视觉信息在视听言语信号的时间对准中起约束作用的结果。
