Hocking Julia, Price Cathy J
Wellcome Trust Centre for Neuroimaging, UCL, London, UK.
Brain Lang. 2009 Feb;108(2):89-96. doi: 10.1016/j.bandl.2008.10.005. Epub 2008 Dec 19.
This fMRI study investigates how audiovisual integration differs for verbal stimuli that can be matched at a phonological level and nonverbal stimuli that can be matched at a semantic level. Subjects were presented simultaneously with one visual and one auditory stimulus and were instructed to decide whether these stimuli referred to the same object or not. Verbal stimuli were simultaneously presented spoken and written object names, and nonverbal stimuli were photographs of objects simultaneously presented with naturally occurring object sounds. Stimulus differences were controlled by including two further conditions that paired photographs of objects with spoken words and object sounds with written words. Verbal matching, relative to all other conditions, increased activation in a region of the left superior temporal sulcus that has previously been associated with phonological processing. Nonverbal matching, relative to all other conditions, increased activation in a right fusiform region that has previously been associated with structural and conceptual object processing. Thus, we demonstrate how brain activation for audiovisual integration depends on the verbal content of the stimuli, even when stimulus and task processing differences are controlled.
这项功能磁共振成像（fMRI）研究调查了对于可在语音层面匹配的言语刺激和可在语义层面匹配的非言语刺激，视听整合是如何不同的。向受试者同时呈现一个视觉刺激和一个听觉刺激，并指示他们判断这些刺激是否指代同一物体。言语刺激是同时呈现的口语和书面物体名称，非言语刺激是物体照片与自然物体声音同时呈现。通过纳入另外两个条件来控制刺激差异，这两个条件将物体照片与口语单词配对，以及将物体声音与书面单词配对。相对于所有其他条件，言语匹配增加了左颞上沟区域的激活，该区域先前已与语音处理相关联。相对于所有其他条件，非言语匹配增加了右梭状回区域的激活，该区域先前已与物体的结构和概念处理相关联。因此，我们证明了即使在控制了刺激和任务处理差异的情况下，视听整合的大脑激活如何取决于刺激的言语内容。
