Department of Computer Science and Technology, Tsinghua University, Beijing 100084, PR China.
Neuroscience. 2012 Oct 25;223:21-7. doi: 10.1016/j.neuroscience.2012.06.009. Epub 2012 Jun 12.
In the present study, we aimed to identify whether cross-modal priming effect based on short-term experience of ecologically unrelated audio-visual information existed. In the experiment, we employed ecologically unrelated pictures and sounds as visual and auditory stimuli. Participants were required to learn the associations between pictures and sounds in the study phase, and then finished the following experiment adopting a cross-modal priming paradigm. The result showed that the processing of sound was facilitated by a priming picture if an audio-visual pair was presented in the study phase. Enhanced induced gamma-band activity (GBA) was also found under the Match condition, and we suggested that induced GBA reflected the association between auditory and visual information to form supra-modal representation, which is top-down modulated by short-term experience of audio-visual information. Event-related potential (ERP) analysis revealed an N400 effect under the Mismatch condition compared to the Match condition, and source reconstruction of N400 effect showed that the biggest difference of activity between two conditions was localized in middle temporal gyrus (MTG), suggesting that MTG played an important role in the mapping process of auditory information onto a temporal semantic network.
在本研究中，我们旨在确定是否存在基于短期生态无关的视听信息经验的跨模态启动效应。在实验中，我们采用生态无关的图片和声音作为视觉和听觉刺激。参与者在学习阶段被要求学习图片和声音之间的关联，然后采用跨模态启动范式完成以下实验。结果表明，如果在学习阶段呈现视听对，则声音的处理会受到启动图片的促进。在匹配条件下也发现了增强的诱导γ 波段活动（GBA），我们认为诱导的 GBA 反映了听觉和视觉信息之间的关联，以形成超模态表示，该表示受到视听信息短期经验的自上而下调制。事件相关电位（ERP）分析显示，与匹配条件相比，在不匹配条件下出现 N400 效应，并且 N400 效应的源重建表明，两种条件之间活动的最大差异定位于颞中回（MTG），表明 MTG 在听觉信息映射到时间语义网络的过程中起着重要作用。
