Brain Imaging and Modeling Section, National Institute on Deafness and other Communication Disorders, National Institutes of Health, Bethesda, MD 20892, United States.
Behav Brain Res. 2013 Feb 1;238:265-72. doi: 10.1016/j.bbr.2012.10.011. Epub 2012 Oct 18.
Crossmodal associations form a fundamental aspect of our daily lives. In this study we investigated the neural correlates of crossmodal association in early sensory cortices using magnetoencephalography (MEG). We used a paired associate recognition paradigm in which subjects were tested after multiple training sessions over a span of four weeks. Subjects had to learn 12 abstract, nonlinguistic, pairs of auditory and visual objects that consisted of crossmodal (visual-auditory, VA; auditory-visual, AV) and unimodal (visual-visual, VV; auditory-auditory, AA) paired items. Visual objects included abstract, non-nameable, fractal-like images, and auditory objects included abstract tone sequences. During scanning, subjects were shown the first item of a pair (S1), followed by a delay, then the simultaneous presentation of a visual and auditory stimulus (S2). Subjects were instructed to indicate whether either of the S2 stimuli contained the correct paired associate of S1. Synthetic aperture magnetometry (SAMspm), a minimum variance beamformer, was then used to assess source power differences between the crossmodal conditions and their corresponding unimodal conditions (i.e., AV-AA and VA-VV) in the beta (15-30 Hz) and low gamma frequencies (31-54 Hz) during the S1 period. We found greater power during S1 in the corresponding modality-specific association areas for crossmodal compared with unimodal stimuli. Thus, even in the absence of explicit sensory input, the retrieval of well-learned, crossmodal pairs activate sensory areas associated with the corresponding modality. These findings support theories which posit that modality-specific regions of cortex are involved in the storage and retrieval of sensory-specific items from long-term memory.
跨模态联想是我们日常生活的基本组成部分。在这项研究中,我们使用脑磁图(MEG)研究了早期感觉皮层中跨模态联想的神经关联。我们使用了配对联想识别范式,其中在四周的时间内进行多次训练后对被试进行测试。被试必须学习 12 对抽象的、非语言的听觉和视觉对象的对,这些对包括跨模态(视觉-听觉、VA;听觉-视觉、AV)和单模态(视觉-视觉、VV;听觉-听觉、AA)对。视觉对象包括抽象的、不可命名的、类分形的图像,而听觉对象包括抽象的音调序列。在扫描过程中,向被试呈现对的第一个项目(S1),然后是延迟,然后同时呈现视觉和听觉刺激(S2)。被试被指示指示 S2 刺激中是否包含 S1 的正确配对联想。合成孔径磁强计(SAMspm),一种最小方差波束形成器,然后用于评估 S1 期间跨模态条件与其相应的单模态条件(即 AV-AA 和 VA-VV)之间的源功率差异在β(15-30 Hz)和低伽马频率(31-54 Hz)。我们发现,与单模态刺激相比,跨模态刺激在相应的模态特异性联想区域的 S1 期间具有更大的功率。因此,即使没有明确的感觉输入,检索经过充分学习的跨模态对也会激活与相应模态相关的感觉区域。这些发现支持了这样一种理论,即皮质的模态特异性区域参与从长期记忆中存储和检索感觉特异性项目。