MRC Cognition and Brain Sciences Unit, Cambridge, UK.
Neuroimage. 2011 Jan 15;54(2):1231-43. doi: 10.1016/j.neuroimage.2010.09.033. Epub 2010 Sep 19.
How we measure time and integrate temporal cues from different sensory modalities are fundamental questions in neuroscience. Sensitivity to a "beat" (such as that routinely perceived in music) differs substantially between auditory and visual modalities. Here we examined beat sensitivity in each modality, and examined cross-modal influences, using functional magnetic resonance imaging (fMRI) to characterize brain activity during perception of auditory and visual rhythms. In separate fMRI sessions, participants listened to auditory sequences or watched visual sequences. The order of auditory and visual sequence presentation was counterbalanced so that cross-modal order effects could be investigated. Participants judged whether sequences were speeding up or slowing down, and the pattern of tempo judgments was used to derive a measure of sensitivity to an implied beat. As expected, participants were less sensitive to an implied beat in visual sequences than in auditory sequences. However, visual sequences produced a stronger sense of beat when preceded by auditory sequences with identical temporal structure. Moreover, increases in brain activity were observed in the bilateral putamen for visual sequences preceded by auditory sequences when compared to visual sequences without prior auditory exposure. No such order-dependent differences (behavioral or neural) were found for the auditory sequences. The results provide further evidence for the role of the basal ganglia in internal generation of the beat and suggest that an internal auditory rhythm representation may be activated during visual rhythm perception.
我们如何衡量时间并整合来自不同感觉模态的时间线索是神经科学中的基本问题。对“拍子”(例如在音乐中常规感知到的拍子)的敏感性在听觉和视觉模态之间有很大的不同。在这里,我们使用功能磁共振成像(fMRI)来研究每种模态的拍子敏感性,并研究跨模态的影响,以描述在感知听觉和视觉节奏时大脑的活动。在单独的 fMRI 会话中,参与者听了听觉序列或观看了视觉序列。听觉和视觉序列的呈现顺序是平衡的,以便可以研究跨模态的顺序效应。参与者判断序列是在加速还是减速,并且可以根据节奏判断的模式得出对暗示拍子的敏感性的度量。正如预期的那样,与听觉序列相比,参与者对视觉序列中的暗示拍子的敏感性较低。但是,当具有相同时间结构的听觉序列先于视觉序列时,视觉序列会产生更强的拍子感。此外,与没有先前听觉暴露的视觉序列相比,当视觉序列先于听觉序列时,双侧壳核的大脑活动增加。对于听觉序列,没有发现这种依赖于顺序的差异(行为或神经)。结果为基底神经节在拍子的内部产生中所起的作用提供了进一步的证据,并表明在视觉节奏感知期间可能会激活内部听觉节奏表示。