Iversen John R, Patel Aniruddh D, Nicodemus Brenda, Emmorey Karen
Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California, San Diego, 9500 Gilman Drive # 0559, La Jolla, CA 92093, USA.
Department of Psychology, Tufts University, 490 Boston Ave., Medford, MA 02155, USA.
Cognition. 2015 Jan;134:232-44. doi: 10.1016/j.cognition.2014.10.018. Epub 2014 Nov 19.
A striking asymmetry in human sensorimotor processing is that humans synchronize movements to rhythmic sound with far greater precision than to temporally equivalent visual stimuli (e.g., to an auditory vs. a flashing visual metronome). Traditionally, this finding is thought to reflect a fundamental difference in auditory vs. visual processing, i.e., superior temporal processing by the auditory system and/or privileged coupling between the auditory and motor systems. It is unclear whether this asymmetry is an inevitable consequence of brain organization or whether it can be modified (or even eliminated) by stimulus characteristics or by experience. With respect to stimulus characteristics, we found that a moving, colliding visual stimulus (a silent image of a bouncing ball with a distinct collision point on the floor) was able to drive synchronization nearly as accurately as sound in hearing participants. To study the role of experience, we compared synchronization to flashing metronomes in hearing and profoundly deaf individuals. Deaf individuals performed better than hearing individuals when synchronizing with visual flashes, suggesting that cross-modal plasticity enhances the ability to synchronize with temporally discrete visual stimuli. Furthermore, when deaf (but not hearing) individuals synchronized with the bouncing ball, their tapping patterns suggest that visual timing may access higher-order beat perception mechanisms for deaf individuals. These results indicate that the auditory advantage in rhythmic synchronization is more experience- and stimulus-dependent than has been previously reported.
人类感觉运动处理过程中一个显著的不对称现象是,与时间上等效的视觉刺激相比,人类能以更高的精度将动作与有节奏的声音同步(例如,与听觉节拍器相比,与闪烁的视觉节拍器同步)。传统上,这一发现被认为反映了听觉与视觉处理的根本差异,即听觉系统具有更优越的时间处理能力和/或听觉与运动系统之间存在特殊的耦合关系。目前尚不清楚这种不对称是脑组织的必然结果,还是可以通过刺激特征或经验进行改变(甚至消除)。关于刺激特征,我们发现一个移动、碰撞的视觉刺激(一个在地板上有明显碰撞点的弹跳球的无声图像)在听力正常的参与者中能够像声音一样准确地驱动同步。为了研究经验的作用,我们比较了听力正常和重度失聪个体与闪烁节拍器同步的情况。在与视觉闪光同步时,失聪个体的表现优于听力正常的个体,这表明跨模态可塑性增强了与时间上离散的视觉刺激同步的能力。此外,当失聪(而非听力正常)个体与弹跳球同步时,他们的敲击模式表明视觉计时可能会激活失聪个体的高阶节拍感知机制。这些结果表明,节奏同步中的听觉优势比之前报道的更依赖于经验和刺激。