Chang Yu-Hsin Fiona, Ullén Fredrik, de Manzano Örjan
Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt, Germany.
Department of Neuroscience, Karolinska Institutet, Stockholm, Sweden.
Sci Rep. 2025 May 12;15(1):16492. doi: 10.1038/s41598-025-00208-x.
An important feature of human cognition is the ability to predict sensory outcomes of motor actions and infer actions from sensory information - a process enabled by action-perception coupling. Through repeated and consistent sensory feedback, bidirectional sensorimotor associations can become highly automatic with experience. In musicians, for instance, auditory cortex activity can increase spontaneously even when observing piano playing without auditory feedback. A key question is whether such associations rely on shared neural representations, or a "common code", between actions and their sensory outcomes. To test this, we trained non-musicians to play two melodies with different pitch sequences on the piano. The following day, they underwent an fMRI experiment with an MR-compatible piano while (a) playing the trained melodies without auditory feedback but imagining the sound, and (b) listening to the same melodies without playing but imagining the finger movements. Within-condition multivariate pattern analyses revealed that patterns of activity in auditory-motor regions represent pitch sequences. Importantly, cross-modal classification showed that these patterns generalized across conditions in the right premotor cortex, indicating the emergence of a common code across perception and action.
人类认知的一个重要特征是能够预测运动行为的感官结果,并从感官信息中推断行为——这一过程由动作-感知耦合实现。通过反复且一致的感官反馈,双向感觉运动关联会随着经验变得高度自动化。例如,在音乐家身上,即使在没有听觉反馈的情况下观察钢琴演奏,听觉皮层活动也会自发增加。一个关键问题是,这种关联是否依赖于动作及其感官结果之间共享的神经表征,即“通用编码”。为了验证这一点,我们训练非音乐家在钢琴上弹奏两首具有不同音高序列的旋律。第二天,他们在使用与磁共振兼容的钢琴进行功能磁共振成像(fMRI)实验时,(a)在没有听觉反馈但想象声音的情况下弹奏训练过的旋律,以及(b)在不弹奏但想象手指动作的情况下聆听相同的旋律。条件内多变量模式分析表明,听觉运动区域中的活动模式代表音高序列。重要的是,跨模态分类显示,这些模式在右侧运动前皮层的不同条件下具有普遍性,表明在感知和动作之间出现了通用编码。