Doctoral Program in Neurobiology and Behavior, Columbia University, New York 10027, New York
Department of Neuroscience, Columbia University, New York 10027, New York.
J Neurosci. 2022 May 4;42(18):3847-3855. doi: 10.1523/JNEUROSCI.1771-21.2022. Epub 2022 Mar 29.
Although the cerebellum has been traditionally considered to be exclusively involved in motor control, recent anatomic and clinical studies show that it also has a role in reward-processing. However, the way in which the movement-related and the reward-related neural activity interact at the level of the cerebellar cortex and contribute toward learning is still unclear. Here, we studied the simple spike activity of Purkinje cells in the mid-lateral cerebellum when 2 male monkeys learned to associate a right or left-hand movement with one of two visual symbolic cues. These cells had distinctly different discharge patterns between an overtrained symbol-hand association and a novel symbol-hand association, responding in association with the movement of both hands, although the kinematics of the movement did not change between the two conditions. The activity change was not related to the pattern of the visual symbols, the movement kinematics, the monkeys' reaction times, or the novelty of the visual symbols. The simple spike activity changed throughout the learning process, but the concurrent complex spikes did not instruct that change. Although these neurons also have reward-related activity, the reward-related and movement-related signals were independent. We suggest that this mixed selectivity may facilitate the flexible learning of difficult reinforcement learning problems. The cerebellum receives both motor-related and reward-related information. However, it is unclear how these two signals interact at the level of cerebellar cortex and contribute to learning nonmotor skills. Here we show that in the mid-lateral cerebellum, the reward information is encoded independently from the motor information such that during reward-based learning, only the reward information carried by the Purkinje cells inform learning while the motor information remains unchanged with learning.
虽然小脑传统上被认为仅参与运动控制,但最近的解剖学和临床研究表明,它在奖励处理中也发挥作用。然而,运动相关和奖励相关神经活动在小脑皮层水平上相互作用并促进学习的方式仍不清楚。在这里,我们研究了两只雄性猴子在学习将右手或左手运动与两个视觉符号之一相关联时,中外侧小脑浦肯野细胞的简单尖峰活动。这些细胞在过度训练的符号手关联和新的符号手关联之间具有明显不同的放电模式,尽管在两种情况下运动的运动学都没有改变,但它们与双手的运动相关联。活动变化与视觉符号的模式、运动运动学、猴子的反应时间或视觉符号的新颖性无关。简单尖峰活动在整个学习过程中发生变化,但同时发生的复杂尖峰并没有指示这种变化。虽然这些神经元也有与奖励相关的活动,但奖励相关和运动相关的信号是独立的。我们认为这种混合选择性可能有助于灵活学习困难的强化学习问题。小脑接收与运动相关和奖励相关的信息。然而,尚不清楚这两个信号如何在小脑皮层水平上相互作用并有助于学习非运动技能。在这里,我们表明在中外侧小脑,奖励信息与运动信息独立编码,使得在基于奖励的学习中,只有由浦肯野细胞携带的奖励信息在学习过程中提供信息,而运动信息在学习过程中保持不变。