Department of Neurobiology, Duke University, Durham, NC 27710.
Duke University Center for Neuroengineering, Duke University, Durham, NC 27710.
Proc Natl Acad Sci U S A. 2017 Jun 13;114(24):E4841-E4850. doi: 10.1073/pnas.1703668114. Epub 2017 May 30.
Rewards are known to influence neural activity associated with both motor preparation and execution. This influence can be exerted directly upon the primary motor (M1) and somatosensory (S1) cortical areas via the projections from reward-sensitive dopaminergic neurons of the midbrain ventral tegmental areas. However, the neurophysiological manifestation of reward-related signals in M1 and S1 are not well understood. Particularly, it is unclear how the neurons in these cortical areas multiplex their traditional functions related to the control of spatial and temporal characteristics of movements with the representation of rewards. To clarify this issue, we trained rhesus monkeys to perform a center-out task in which arm movement direction, reward timing, and magnitude were manipulated independently. Activity of several hundred cortical neurons was simultaneously recorded using chronically implanted microelectrode arrays. Many neurons (9-27%) in both M1 and S1 exhibited activity related to reward anticipation. Additionally, neurons in these areas responded to a mismatch between the reward amount given to the monkeys and the amount they expected: A lower-than-expected reward caused a transient increase in firing rate in 60-80% of the total neuronal sample, whereas a larger-than-expected reward resulted in a decreased firing rate in 20-35% of the neurons. Moreover, responses of M1 and S1 neurons to reward omission depended on the direction of movements that led to those rewards. These observations suggest that sensorimotor cortical neurons corepresent rewards and movement-related activity, presumably to enable reward-based learning.
奖励已知会影响与运动准备和执行相关的神经活动。这种影响可以通过从中脑腹侧被盖区的奖励敏感多巴胺能神经元投射直接施加于主要运动(M1)和躯体感觉(S1)皮质区。然而,M1 和 S1 中与奖励相关的信号的神经生理学表现尚不清楚。特别是,这些皮质区域中的神经元如何将其与运动的空间和时间特征控制相关的传统功能与奖励的表示进行多路复用仍不清楚。为了阐明这个问题,我们训练恒河猴执行一项中心到外周的任务,在该任务中,手臂运动方向、奖励时间和奖励幅度可以独立操纵。使用慢性植入的微电极阵列同时记录了数百个皮质神经元的活动。M1 和 S1 中的许多神经元(9-27%)表现出与奖励预期相关的活动。此外,这些区域中的神经元对给予猴子的奖励金额与他们预期的金额之间的不匹配做出反应:低于预期的奖励会导致 60-80%的总神经元样本的发射率短暂增加,而大于预期的奖励会导致 20-35%的神经元的发射率降低。此外,M1 和 S1 神经元对奖励缺失的反应取决于导致这些奖励的运动方向。这些观察结果表明,感觉运动皮质神经元共同表示奖励和与运动相关的活动,大概是为了能够进行基于奖励的学习。