Howard Hughes Medical Institute, Department of Neurobiology, Harvard Medical School, Boston, MA, USA.
Department of Neuroscience, Washington University School of Medicine, St Louis, MO, USA.
Nature. 2021 Feb;590(7846):451-456. doi: 10.1038/s41586-020-03050-5. Epub 2020 Dec 23.
Reinforcement learning models postulate that neurons that release dopamine encode information about action and action outcome, and provide a teaching signal to striatal spiny projection neurons in the form of dopamine release. Dopamine is thought to guide learning via dynamic and differential modulation of protein kinase A (PKA) in each class of spiny projection neuron. However, the real-time relationship between dopamine and PKA in spiny projection neurons remains untested in behaving animals. Here we monitor the activity of dopamine-releasing neurons, extracellular levels of dopamine and net PKA activity in spiny projection neurons in the nucleus accumbens of mice during learning. We find positive and negative modulation of dopamine that evolves across training and is both necessary and sufficient to explain concurrent fluctuations in the PKA activity of spiny projection neurons. Modulations of PKA in spiny projection neurons that express type-1 and type-2 dopamine receptors are dichotomous, such that these neurons are selectively sensitive to increases and decreases, respectively, in dopamine that occur at different phases of learning. Thus, PKA-dependent pathways in each class of spiny projection neuron are asynchronously engaged by positive or negative dopamine signals during learning.
强化学习模型假设,释放多巴胺的神经元编码关于动作和动作结果的信息,并以多巴胺释放的形式向纹状体棘突投射神经元提供教学信号。多巴胺被认为通过动态和差异调节每个棘突投射神经元中的蛋白激酶 A (PKA) 来指导学习。然而,在行为动物中,纹状体棘突投射神经元中多巴胺和 PKA 之间的实时关系仍未得到测试。在这里,我们在学习过程中监测小鼠伏隔核中释放多巴胺的神经元、细胞外多巴胺水平和棘突投射神经元中净 PKA 活性的活动。我们发现多巴胺的正调和负调随训练而演变,这对于解释棘突投射神经元中 PKA 活性的并发波动是必要且充分的。表达 1 型和 2 型多巴胺受体的棘突投射神经元中的 PKA 调节是二分的,使得这些神经元分别对学习不同阶段发生的多巴胺的增加和减少具有选择性敏感性。因此,在学习过程中,每个棘突投射神经元中的 PKA 依赖途径被正或负多巴胺信号异步激活。