Suppr超能文献

杏仁核与腹侧纹状体对强化学习有不同贡献。

Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning.

作者信息

Costa Vincent D, Dal Monte Olga, Lucas Daniel R, Murray Elisabeth A, Averbeck Bruno B

机构信息

Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, MD 20892-4415, USA.

Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, MD 20892-4415, USA.

出版信息

Neuron. 2016 Oct 19;92(2):505-517. doi: 10.1016/j.neuron.2016.09.025. Epub 2016 Oct 6.

Abstract

Reinforcement learning (RL) theories posit that dopaminergic signals are integrated within the striatum to associate choices with outcomes. Often overlooked is that the amygdala also receives dopaminergic input and is involved in Pavlovian processes that influence choice behavior. To determine the relative contributions of the ventral striatum (VS) and amygdala to appetitive RL, we tested rhesus macaques with VS or amygdala lesions on deterministic and stochastic versions of a two-arm bandit reversal learning task. When learning was characterized with an RL model relative to controls, amygdala lesions caused general decreases in learning from positive feedback and choice consistency. By comparison, VS lesions only affected learning in the stochastic task. Moreover, the VS lesions hastened the monkeys' choice reaction times, which emphasized a speed-accuracy trade-off that accounted for errors in deterministic learning. These results update standard accounts of RL by emphasizing distinct contributions of the amygdala and VS to RL.

摘要

强化学习(RL)理论认为,多巴胺能信号在纹状体内整合,将选择与结果联系起来。常被忽视的是,杏仁核也接收多巴胺能输入,并参与影响选择行为的经典条件反射过程。为了确定腹侧纹状体(VS)和杏仁核对奖赏性强化学习的相对贡献,我们在双臂强盗反转学习任务的确定性和随机性版本中,对患有VS或杏仁核损伤的恒河猴进行了测试。当相对于对照组用强化学习模型来描述学习情况时,杏仁核损伤导致从积极反馈中学习和选择一致性普遍下降。相比之下,VS损伤仅影响随机任务中的学习。此外,VS损伤加快了猴子的选择反应时间,这强调了速度与准确性之间的权衡,而这种权衡解释了确定性学习中的错误。这些结果通过强调杏仁核和VS对强化学习的不同贡献,更新了强化学习的标准观点。

相似文献

6
Ventral striatum's role in learning from gains and losses.腹侧纹状体在得失学习中的作用。
Proc Natl Acad Sci U S A. 2018 Dec 26;115(52):E12398-E12406. doi: 10.1073/pnas.1809833115. Epub 2018 Dec 13.
10
Subcortical Substrates of Explore-Exploit Decisions in Primates.灵长类动物探索-利用决策的皮质下基质。
Neuron. 2019 Aug 7;103(3):533-545.e5. doi: 10.1016/j.neuron.2019.05.017. Epub 2019 Jun 10.

引用本文的文献

7
An opponent striatal circuit for distributional reinforcement learning.用于分布式强化学习的对侧纹状体回路。
Nature. 2025 Mar;639(8055):717-726. doi: 10.1038/s41586-024-08488-5. Epub 2025 Feb 19.
10
Representation of Anticipated Rewards and Punishments in the Human Brain.人类大脑中预期奖励与惩罚的表征。
Annu Rev Psychol. 2025 Jan;76(1):197-226. doi: 10.1146/annurev-psych-022324-042614. Epub 2024 Dec 3.

本文引用的文献

4
Mini-review: Prediction errors, attention and associative learning.小型综述:预测误差、注意力与联想学习
Neurobiol Learn Mem. 2016 May;131:207-15. doi: 10.1016/j.nlm.2016.02.014. Epub 2016 Mar 3.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验