文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

基于多巴胺浓度的纹状体动作学习。

Striatal action-learning based on dopamine concentration.

机构信息

Department of Neurobiology and Ethology, Haifa University, Haifa, Israel.

出版信息

Exp Brain Res. 2010 Jan;200(3-4):307-17. doi: 10.1007/s00221-009-2060-6. Epub 2009 Nov 11.


DOI:10.1007/s00221-009-2060-6
PMID:19904530
Abstract

The reinforcement learning hypothesis of dopamine function predicts that dopamine acts as a teaching signal by governing synaptic plasticity in the striatum. Induced changes in synaptic strength enable the cortico-striatal network to learn a mapping between situations and actions that lead to a reward. A review of the relevant neurophysiology of dopamine function in the cortico-striatal network and the machine reinforcement learning hypothesis reveals an apparent mismatch with recent electrophysiological studies. It was found that in addition to the well-described reward-related responses, a subpopulation of dopamine neurons also exhibits phasic responses to aversive stimuli or to cues predicting aversive stimuli. Obviously, actions that lead to aversive events should not be reinforced. However, published data suggest that the phasic responses of dopamine neurons to reward-related stimuli have a higher firing rate and have a longer duration than phasic responses of dopamine neurons to aversion-related stimuli. We propose that based on different dopamine concentrations, the target structures are able to decode reward-related dopamine from aversion-related dopamine responses. Thereby, the learning of actions in the basal-ganglia network integrates information about both costs and benefits. This hypothesis predicts that dopamine concentration should be a crucial parameter for plasticity rules at cortico-striatal synapses. Recent in vitro studies on cortico-striatal synaptic plasticity rules support a striatal action-learning scheme where during reward-related dopamine release dopamine-dependent forms of synaptic plasticity occur, while during aversion-related dopamine release the dopamine concentration only allows dopamine-independent forms of synaptic plasticity to occur.

摘要

多巴胺功能的强化学习假说预测,多巴胺通过调节纹状体中的突触可塑性而起教学信号作用。突触强度的诱导变化使皮质纹状体网络能够学习到一种将情况与导致奖励的动作联系起来的映射。对皮质纹状体网络中多巴胺功能的相关神经生理学和机器强化学习假说的回顾显示,与最近的电生理学研究明显不匹配。研究发现,除了描述良好的与奖励相关的反应外,多巴胺神经元的亚群还对厌恶刺激或预测厌恶刺激的线索表现出相位反应。显然,导致厌恶事件的动作不应得到强化。然而,已发表的数据表明,多巴胺神经元对与奖励相关的刺激的相位反应的发射率比多巴胺神经元对与厌恶相关的刺激的相位反应的发射率更高,持续时间更长。我们提出,基于不同的多巴胺浓度,靶结构能够从与厌恶相关的多巴胺反应中解码与奖励相关的多巴胺。因此,基底神经节网络中的动作学习整合了关于成本和收益的信息。该假说预测,多巴胺浓度应该是皮质纹状体突触可塑性规则的关键参数。最近关于皮质纹状体突触可塑性规则的体外研究支持一种纹状体动作学习方案,即在与奖励相关的多巴胺释放期间发生多巴胺依赖性形式的突触可塑性,而在与厌恶相关的多巴胺释放期间,多巴胺浓度仅允许发生多巴胺非依赖性形式的突触可塑性。

相似文献

[1]
Striatal action-learning based on dopamine concentration.

Exp Brain Res. 2009-11-11

[2]
A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface.

PLoS Biol. 2015-1-6

[3]
Striatal dopamine ramping may indicate flexible reinforcement learning with forgetting in the cortico-basal ganglia circuits.

Front Neural Circuits. 2014-4-9

[4]
A Dual Role Hypothesis of the Cortico-Basal-Ganglia Pathways: Opponency and Temporal Difference Through Dopamine and Adenosine.

Front Neural Circuits. 2019-1-7

[5]
Opposing patterns of abnormal D1 and D2 receptor dependent cortico-striatal plasticity explain increased risk taking in patients with DYT1 dystonia.

PLoS One. 2020-5-4

[6]
Molecular substrates of action control in cortico-striatal circuits.

Prog Neurobiol. 2011-6-17

[7]
Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior.

Prog Brain Res. 2000

[8]
Stimulus-response and response-outcome learning mechanisms in the striatum.

Behav Brain Res. 2009-4-12

[9]
Modeling functions of striatal dopamine modulation in learning and planning.

Neuroscience. 2001

[10]
The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective.

Front Neural Circuits. 2019-2-21

引用本文的文献

[1]
Reinforcement learning approaches to hippocampus-dependent flexible spatial navigation.

Brain Neurosci Adv. 2021-4-9

[2]
CK1δ over-expressing mice display ADHD-like behaviors, frontostriatal neuronal abnormalities and altered expressions of ADHD-candidate genes.

Mol Psychiatry. 2020-12

[3]
Beyond Reward Prediction Errors: Human Striatum Updates Rule Values During Learning.

Cereb Cortex. 2018-11-1

[4]
Role of Nitric Oxide on Dopamine Release and Morphine-Dependency.

Basic Clin Neurosci. 2016-10

[5]
Long-Term Supplementation with Beta Serum Concentrate (BSC), a Complex of Milk Lipids, during Post-Natal Brain Development Improves Memory in Rats.

Nutrients. 2015-6-5

[6]
Differential effects of dopamine signalling on long-term memory formation and consolidation in rodent brain.

Proteome Sci. 2015-3-18

[7]
Supplementation with complex milk lipids during brain development promotes neuroplasticity without altering myelination or vascular density.

Food Nutr Res. 2015-3-27

[8]
Dopamine modulation of learning and memory in the prefrontal cortex: insights from studies in primates, rodents, and birds.

Front Neural Circuits. 2014-8-5

[9]
Midbrain dopamine neurons sustain inhibitory transmission using plasma membrane uptake of GABA, not synthesis.

Elife. 2014-4-24

[10]
To treat a psychopath.

Theor Med Bioeth. 2014-2

本文引用的文献

[1]
The dopamine puzzle.

Proc Natl Acad Sci U S A. 2009-7-7

[2]
Two types of dopamine neuron distinctly convey positive and negative motivational signals.

Nature. 2009-6-11

[3]
Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning.

Science. 2009-5-22

[4]
Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli.

Proc Natl Acad Sci U S A. 2009-3-24

[5]
Single nigrostriatal dopaminergic neurons form widely spread and highly dense axonal arborizations in the neostriatum.

J Neurosci. 2009-1-14

[6]
Dopamine and reward: the anhedonia hypothesis 30 years on.

Neurotox Res. 2008-10

[7]
Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials.

J Neurosci. 2008-11-5

[8]
Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli.

Nat Neurosci. 2008-12

[9]
A dopaminergic axon lattice in the striatum and its relationship with cortical and thalamic terminals.

J Neurosci. 2008-10-29

[10]
Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model.

J Neurosci. 2008-9-24

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索