• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

多巴胺瞬变对于基于模型的联想学习而言既是充分的也是必要的。

Dopamine transients are sufficient and necessary for acquisition of model-based associations.

作者信息

Sharpe Melissa J, Chang Chun Yun, Liu Melissa A, Batchelor Hannah M, Mueller Lauren E, Jones Joshua L, Niv Yael, Schoenbaum Geoffrey

机构信息

NIDA Intramural Research Program, Baltimore, Maryland, USA.

Department of Psychology and Neuroscience Institute, Princeton University, Princeton, New Jersey, USA.

出版信息

Nat Neurosci. 2017 May;20(5):735-742. doi: 10.1038/nn.4538. Epub 2017 Apr 3.

DOI:10.1038/nn.4538
PMID:28368385
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC5413864/
Abstract

Associative learning is driven by prediction errors. Dopamine transients correlate with these errors, which current interpretations limit to endowing cues with a scalar quantity reflecting the value of future rewards. We tested whether dopamine might act more broadly to support learning of an associative model of the environment. Using sensory preconditioning, we show that prediction errors underlying stimulus-stimulus learning can be blocked behaviorally and reinstated by optogenetically activating dopamine neurons. We further show that suppressing the firing of these neurons across the transition prevents normal stimulus-stimulus learning. These results establish that the acquisition of model-based information about transitions between nonrewarding events is also driven by prediction errors and that, contrary to existing canon, dopamine transients are both sufficient and necessary to support this type of learning. Our findings open new possibilities for how these biological signals might support associative learning in the mammalian brain in these and other contexts.

摘要

联想学习由预测误差驱动。多巴胺瞬变与这些误差相关,目前的解释将其局限于赋予线索一个反映未来奖励价值的标量。我们测试了多巴胺是否可能更广泛地发挥作用以支持对环境关联模型的学习。通过感觉预适应,我们表明刺激-刺激学习背后的预测误差可以通过行为阻断,并通过光遗传学激活多巴胺神经元而恢复。我们进一步表明,在转换过程中抑制这些神经元的放电会阻止正常的刺激-刺激学习。这些结果表明,关于无奖励事件之间转换的基于模型的信息的获取也由预测误差驱动,并且与现有准则相反,多巴胺瞬变对于支持这类学习既是充分的也是必要的。我们的发现为这些生物信号如何在这些及其他情境下支持哺乳动物大脑中的联想学习开辟了新的可能性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/797e07e7e1ed/nihms857153f5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/7bc6f023b4a9/nihms857153f1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/90dc59c93579/nihms857153f2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/263210ecf733/nihms857153f3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/01fb4292dcb0/nihms857153f4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/797e07e7e1ed/nihms857153f5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/7bc6f023b4a9/nihms857153f1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/90dc59c93579/nihms857153f2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/263210ecf733/nihms857153f3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/01fb4292dcb0/nihms857153f4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9390/5413864/797e07e7e1ed/nihms857153f5.jpg

相似文献

1
Dopamine transients are sufficient and necessary for acquisition of model-based associations.多巴胺瞬变对于基于模型的联想学习而言既是充分的也是必要的。
Nat Neurosci. 2017 May;20(5):735-742. doi: 10.1038/nn.4538. Epub 2017 Apr 3.
2
Cue and Reward Evoked Dopamine Activity Is Necessary for Maintaining Learned Pavlovian Associations.线索和奖励诱发的多巴胺活动对于维持习得的巴甫洛夫式联想是必要的。
J Neurosci. 2021 Jun 9;41(23):5004-5014. doi: 10.1523/JNEUROSCI.2744-20.2021. Epub 2021 Apr 22.
3
Optogenetic Blockade of Dopamine Transients Prevents Learning Induced by Changes in Reward Features.光遗传学阻断多巴胺瞬变可防止因奖励特征变化引起的学习。
Curr Biol. 2017 Nov 20;27(22):3480-3486.e3. doi: 10.1016/j.cub.2017.09.049. Epub 2017 Nov 2.
4
Dopamine transients do not act as model-free prediction errors during associative learning.多巴胺瞬变在联想学习中不作为无模型预测误差。
Nat Commun. 2020 Jan 8;11(1):106. doi: 10.1038/s41467-019-13953-1.
5
A causal link between prediction errors, dopamine neurons and learning.预测误差、多巴胺神经元和学习之间的因果关系。
Nat Neurosci. 2013 Jul;16(7):966-73. doi: 10.1038/nn.3413. Epub 2013 May 26.
6
Dissociable contributions of phasic dopamine activity to reward and prediction.相位多巴胺活动对奖励和预测的可分离贡献。
Cell Rep. 2021 Sep 7;36(10):109684. doi: 10.1016/j.celrep.2021.109684.
7
Dopamine errors drive excitatory and inhibitory components of backward conditioning in an outcome-specific manner.多巴胺错误以特定于结果的方式驱动反向条件作用的兴奋性和抑制性成分。
Curr Biol. 2022 Jul 25;32(14):3210-3218.e3. doi: 10.1016/j.cub.2022.06.035. Epub 2022 Jun 24.
8
Causal evidence supporting the proposal that dopamine transients function as temporal difference prediction errors.支持多巴胺瞬时作为时间差分预测误差的因果证据。
Nat Neurosci. 2020 Feb;23(2):176-178. doi: 10.1038/s41593-019-0574-1. Epub 2020 Jan 20.
9
Tonic or Phasic Stimulation of Dopaminergic Projections to Prefrontal Cortex Causes Mice to Maintain or Deviate from Previously Learned Behavioral Strategies.对前额叶皮层多巴胺能投射的强直或相位刺激使小鼠维持或偏离先前习得的行为策略。
J Neurosci. 2017 Aug 30;37(35):8315-8329. doi: 10.1523/JNEUROSCI.1221-17.2017. Epub 2017 Jul 24.
10
Dopamine reward prediction errors reflect hidden-state inference across time.多巴胺奖励预测误差反映了跨时间的隐藏状态推理。
Nat Neurosci. 2017 Apr;20(4):581-589. doi: 10.1038/nn.4520. Epub 2017 Mar 6.

引用本文的文献

1
Flexible updating of reward and punishment contingencies by VTA GABA neurons.腹侧被盖区γ-氨基丁酸能神经元对奖惩意外情况的灵活更新
Curr Biol. 2025 Aug 18;35(16):3973-3985.e3. doi: 10.1016/j.cub.2025.07.021. Epub 2025 Jul 31.
2
Individual differences in decision-making shape how mesolimbic dopamine regulates choice confidence and change-of-mind.决策过程中的个体差异塑造了中脑边缘多巴胺调节选择信心和改变想法的方式。
Nat Neurosci. 2025 Jul 30. doi: 10.1038/s41593-025-02015-z.
3
Striatal Gradient in Value-Decay Explains Regional Differences in Dopamine Patterns and Reinforcement Learning Computations.

本文引用的文献

1
Phasic dopamine release in the medial prefrontal cortex enhances stimulus discrimination.内侧前额叶皮质中的阶段性多巴胺释放增强了刺激辨别能力。
Proc Natl Acad Sci U S A. 2016 May 31;113(22):E3169-76. doi: 10.1073/pnas.1606098113. Epub 2016 May 16.
2
Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target.中脑多巴胺神经元终末的奖赏与选择编码取决于纹状体靶点。
Nat Neurosci. 2016 Jun;19(6):845-54. doi: 10.1038/nn.4287. Epub 2016 Apr 25.
3
Midbrain dopamine neurons compute inferred and cached value prediction errors in a common framework.
纹状体价值衰减梯度解释了多巴胺模式和强化学习计算中的区域差异。
J Neurosci. 2025 Jul 18. doi: 10.1523/JNEUROSCI.0170-25.2025.
4
Striatal dopamine signals errors in prediction across different informational domains.纹状体多巴胺信号在不同信息领域中预测误差。
Sci Adv. 2025 Jul 11;11(28):eadq9684. doi: 10.1126/sciadv.adq9684. Epub 2025 Jul 9.
5
A multidimensional distributional map of future reward in dopamine neurons.多巴胺神经元中未来奖励的多维分布图。
Nature. 2025 Jun;642(8068):691-699. doi: 10.1038/s41586-025-09089-6. Epub 2025 Jun 4.
6
Differentiating Reinforcement Learning and Episodic Memory in Value-Based Decisions in Parkinson's Disease.帕金森病基于价值决策中强化学习与情景记忆的区分
J Neurosci. 2025 May 21;45(21):e0911242025. doi: 10.1523/JNEUROSCI.0911-24.2025.
7
Striatal dopamine represents valence on dynamic regional scales.纹状体多巴胺在动态区域尺度上代表效价。
J Neurosci. 2025 Mar 17;45(17). doi: 10.1523/JNEUROSCI.1551-24.2025.
8
Untangling dopamine and glutamate in the ventral tegmental area.厘清腹侧被盖区中的多巴胺与谷氨酸
bioRxiv. 2025 Feb 26:2025.02.25.640201. doi: 10.1101/2025.02.25.640201.
9
Proactive and reactive construction of memory-based preferences.基于记忆的偏好的主动和被动构建。
Nat Commun. 2025 Feb 13;16(1):1618. doi: 10.1038/s41467-025-56183-4.
10
Devaluing memories of reward: a case for dopamine.贬低奖励记忆:多巴胺的一个实例
Commun Biol. 2025 Feb 3;8(1):161. doi: 10.1038/s42003-024-07440-7.
中脑多巴胺神经元在一个通用框架中计算推断和缓存的价值预测误差。
Elife. 2016 Mar 7;5:e13665. doi: 10.7554/eLife.13665.
4
Dopamine reward prediction-error signalling: a two-component response.多巴胺奖励预测误差信号传导:一种双组分反应。
Nat Rev Neurosci. 2016 Mar;17(3):183-95. doi: 10.1038/nrn.2015.26. Epub 2016 Feb 11.
5
Dopamine neurons share common response function for reward prediction error.多巴胺能神经元对奖励预测误差具有共同的反应功能。
Nat Neurosci. 2016 Mar;19(3):479-86. doi: 10.1038/nn.4239. Epub 2016 Feb 8.
6
Physiological state gates acquisition and expression of mesolimbic reward prediction signals.生理状态控制中脑边缘奖赏预测信号的获取与表达。
Proc Natl Acad Sci U S A. 2016 Feb 16;113(7):1943-8. doi: 10.1073/pnas.1519643113. Epub 2016 Feb 1.
7
Nucleus accumbens core dopamine signaling tracks the need-based motivational value of food-paired cues.伏隔核核心多巴胺信号追踪食物配对线索的基于需求的动机价值。
J Neurochem. 2016 Mar;136(5):1026-36. doi: 10.1111/jnc.13494. Epub 2016 Jan 24.
8
Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors.对多巴胺神经元进行短暂的光遗传学抑制可模拟内源性负性奖励预测误差。
Nat Neurosci. 2016 Jan;19(1):111-6. doi: 10.1038/nn.4191. Epub 2015 Dec 7.
9
Arithmetic and local circuitry underlying dopamine prediction errors.多巴胺预测误差背后的算术和局部神经回路。
Nature. 2015 Sep 10;525(7568):243-6. doi: 10.1038/nature14855. Epub 2015 Aug 31.
10
Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making.腹侧纹状体多巴胺反映了序列决策过程中基于模型控制的行为和神经特征。
Proc Natl Acad Sci U S A. 2015 Feb 3;112(5):1595-600. doi: 10.1073/pnas.1417219112. Epub 2015 Jan 20.