Suppr超能文献

由正反馈诱导的阶段性多巴胺释放可预测逆向学习中的个体差异。

Phasic dopamine release induced by positive feedback predicts individual differences in reversal learning.

作者信息

Klanker Marianne, Sandberg Tessa, Joosten Ruud, Willuhn Ingo, Feenstra Matthijs, Denys Damiaan

机构信息

Netherlands Institute for Neuroscience, Institute of the Royal Netherlands Academy of Arts and Sciences, Meibergdreef 47, 1105 BA Amsterdam, The Netherlands; Department of Psychiatry, Academic Medical Center, University of Amsterdam, Postbus 22660, 1100 DD Amsterdam, The Netherlands.

Netherlands Institute for Neuroscience, Institute of the Royal Netherlands Academy of Arts and Sciences, Meibergdreef 47, 1105 BA Amsterdam, The Netherlands.

出版信息

Neurobiol Learn Mem. 2015 Nov;125:135-45. doi: 10.1016/j.nlm.2015.08.011. Epub 2015 Sep 5.

Abstract

Striatal dopamine (DA) is central to reward-based learning. Less is known about the contribution of DA to the ability to adapt previously learned behavior in response to changes in the environment, such as a reversal of response-reward contingencies. We hypothesized that DA is involved in the rapid updating of response-reward information essential for successful reversal learning. We trained rats to discriminate between two levers, where lever availability was signaled by a non-discriminative cue. Pressing one lever was always rewarded, whereas the other lever was never rewarded. After reaching stable discrimination performance, a reversal was presented, so that the previously non-rewarded lever was now rewarded and vice versa. We used fast-scan cyclic voltammetry to monitor DA release in the ventromedial striatum. During discrimination performance (pre-reversal), cue presentation induced phasic DA release, whereas reward delivery did not. The opposite pattern was observed post-reversal: Striatal DA release emerged after reward delivery, while cue-induced release diminished. Trial-by-trial analysis showed rapid reinstatement of cue-induced DA release on trials immediately following initial correct responses. This effect of positive feedback was observed in animals that learned the reversal, but not in 'non-learners'. In contrast, neither pre-reversal responding and DA signaling, nor post-reversal DA signaling in response to negative feedback differed between learners and non-learners. Together, we show that phasic DA dynamics in the ventromedial striatum encoding reward-predicting cues are associated with positive feedback during reversal learning. Furthermore, these signals predict individual differences in learning that are not present prior to reversal, suggesting a distinct role for dopamine in the adaptation of previously learned behavior.

摘要

纹状体多巴胺(DA)对于基于奖励的学习至关重要。关于DA在适应先前学习行为以应对环境变化(如反应-奖励偶联的逆转)能力方面的贡献,我们所知较少。我们假设DA参与了成功逆转学习所必需的反应-奖励信息的快速更新。我们训练大鼠区分两个杠杆,其中杠杆可用性由非区分性线索表示。按压一个杠杆总是会得到奖励,而另一个杠杆则从未得到奖励。在达到稳定的辨别性能后,进行逆转,使先前未得到奖励的杠杆现在得到奖励,反之亦然。我们使用快速扫描循环伏安法监测腹内侧纹状体中的DA释放。在辨别性能期间(逆转前),线索呈现诱导了阶段性DA释放,而奖励发放则没有。逆转后观察到相反的模式:奖励发放后腹侧纹状体DA释放出现,而线索诱导的释放减少。逐次试验分析表明,在最初正确反应后的试验中,线索诱导的DA释放迅速恢复。在学会逆转的动物中观察到了这种正反馈效应,但在“未学习者”中没有观察到。相比之下,学习者和未学习者在逆转前的反应和DA信号传导,以及逆转后对负反馈的DA信号传导方面均无差异。我们共同表明,腹内侧纹状体中编码奖励预测线索的阶段性DA动态与逆转学习期间的正反馈相关。此外,这些信号预测了逆转前不存在的学习个体差异,表明多巴胺在先前学习行为的适应中具有独特作用。

相似文献

1
Phasic dopamine release induced by positive feedback predicts individual differences in reversal learning.
Neurobiol Learn Mem. 2015 Nov;125:135-45. doi: 10.1016/j.nlm.2015.08.011. Epub 2015 Sep 5.
2
Regionally distinct phasic dopamine release patterns in the striatum during reversal learning.
Neuroscience. 2017 Mar 14;345:110-123. doi: 10.1016/j.neuroscience.2016.05.011. Epub 2016 May 13.
5
Ventral striatal dopamine modulation of different forms of behavioral flexibility.
Neuropsychopharmacology. 2009 Jul;34(8):2041-52. doi: 10.1038/npp.2009.21. Epub 2009 Mar 4.
7
A role for neurogenesis in probabilistic reward learning.
Behav Neurosci. 2020 Aug;134(4):283-295. doi: 10.1037/bne0000370. Epub 2020 May 7.
8
Dopamine D2/D3 receptors play a specific role in the reversal of a learned visual discrimination in monkeys.
Neuropsychopharmacology. 2007 Oct;32(10):2125-34. doi: 10.1038/sj.npp.1301337. Epub 2007 Feb 14.
9
Modulation of behavior by expected reward magnitude depends on dopamine in the dorsomedial striatum.
Neurotox Res. 2009 Feb;15(2):97-110. doi: 10.1007/s12640-009-9009-1. Epub 2009 Feb 12.
10
Orbitofrontal cortex reflects changes in response-outcome contingencies during probabilistic reversal learning.
Neuroscience. 2017 Mar 14;345:27-37. doi: 10.1016/j.neuroscience.2016.03.034. Epub 2016 Mar 17.

引用本文的文献

2
A narrative on the neurobiological roots of attachment-system functioning.
Commun Psychol. 2024 Oct 16;2(1):96. doi: 10.1038/s44271-024-00147-9.
3
Effects of chronic stress on cognitive function - From neurobiology to intervention.
Neurobiol Stress. 2024 Sep 2;33:100670. doi: 10.1016/j.ynstr.2024.100670. eCollection 2024 Nov.
4
An open-source platform for head-fixed operant and consummatory behavior.
Elife. 2023 Aug 9;12:e86183. doi: 10.7554/eLife.86183.
5
An Open-Source Platform for Head-Fixed Operant and Consummatory Behavior.
bioRxiv. 2023 Jan 16:2023.01.13.523828. doi: 10.1101/2023.01.13.523828.
6
Characterization of striatal dopamine projections across striatal subregions in behavioral flexibility.
Eur J Neurosci. 2023 Dec;58(12):4466-4486. doi: 10.1111/ejn.15910. Epub 2023 Jan 22.
8
Dopamine Circuit Mechanisms of Addiction-Like Behaviors.
Front Neural Circuits. 2021 Nov 9;15:752420. doi: 10.3389/fncir.2021.752420. eCollection 2021.
9
Gene Knockout Negatively Impacts Aspects of Reversal Learning Performance.
eNeuro. 2021 Sep 9;8(5). doi: 10.1523/ENEURO.0251-21.2021. Print 2021 Sep-Oct.

本文引用的文献

1
Extinction and reinstatement of phasic dopamine signals in the nucleus accumbens core during Pavlovian conditioning.
Behav Neurosci. 2014 Oct;128(5):579-87. doi: 10.1037/bne0000012. Epub 2014 Aug 11.
3
Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term.
J Neurosci. 2014 Jan 15;34(3):698-704. doi: 10.1523/JNEUROSCI.2489-13.2014.
4
Dopaminergic control of cognitive flexibility in humans and animals.
Front Neurosci. 2013 Nov 5;7:201. doi: 10.3389/fnins.2013.00201.
5
A causal link between prediction errors, dopamine neurons and learning.
Nat Neurosci. 2013 Jul;16(7):966-73. doi: 10.1038/nn.3413. Epub 2013 May 26.
7
Pathway-specific control of reward learning and its flexibility via selective dopamine receptors in the nucleus accumbens.
Proc Natl Acad Sci U S A. 2012 Jul 31;109(31):12764-9. doi: 10.1073/pnas.1210797109. Epub 2012 Jul 16.
9
Phasic mesolimbic dopamine signaling precedes and predicts performance of a self-initiated action sequence task.
Biol Psychiatry. 2012 May 15;71(10):846-54. doi: 10.1016/j.biopsych.2011.12.019. Epub 2012 Feb 2.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验