Suppr超能文献

前额叶纹状体和多巴胺对强化学习个体差异的标志物:一项多模态研究。

Frontostriatal and Dopamine Markers of Individual Differences in Reinforcement Learning: A Multi-modal Investigation.

机构信息

Department of Psychiatry, Harvard Medical School, and Center for Depression, Anxiety and Stress Research, McLean Hospital, Belmont, MA, USA.

Department of Psychology, University of California Los Angeles, CA, USA.

出版信息

Cereb Cortex. 2018 Dec 1;28(12):4281-4290. doi: 10.1093/cercor/bhx281.

Abstract

Prior studies have shown that dopamine (DA) functioning in frontostriatal circuits supports reinforcement learning (RL), as phasic DA activity in ventral striatum signals unexpected reward and may drive coordinated activity of striatal and orbitofrontal regions that support updating of action plans. However, the nature of DA functioning in RL is complex, in particular regarding the role of DA clearance in RL behavior. Here, in a multi-modal neuroimaging study with healthy adults, we took an individual differences approach to the examination of RL behavior and DA clearance mechanisms in frontostriatal learning networks. We predicted that better RL would be associated with decreased striatal DA transporter (DAT) availability and increased intrinsic functional connectivity among DA-rich frontostriatal regions. In support of these predictions, individual differences in RL behavior were related to DAT binding potential in ventral striatum and resting-state functional connectivity between ventral striatum and orbitofrontal cortex. Critically, DAT binding potential had an indirect effect on reinforcement learning behavior through frontostriatal connectivity, suggesting potential causal relationships across levels of neurocognitive functioning. These data suggest that individual differences in DA clearance and frontostriatal coordination may serve as markers for RL, and suggest directions for research on psychopathologies characterized by altered RL.

摘要

先前的研究表明,前额叶纹状体回路中的多巴胺(DA)功能支持强化学习(RL),因为腹侧纹状体中的 DA 相位活动信号表示意外奖励,并可能驱动纹状体和眶额区域的协调活动,从而支持行动计划的更新。然而,RL 中 DA 功能的性质很复杂,特别是关于 DA 清除在 RL 行为中的作用。在这里,我们在一项具有健康成年人的多模态神经影像学研究中,采用个体差异方法来检查 RL 行为和前额叶纹状体学习网络中的 DA 清除机制。我们预测,更好的 RL 与纹状体多巴胺转运蛋白(DAT)可用性降低以及富含多巴胺的前额叶纹状体区域之间的内在功能连接增加有关。这些预测得到了支持,RL 行为的个体差异与腹侧纹状体中的 DAT 结合潜力以及腹侧纹状体和眶额皮层之间的静息状态功能连接有关。至关重要的是,DAT 结合潜力通过前额叶纹状体的连接对强化学习行为产生间接影响,这表明在神经认知功能的各个层面上存在潜在的因果关系。这些数据表明,DA 清除和前额叶纹状体协调的个体差异可能是 RL 的标志物,并为研究以 RL 改变为特征的精神病理学提供了方向。

相似文献

2
Striatal dopaminergic modulation of reinforcement learning predicts reward-oriented behavior in daily life.
Biol Psychol. 2017 Jul;127:1-9. doi: 10.1016/j.biopsycho.2017.04.014. Epub 2017 Apr 29.
4
Relationship between regional gray matter volumes and dopamine D receptor and transporter in living human brains.
Hum Brain Mapp. 2021 Aug 15;42(12):4048-4058. doi: 10.1002/hbm.25538. Epub 2021 May 20.
5
Individual differences in impulsive action and dopamine transporter function in rat orbitofrontal cortex.
Neuroscience. 2016 Jan 28;313:122-9. doi: 10.1016/j.neuroscience.2015.11.033. Epub 2015 Nov 23.
6
Phasic dopamine release induced by positive feedback predicts individual differences in reversal learning.
Neurobiol Learn Mem. 2015 Nov;125:135-45. doi: 10.1016/j.nlm.2015.08.011. Epub 2015 Sep 5.
7
Dynamic Flexibility in Striatal-Cortical Circuits Supports Reinforcement Learning.
J Neurosci. 2018 Mar 7;38(10):2442-2453. doi: 10.1523/JNEUROSCI.2084-17.2018. Epub 2018 Feb 5.
8
Shifts in the functional topography of frontal cortex-striatum connectivity in alcohol use disorder.
Addict Biol. 2019 Nov;24(6):1245-1253. doi: 10.1111/adb.12692. Epub 2018 Nov 23.
9
Dissociable roles of dopamine and serotonin transporter function in a rat model of negative urgency.
Behav Brain Res. 2015 Sep 15;291:201-208. doi: 10.1016/j.bbr.2015.05.023. Epub 2015 May 21.
10
DRD2 genotype-based variation of default mode network activity and of its relationship with striatal DAT binding.
Schizophr Bull. 2013 Jan;39(1):206-16. doi: 10.1093/schbul/sbr128. Epub 2011 Oct 5.

引用本文的文献

1
Cross-species translational paradigms for assessing positive valence system as defined by the RDoC matrix.
J Neurochem. 2025 Jan;169(1):e16243. doi: 10.1111/jnc.16243. Epub 2024 Oct 28.
2
Reinforcement feedback impairs locomotor adaptation and retention.
Front Behav Neurosci. 2024 Apr 24;18:1388495. doi: 10.3389/fnbeh.2024.1388495. eCollection 2024.
3
Brain Imaging in Routine Psychiatric Practice.
Mo Med. 2024 Jan-Feb;121(1):37-43.
5
Neurocognitive risk phenotyping to predict mood symptoms in adolescence.
J Psychopathol Clin Sci. 2024 Jan;133(1):90-102. doi: 10.1037/abn0000866. Epub 2023 Dec 7.
6
Striatal dopamine supports reward expectation and learning: A simultaneous PET/fMRI study.
Neuroimage. 2023 Feb 15;267:119831. doi: 10.1016/j.neuroimage.2022.119831. Epub 2022 Dec 28.
7
8
Pharmacological Treatments for Anhedonia.
Curr Top Behav Neurosci. 2022;58:467-489. doi: 10.1007/7854_2022_357.
9
Probabilistic Reinforcement Learning and Anhedonia.
Curr Top Behav Neurosci. 2022;58:355-377. doi: 10.1007/7854_2022_349.
10
What do Reinforcement Learning Models Measure? Interpreting Model Parameters in Cognition and Neuroscience.
Curr Opin Behav Sci. 2021 Oct;41:128-137. doi: 10.1016/j.cobeha.2021.06.004. Epub 2021 Jul 3.

本文引用的文献

1
Human Orbitofrontal Cortex Represents a Cognitive Map of State Space.
Neuron. 2016 Sep 21;91(6):1402-1412. doi: 10.1016/j.neuron.2016.08.019.
3
Dopamine-Related Disruption of Functional Topography of Striatal Connections in Unmedicated Patients With Schizophrenia.
JAMA Psychiatry. 2016 Aug 1;73(8):862-70. doi: 10.1001/jamapsychiatry.2016.0178.
4
Individual Variability and Test-Retest Reliability Revealed by Ten Repeated Resting-State Brain Scans over One Month.
PLoS One. 2015 Dec 29;10(12):e0144963. doi: 10.1371/journal.pone.0144963. eCollection 2015.
5
Corticostriatal pathways contribute to the natural time course of positive mood.
Nat Commun. 2015 Dec 7;6:10065. doi: 10.1038/ncomms10065.
6
Inflammation is associated with decreased functional connectivity within corticostriatal reward circuitry in depression.
Mol Psychiatry. 2016 Oct;21(10):1358-65. doi: 10.1038/mp.2015.168. Epub 2015 Nov 10.
7
State and Trait Components of Functional Connectivity: Individual Differences Vary with Mental State.
J Neurosci. 2015 Oct 14;35(41):13949-61. doi: 10.1523/JNEUROSCI.1324-15.2015.
9
Arithmetic and local circuitry underlying dopamine prediction errors.
Nature. 2015 Sep 10;525(7568):243-6. doi: 10.1038/nature14855. Epub 2015 Aug 31.
10
Drug Addiction: Updating Actions to Habits to Compulsions Ten Years On.
Annu Rev Psychol. 2016;67:23-50. doi: 10.1146/annurev-psych-122414-033457. Epub 2015 Aug 7.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验