• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

多巴胺与强化学习任务中的表现:来自帕金森病的证据。

Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease.

机构信息

Wellcome Trust Centre for Neuroimaging, UCL, London, WC1N 3BG, UK.

出版信息

Brain. 2012 Jun;135(Pt 6):1871-83. doi: 10.1093/brain/aws083. Epub 2012 Apr 15.

DOI:10.1093/brain/aws083
PMID:22508958
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC3359751/
Abstract

The role dopamine plays in decision-making has important theoretical, empirical and clinical implications. Here, we examined its precise contribution by exploiting the lesion deficit model afforded by Parkinson's disease. We studied patients in a two-stage reinforcement learning task, while they were ON and OFF dopamine replacement medication. Contrary to expectation, we found that dopaminergic drug state (ON or OFF) did not impact learning. Instead, the critical factor was drug state during the performance phase, with patients ON medication choosing correctly significantly more frequently than those OFF medication. This effect was independent of drug state during initial learning and appears to reflect a facilitation of generalization for learnt information. This inference is bolstered by our observation that neural activity in nucleus accumbens and ventromedial prefrontal cortex, measured during simultaneously acquired functional magnetic resonance imaging, represented learnt stimulus values during performance. This effect was expressed solely during the ON state with activity in these regions correlating with better performance. Our data indicate that dopamine modulation of nucleus accumbens and ventromedial prefrontal cortex exerts a specific effect on choice behaviour distinct from pure learning. The findings are in keeping with the substantial other evidence that certain aspects of learning are unaffected by dopamine lesions or depletion, and that dopamine plays a key role in performance that may be distinct from its role in learning.

摘要

多巴胺在决策中的作用具有重要的理论、经验和临床意义。在这里,我们通过利用帕金森病提供的损伤缺陷模型来检验其确切贡献。我们在一项两阶段强化学习任务中研究了患者,同时他们正在接受多巴胺替代药物治疗。与预期相反,我们发现多巴胺能药物状态(ON 或 OFF)并不影响学习。相反,关键因素是表现阶段的药物状态,服用药物的患者选择正确的频率明显高于未服用药物的患者。这种效果独立于初始学习期间的药物状态,似乎反映了对所学信息的泛化促进。我们观察到伏隔核和腹内侧前额叶皮层在同时获得的功能磁共振成像期间的神经活动在表现期间代表学习的刺激值,这一推断得到了支持。这种效果仅在 ON 状态下表达,这些区域的活动与更好的表现相关。我们的数据表明,多巴胺对伏隔核和腹内侧前额叶皮层的调节对选择行为有特定影响,与纯粹的学习不同。这些发现与大量其他证据一致,即学习的某些方面不受多巴胺损伤或耗竭的影响,并且多巴胺在表现中起着关键作用,这可能与它在学习中的作用不同。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/467af153aa47/aws083f5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/fbe094b850a4/aws083f1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/cc8bdcc6226c/aws083f2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/dbf4cc14e386/aws083f3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/69db58632813/aws083f4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/467af153aa47/aws083f5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/fbe094b850a4/aws083f1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/cc8bdcc6226c/aws083f2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/dbf4cc14e386/aws083f3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/69db58632813/aws083f4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3a4/3359751/467af153aa47/aws083f5.jpg

相似文献

1
Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease.多巴胺与强化学习任务中的表现:来自帕金森病的证据。
Brain. 2012 Jun;135(Pt 6):1871-83. doi: 10.1093/brain/aws083. Epub 2012 Apr 15.
2
L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson's disease.左旋多巴在帕金森病反转学习过程中会扰乱伏隔核的活动。
Neuropsychopharmacology. 2007 Jan;32(1):180-9. doi: 10.1038/sj.npp.1301153. Epub 2006 Jul 12.
3
Effects of levodopa on stimulus-response learning versus response selection in healthy young adults.左旋多巴对健康年轻成年人刺激-反应学习与反应选择的影响。
Behav Brain Res. 2017 Jan 15;317:553-561. doi: 10.1016/j.bbr.2016.10.019. Epub 2016 Oct 12.
4
Decomposing effects of dopaminergic medication in Parkinson's disease on probabilistic action selection--learning or performance?帕金森病中多巴胺能药物对概率动作选择的分解效应——学习还是表现?
Eur J Neurosci. 2012 Apr;35(7):1144-51. doi: 10.1111/j.1460-9568.2012.08043.x.
5
Dose dependent dopaminergic modulation of reward-based learning in Parkinson's disease.帕金森病中基于奖励的学习的多巴胺能调节与剂量相关。
Neuropsychologia. 2012 Apr;50(5):583-91. doi: 10.1016/j.neuropsychologia.2011.12.012. Epub 2011 Dec 27.
6
Distinct effects of dopamine vs STN stimulation therapies in associative learning and retention in Parkinson disease.多巴胺与丘脑底核刺激疗法对帕金森病联想学习和记忆的不同影响。
Behav Brain Res. 2016 Apr 1;302:131-41. doi: 10.1016/j.bbr.2016.01.010. Epub 2016 Jan 8.
7
Dopaminergic modulation of high-level cognition in Parkinson's disease: the role of the prefrontal cortex revealed by PET.帕金森病中多巴胺能对高级认知的调节作用:PET揭示的前额叶皮质的作用
Brain. 2002 Mar;125(Pt 3):584-94. doi: 10.1093/brain/awf052.
8
Dopamine substitution alters effective connectivity of cortical prefrontal, premotor, and motor regions during complex bimanual finger movements in Parkinson's disease.多巴胺替代治疗改变帕金森病患者复杂双手手指运动时皮质前额叶、运动前区和运动区的有效连通性。
Neuroimage. 2019 Apr 15;190:118-132. doi: 10.1016/j.neuroimage.2018.04.030. Epub 2018 Apr 23.
9
Levodopa influences striatal activity but does not affect cortical hyper-activity in Parkinson's disease.左旋多巴影响纹状体的活动,但不影响帕金森病患者皮质的过度活跃。
Eur J Neurosci. 2012 Feb;35(4):572-83. doi: 10.1111/j.1460-9568.2011.07979.x. Epub 2012 Feb 3.
10
Dopaminergic modulation of cognitive interference after pharmacological washout in Parkinson's disease.帕金森病药物洗脱后认知干扰的多巴胺能调节
Brain Res Bull. 2007 Sep 14;74(1-3):75-83. doi: 10.1016/j.brainresbull.2007.05.009. Epub 2007 Jun 6.

引用本文的文献

1
Gambling Environment Exposure Increases Temporal Discounting but Improves Model-Based Control in Regular Slot-Machine Gamblers.接触赌博环境会增加时间折扣,但会改善经常玩老虎机的赌徒基于模型的控制能力。
Comput Psychiatr. 2022 Jul 5;6(1):142-165. doi: 10.5334/cpsy.84. eCollection 2022.
2
Impaired value-based decision-making in Parkinson's disease apathy.帕金森病淡漠患者的基于价值的决策受损。
Brain. 2024 Apr 4;147(4):1362-1376. doi: 10.1093/brain/awae025.
3
Advances in clinical basic research: Performance, treatments, and mechanisms of Parkinson disease.

本文引用的文献

1
Inverted-U-shaped dopamine actions on human working memory and cognitive control.多巴胺对人类工作记忆和认知控制的倒 U 型作用。
Biol Psychiatry. 2011 Jun 15;69(12):e113-25. doi: 10.1016/j.biopsych.2011.03.028. Epub 2011 May 4.
2
Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices.纹状体和腹内侧前额叶皮层中的多巴胺介导的强化学习信号是基于价值的选择的基础。
J Neurosci. 2011 Feb 2;31(5):1606-13. doi: 10.1523/JNEUROSCI.3904-10.2011.
3
From reinforcement learning models to psychiatric and neurological disorders.
临床基础研究进展:帕金森病的表现、治疗及机制
Ibrain. 2021 Dec 23;7(4):362-378. doi: 10.1002/ibra.12011. eCollection 2021 Winter.
4
Reliability of gamified reinforcement learning in densely sampled longitudinal assessments.密集抽样纵向评估中游戏化强化学习的可靠性
PLOS Digit Health. 2023 Sep 6;2(9):e0000330. doi: 10.1371/journal.pdig.0000330. eCollection 2023 Sep.
5
A Brief Review on the Potential of Psychedelics for Treating Alzheimer's Disease and Related Depression.迷幻剂治疗阿尔茨海默病及相关抑郁症的潜力简述。
Int J Mol Sci. 2023 Aug 7;24(15):12513. doi: 10.3390/ijms241512513.
6
Impulse control disorder in Parkinson's disease is associated with abnormal frontal value signalling.帕金森病中的冲动控制障碍与额叶价值信号异常有关。
Brain. 2023 Sep 1;146(9):3676-3689. doi: 10.1093/brain/awad162.
7
On the normative advantages of dopamine and striatal opponency for learning and choice.多巴胺和纹状体拮抗作用在学习和选择中的规范优势。
Elife. 2023 Mar 22;12:e85107. doi: 10.7554/eLife.85107.
8
What Is Social about Autism? The Role of Allostasis-Driven Learning.自闭症的社会性体现在何处?基于稳态调节驱动学习的作用。
Brain Sci. 2021 Sep 25;11(10):1269. doi: 10.3390/brainsci11101269.
9
Application of Three Ecological Assessment Tools in Examining Chromatographic Methods for the Green Analysis of a Mixture of Dopamine, Serotonin, Glutamate and GABA: A Comparative Study.三种生态评估工具在考察混合多巴胺、血清素、谷氨酸和 GABA 的色谱方法的绿色分析中的应用:比较研究。
Molecules. 2021 Sep 7;26(18):5436. doi: 10.3390/molecules26185436.
10
Rational inattention and tonic dopamine.理性忽视与基础多巴胺。
PLoS Comput Biol. 2021 Mar 24;17(3):e1008659. doi: 10.1371/journal.pcbi.1008659. eCollection 2021 Mar.
从强化学习模型到精神和神经疾病。
Nat Neurosci. 2011 Feb;14(2):154-62. doi: 10.1038/nn.2723.
4
Tonic dopamine modulates exploitation of reward learning.强直性多巴胺调节奖赏学习的利用。
Front Behav Neurosci. 2010 Nov 4;4:170. doi: 10.3389/fnbeh.2010.00170. eCollection 2010.
5
Differential influence of levodopa on reward-based learning in Parkinson's disease.左旋多巴对帕金森病基于奖励学习的差异性影响。
Front Hum Neurosci. 2010 Oct 14;4:169. doi: 10.3389/fnhum.2010.00169. eCollection 2010.
6
Differentiable neural substrates for learned and described value and risk.可微分的学习价值和描述价值及风险的神经基础
Curr Biol. 2010 Oct 26;20(20):1823-9. doi: 10.1016/j.cub.2010.08.048. Epub 2010 Sep 30.
7
Opponency revisited: competition and cooperation between dopamine and serotonin.对立重温:多巴胺和血清素之间的竞争与合作。
Neuropsychopharmacology. 2011 Jan;36(1):74-97. doi: 10.1038/npp.2010.151. Epub 2010 Sep 29.
8
Serotonin and dopamine: unifying affective, activational, and decision functions.血清素和多巴胺:统一情感、激活和决策功能。
Neuropsychopharmacology. 2011 Jan;36(1):98-113. doi: 10.1038/npp.2010.121. Epub 2010 Aug 25.
9
Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making.在做决策时,奖赏和惩罚目标值被编码在眶额内侧皮质。
J Neurosci. 2010 Aug 11;30(32):10799-808. doi: 10.1523/JNEUROSCI.0788-10.2010.
10
Economic choices can be made using only stimulus values.经济选择可以仅使用刺激值做出。
Proc Natl Acad Sci U S A. 2010 Aug 24;107(34):15005-10. doi: 10.1073/pnas.1002258107. Epub 2010 Aug 9.