• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

解码学习过程中奖励预测的形成。

Decoding the formation of reward predictions across learning.

机构信息

Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging, Charité-Universitätsmedizin Berlin, D-10115 Berlin, Germany.

出版信息

J Neurosci. 2011 Oct 12;31(41):14624-30. doi: 10.1523/JNEUROSCI.3412-11.2011.

DOI:10.1523/JNEUROSCI.3412-11.2011
PMID:21994378
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6703411/
Abstract

The predicted reward of different behavioral options plays an important role in guiding decisions. Previous research has identified reward predictions in prefrontal and striatal brain regions. Moreover, it has been shown that the neural representation of a predicted reward is similar to the neural representation of the actual reward outcome. However, it has remained unknown how these representations emerge over the course of learning and how they relate to decision making. Here, we sought to investigate learning of predicted reward representations using functional magnetic resonance imaging and multivariate pattern classification. Using a pavlovian conditioning procedure, human subjects learned multiple novel cue-outcome associations in each scanning run. We demonstrate that across learning activity patterns in the orbitofrontal cortex, the dorsolateral prefrontal cortex (DLPFC), and the dorsal striatum, coding the value of predicted rewards become similar to the patterns coding the value of actual reward outcomes. Furthermore, we provide evidence that predicted reward representations in the striatum precede those in prefrontal regions and that representations in the DLPFC are linked to subsequent value-based choices. Our results show that different brain regions represent outcome predictions by eliciting the neural representation of the actual outcome. Furthermore, they suggest that reward predictions in the DLPFC are directly related to value-based choices.

摘要

不同行为选择的预测奖励在指导决策中起着重要作用。先前的研究已经确定了前额叶和纹状体脑区的奖励预测。此外,已经表明,预测奖励的神经表示与实际奖励结果的神经表示相似。然而,这些表示如何在学习过程中出现以及它们与决策的关系仍然未知。在这里,我们试图使用功能磁共振成像和多元模式分类来研究预测奖励表示的学习。使用巴甫洛夫条件反射程序,人类受试者在每次扫描运行中学习多个新的线索-结果关联。我们证明,在眶额皮层、背外侧前额叶皮层 (DLPFC) 和背侧纹状体中,编码预测奖励价值的活动模式变得与编码实际奖励结果价值的模式相似。此外,我们提供的证据表明,纹状体中的预测奖励表示先于前额叶区域中的表示,并且 DLPFC 中的表示与随后的基于价值的选择有关。我们的结果表明,不同的大脑区域通过引发实际结果的神经表示来表示结果预测。此外,它们表明 DLPFC 中的奖励预测与基于价值的选择直接相关。

相似文献

1
Decoding the formation of reward predictions across learning.解码学习过程中奖励预测的形成。
J Neurosci. 2011 Oct 12;31(41):14624-30. doi: 10.1523/JNEUROSCI.3412-11.2011.
2
Decoding different roles for vmPFC and dlPFC in multi-attribute decision making.解码 vmPFC 和 dlPFC 在多属性决策中的不同作用。
Neuroimage. 2011 May 15;56(2):709-15. doi: 10.1016/j.neuroimage.2010.05.058. Epub 2010 May 25.
3
Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making.确定腹内侧前额叶皮层在奖励相关决策过程中编码基于动作的价值信号方面的作用。
Cereb Cortex. 2009 Feb;19(2):483-95. doi: 10.1093/cercor/bhn098. Epub 2008 Jun 11.
4
Dissociating Value Representation and Inhibition of Inappropriate Affective Response during Reversal Learning in the Ventromedial Prefrontal Cortex.在腹内侧前额叶皮层的反转学习过程中,对价值表现和抑制不适当情感反应进行分离。
eNeuro. 2016 Jan 4;2(6). doi: 10.1523/ENEURO.0072-15.2015. eCollection 2015 Nov-Dec.
5
Neural representations of the amount and the delay time of reward in intertemporal decision making.在跨期决策中,对奖励数量和延迟时间的神经表示。
Hum Brain Mapp. 2021 Aug 1;42(11):3450-3469. doi: 10.1002/hbm.25445. Epub 2021 May 2.
6
Prefrontal cortex fails to learn from reward prediction errors in alcohol dependence.前额皮质在酒精依赖中无法从奖励预测错误中学习。
J Neurosci. 2010 Jun 2;30(22):7749-53. doi: 10.1523/JNEUROSCI.5587-09.2010.
7
Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors.区分眶额皮质和纹状体在目标价值计算和预测误差中的作用。
J Neurosci. 2008 May 28;28(22):5623-30. doi: 10.1523/JNEUROSCI.1309-08.2008.
8
Distinct portions of anterior cingulate cortex and medial prefrontal cortex are activated by reward processing in separable phases of decision-making cognition.在前扣带回皮层和内侧前额叶皮层的不同部分,在决策认知的不同阶段,由奖励处理激活。
Biol Psychiatry. 2004 Mar 15;55(6):594-602. doi: 10.1016/j.biopsych.2003.11.012.
9
Prior expectation modulates the interaction between sensory and prefrontal regions in the human brain.先前的期望调节了人类大脑中感觉和前额区域之间的相互作用。
J Neurosci. 2011 Jul 20;31(29):10741-8. doi: 10.1523/JNEUROSCI.1478-11.2011.
10
Distinct value signals in anterior and posterior ventromedial prefrontal cortex.前腹内侧前额皮质和后腹内侧前额皮质的独特价值信号。
J Neurosci. 2010 Feb 17;30(7):2490-5. doi: 10.1523/JNEUROSCI.3319-09.2010.

引用本文的文献

1
Representation of probabilistic outcomes during risky decision-making.风险决策过程中概率结果的表示。
Nat Commun. 2020 May 15;11(1):2419. doi: 10.1038/s41467-020-16202-y.
2
Neural representation of newly instructed rule identities during early implementation trials.新指令规则身份在早期实施试验中的神经表现。
Elife. 2019 Nov 18;8:e48293. doi: 10.7554/eLife.48293.
3
Amphetamine disrupts haemodynamic correlates of prediction errors in nucleus accumbens and orbitofrontal cortex.安非他命破坏伏隔核和眶额皮质中预测误差的血液动力学相关性。
Neuropsychopharmacology. 2020 Apr;45(5):793-803. doi: 10.1038/s41386-019-0564-8. Epub 2019 Nov 8.
4
Neural Dynamics Underlying the Evaluation Process of Ambiguous Options During Reward-Related Decision-Making.奖励相关决策过程中模糊选项评估过程背后的神经动力学
Front Psychol. 2019 Aug 28;10:1979. doi: 10.3389/fpsyg.2019.01979. eCollection 2019.
5
Common and Distinct Functional Brain Networks for Intuitive and Deliberate Decision Making.用于直觉和审慎决策的常见和独特功能性脑网络。
Brain Sci. 2019 Jul 20;9(7):174. doi: 10.3390/brainsci9070174.
6
Expectation effects on brain dopamine responses to methylphenidate in cocaine use disorder.期待效应对可卡因使用障碍者大脑对哌甲酯多巴胺反应的影响。
Transl Psychiatry. 2019 Feb 15;9(1):93. doi: 10.1038/s41398-019-0421-x.
7
Spatiotemporal dynamics of reward and punishment effects induced by associative learning.联想学习诱导的奖惩效应的时空动力学。
PLoS One. 2018 Nov 26;13(11):e0199847. doi: 10.1371/journal.pone.0199847. eCollection 2018.
8
Computing Value from Quality and Quantity in Human Decision-Making.从人类决策中的质量和数量中计算价值。
J Neurosci. 2019 Jan 2;39(1):163-176. doi: 10.1523/JNEUROSCI.0706-18.2018. Epub 2018 Nov 19.
9
Unbiased Analysis of Item-Specific Multi-Voxel Activation Patterns Across Learning.跨学习过程中特定项目多体素激活模式的无偏分析。
Front Neurosci. 2018 Oct 4;12:723. doi: 10.3389/fnins.2018.00723. eCollection 2018.
10
Mapping the human brain's cortical-subcortical functional network organization.绘制人类大脑皮质-皮质下功能网络组织图。
Neuroimage. 2019 Jan 15;185:35-57. doi: 10.1016/j.neuroimage.2018.10.006. Epub 2018 Oct 3.

本文引用的文献

1
Neurobiology of value integration: when value impacts valuation.价值整合的神经生物学:当价值影响估值时。
J Neurosci. 2011 Jun 22;31(25):9307-14. doi: 10.1523/JNEUROSCI.4973-10.2011.
2
Causal role of dorsolateral prefrontal cortex in human perceptual decision making.背外侧前额叶皮层在人类知觉决策中的因果作用。
Curr Biol. 2011 Jun 7;21(11):980-3. doi: 10.1016/j.cub.2011.04.034. Epub 2011 May 27.
3
Perceptual learning and decision-making in human medial frontal cortex.人类内侧前额叶皮层的知觉学习和决策。
Neuron. 2011 May 12;70(3):549-59. doi: 10.1016/j.neuron.2011.02.054.
4
Category learning in the brain.大脑中的类别学习。
Annu Rev Neurosci. 2010;33:203-19. doi: 10.1146/annurev.neuro.051508.135546.
5
Prefrontal cortex fails to learn from reward prediction errors in alcohol dependence.前额皮质在酒精依赖中无法从奖励预测错误中学习。
J Neurosci. 2010 Jun 2;30(22):7749-53. doi: 10.1523/JNEUROSCI.5587-09.2010.
6
Decoding different roles for vmPFC and dlPFC in multi-attribute decision making.解码 vmPFC 和 dlPFC 在多属性决策中的不同作用。
Neuroimage. 2011 May 15;56(2):709-15. doi: 10.1016/j.neuroimage.2010.05.058. Epub 2010 May 25.
7
The neural code of reward anticipation in human orbitofrontal cortex.人类眶额皮质中奖励预期的神经编码。
Proc Natl Acad Sci U S A. 2010 Mar 30;107(13):6010-5. doi: 10.1073/pnas.0912838107. Epub 2010 Mar 15.
8
Adaptation of reward sensitivity in orbitofrontal neurons.眶额皮质神经元奖赏敏感性的适应性。
J Neurosci. 2010 Jan 13;30(2):534-44. doi: 10.1523/JNEUROSCI.4009-09.2010.
9
Multiscale pattern analysis of orientation-selective activity in the primary visual cortex.多尺度模式分析初级视皮层中的朝向选择性活动。
J Neurosci. 2010 Jan 6;30(1):325-30. doi: 10.1523/JNEUROSCI.4811-09.2010.
10
How does an fMRI voxel sample the neuronal activity pattern: compact-kernel or complex spatiotemporal filter?功能磁共振成像体素如何采样神经元活动模式:紧致核还是复杂时空滤波器?
Neuroimage. 2010 Feb 1;49(3):1965-76. doi: 10.1016/j.neuroimage.2009.09.059. Epub 2009 Oct 1.