文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

Reward-Guided Learning with and without Causal Attribution.

作者信息

Jocham Gerhard, Brodersen Kay H, Constantinescu Alexandra O, Kahn Martin C, Ianni Angela M, Walton Mark E, Rushworth Matthew F S, Behrens Timothy E J

机构信息

Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, John Radcliffe Hospital, Oxford OX3 9DU, UK; Center for Behavioral Brain Sciences, Otto-von-Guericke-Universität Magdeburg, Universitätsplatz 2, 39106 Magdeburg, Germany; Faculty of Economics and Management, Otto-von-Guericke-Universität Magdeburg, Universitätsplatz 2, 39106 Magdeburg, Germany.

Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, John Radcliffe Hospital, Oxford OX3 9DU, UK; Department of Experimental Psychology, University of Oxford, South Parks Road, Oxford OX1 3UD, UK.

出版信息

Neuron. 2016 Apr 6;90(1):177-90. doi: 10.1016/j.neuron.2016.02.018. Epub 2016 Mar 10.


DOI:10.1016/j.neuron.2016.02.018
PMID:26971947
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC4826429/
Abstract

When an organism receives a reward, it is crucial to know which of many candidate actions caused this reward. However, recent work suggests that learning is possible even when this most fundamental assumption is not met. We used novel reward-guided learning paradigms in two fMRI studies to show that humans deploy separable learning mechanisms that operate in parallel. While behavior was dominated by precise contingent learning, it also revealed hallmarks of noncontingent learning strategies. These learning mechanisms were separable behaviorally and neurally. Lateral orbitofrontal cortex supported contingent learning and reflected contingencies between outcomes and their causal choices. Amygdala responses around reward times related to statistical patterns of learning. Time-based heuristic mechanisms were related to activity in sensorimotor corticostriatal circuitry. Our data point to the existence of several learning mechanisms in the human brain, of which only one relies on applying known rules about the causal structure of the task.

摘要
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/fc089f5a0cc0/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/974482260ed4/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/707b0d1fe2f9/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/0a5e322d4d86/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/7c14aa4649b2/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/ca60a5986b63/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/fda5623417ba/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/fc089f5a0cc0/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/974482260ed4/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/707b0d1fe2f9/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/0a5e322d4d86/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/7c14aa4649b2/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/ca60a5986b63/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/fda5623417ba/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a45b/4826429/fc089f5a0cc0/gr7.jpg

相似文献

[1]
Reward-Guided Learning with and without Causal Attribution.

Neuron. 2016-4-6

[2]
Differential coding of goals and actions in ventral and dorsal corticostriatal circuits during goal-directed behavior.

Cell Rep. 2022-1-4

[3]
Contrasting Roles for Orbitofrontal Cortex and Amygdala in Credit Assignment and Learning in Macaques.

Neuron. 2015-9-2

[4]
Neural correlates of outcome processing post dishonest choice: an fMRI and ERP study.

Neuropsychologia. 2015-1-10

[5]
Corticostriatal Circuits Encode the Subjective Value of Perceived Control.

Cereb Cortex. 2019-12-17

[6]
Contextual modulation of value signals in reward and punishment learning.

Nat Commun. 2015-8-25

[7]
Instrumental learning of traits versus rewards: dissociable neural correlates and effects on choice.

Nat Neurosci. 2015-8-3

[8]
Primate Orbitofrontal Cortex Codes Information Relevant for Managing Explore-Exploit Tradeoffs.

J Neurosci. 2020-2-14

[9]
Contributions of the amygdala to reward expectancy and choice signals in human prefrontal cortex.

Neuron. 2007-8-16

[10]
Amygdala Contributions to Stimulus-Reward Encoding in the Macaque Medial and Orbital Frontal Cortex during Learning.

J Neurosci. 2017-2-22

引用本文的文献

[1]
Higher-order and distributed synergistic functional interactions encode information gain in goal-directed learning.

Nat Commun. 2025-8-5

[2]
A State-Transition-Free Delayed-Feedback Task Elicits Heterogeneous Human Responses.

J Cogn. 2025-7-14

[3]
Chemogenetic inhibition of amygdala to ventrolateral prefrontal cortex communication selectively impacts contingent learning.

bioRxiv. 2025-6-27

[4]
Persistent representation of a prior schema in the orbitofrontal cortex facilitates learning of a conflicting schema.

bioRxiv. 2025-3-1

[5]
The Role of the N170 in Linking Stimuli to Feedback-Effects of Stimulus Modality and Feedback Delay.

Psychophysiology. 2025-4

[6]
Neural mechanisms of credit assignment for delayed outcomes during contingent learning.

Elife. 2025-4-15

[7]
Neural mechanisms of credit assignment for delayed outcomes during contingent learning.

bioRxiv. 2024-12-12

[8]
Dissociable Representations of Decision Variables within Subdivisions of the Macaque Orbital and Ventrolateral Frontal Cortex.

J Neurosci. 2024-8-28

[9]
Surprise-minimization as a solution to the structural credit assignment problem.

PLoS Comput Biol. 2024-5-28

[10]
Therapeutic doses of ketamine acutely attenuate the aversive effect of losses during decision-making.

Elife. 2024-5-3

本文引用的文献

[1]
A critical time window for dopamine actions on the structural plasticity of dendritic spines.

Science. 2014-9-26

[2]
Orbitofrontal cortex as a cognitive map of task space.

Neuron. 2014-1-22

[3]
Choice coding in frontal cortex during stimulus-guided or action-guided decision-making.

J Neurosci. 2013-1-30

[4]
A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex.

Nat Neurosci. 2012-6-17

[5]
Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex.

Nat Neurosci. 2011-10-30

[6]
Dopaminergic genes predict individual differences in susceptibility to confirmation bias.

J Neurosci. 2011-4-20

[7]
Model-based influences on humans' choices and striatal prediction errors.

Neuron. 2011-3-24

[8]
Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning.

Neuron. 2010-3-25

[9]
A new perspective on the role of the orbitofrontal cortex in adaptive behaviour.

Nat Rev Neurosci. 2009-12

[10]
The convergence of information about rewarding and aversive stimuli in single neurons.

J Neurosci. 2009-9-16

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索