• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

偶发学习中延迟结果的信用分配神经机制。

Neural mechanisms of credit assignment for delayed outcomes during contingent learning.

作者信息

Witkowski Phillip P, Rondot Lindsay, Kurth-Nelson Zeb, Garvert Mona M, Dolan Raymond J, Behrens Timothy E J, Boorman Erie D

机构信息

Center for Mind and Brain, University of California Davis, Davis, CA, 95618.

Department of Psychology, University of California Davis, Davis, CA, 95618.

出版信息

bioRxiv. 2024 Dec 12:2024.08.06.606895. doi: 10.1101/2024.08.06.606895.

DOI:10.1101/2024.08.06.606895
PMID:39149338
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11326259/
Abstract

Adaptive behavior in complex environments critically relies on the ability to appropriately link specific choices or actions to their outcomes. However, the neural mechanisms that support the ability to credit only those past choices believed to have caused the observed outcomes remain unclear. Here, we leverage multivariate pattern analyses of functional magnetic resonance imaging (fMRI) data and an adaptive learning task to shed light on the underlying neural mechanisms of such specific credit assignment. We find that the lateral orbitofrontal cortex (lOFC) and hippocampus (HC) code for the causal choice identity when credit needs to be assigned for choices that are separated from outcomes by a long delay, even when this delayed transition is punctuated by interim decisions. Further, we show when interim decisions must be made, learning is additionally supported by lateral frontopolar cortex (lFPC). Our results indicate that lFPC holds previous causal choices in a "pending" state until a relevant outcome is observed, and the fidelity of these representations predicts the fidelity of subsequent causal choice representations in lOFC and HC during credit assignment. Together, these results highlight the importance of the timely reinstatement of specific causes in lOFC and HC in learning choice-outcome relationships when delays and choices intervene, a critical component of real-world learning and decision making.

摘要

在复杂环境中的适应性行为严重依赖于将特定选择或行动与其结果进行适当关联的能力。然而,支持仅将那些被认为导致了观察到的结果的过去选择进行归因的能力的神经机制仍不清楚。在这里,我们利用功能磁共振成像(fMRI)数据的多变量模式分析和一项适应性学习任务,来揭示这种特定归因的潜在神经机制。我们发现,当需要对与结果有长时间延迟间隔的选择进行归因时,外侧眶额皮质(lOFC)和海马体(HC)会编码因果选择身份,即使这种延迟转换被中间决策打断。此外,我们表明,当必须做出中间决策时,外侧额极皮质(lFPC)会额外支持学习。我们的结果表明,lFPC会将先前的因果选择保持在“待定”状态,直到观察到相关结果,并且这些表征的保真度预测了在归因过程中lOFC和HC中后续因果选择表征的保真度。总之,这些结果凸显了在延迟和选择介入时,及时恢复lOFC和HC中特定原因对于学习选择 - 结果关系的重要性,这是现实世界学习和决策的关键组成部分。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/f74e4e8ab6a2/nihpp-2024.08.06.606895v2-f0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/5eb372d03511/nihpp-2024.08.06.606895v2-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/0b3dfd21917a/nihpp-2024.08.06.606895v2-f0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/6fb5b304d184/nihpp-2024.08.06.606895v2-f0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/f74e4e8ab6a2/nihpp-2024.08.06.606895v2-f0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/5eb372d03511/nihpp-2024.08.06.606895v2-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/0b3dfd21917a/nihpp-2024.08.06.606895v2-f0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/6fb5b304d184/nihpp-2024.08.06.606895v2-f0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/f74e4e8ab6a2/nihpp-2024.08.06.606895v2-f0004.jpg

相似文献

1
Neural mechanisms of credit assignment for delayed outcomes during contingent learning.偶发学习中延迟结果的信用分配神经机制。
bioRxiv. 2024 Dec 12:2024.08.06.606895. doi: 10.1101/2024.08.06.606895.
2
Neural mechanisms of credit assignment for delayed outcomes during contingent learning.偶联学习中延迟结果的信用分配神经机制。
Elife. 2025 Apr 15;13:RP101841. doi: 10.7554/eLife.101841.
3
Contrasting Effects of Medial and Lateral Orbitofrontal Cortex Lesions on Credit Assignment and Decision-Making in Humans.内侧和外侧眶额皮质损伤对人类信用分配和决策的对比影响
J Neurosci. 2017 Jul 19;37(29):7023-7035. doi: 10.1523/JNEUROSCI.0692-17.2017. Epub 2017 Jun 19.
4
Prefrontal cortex state representations shape human credit assignment.前额皮质状态表示塑造人类的信用分配。
Elife. 2023 Jul 3;12:e84888. doi: 10.7554/eLife.84888.
5
Prefrontal Neurons Encode a Solution to the Credit-Assignment Problem.前额叶神经元编码信用分配问题的解决方案。
J Neurosci. 2017 Jul 19;37(29):6995-7007. doi: 10.1523/JNEUROSCI.3311-16.2017. Epub 2017 Jun 20.
6
Neural Mechanisms of Credit Assignment in a Multicue Environment.多线索环境下的信用分配神经机制
J Neurosci. 2016 Jan 27;36(4):1096-112. doi: 10.1523/JNEUROSCI.3159-15.2016.
7
Neural mechanisms of credit assignment for inferred relationships in a structured world.在结构化世界中对推断关系进行信用分配的神经机制。
Neuron. 2022 Aug 17;110(16):2680-2690.e9. doi: 10.1016/j.neuron.2022.05.021. Epub 2022 Jun 16.
8
Counterfactual choice and learning in a neural network centered on human lateral frontopolar cortex.以人类外侧额极皮层为中心的神经网络中的反事实选择与学习。
PLoS Biol. 2011 Jun;9(6):e1001093. doi: 10.1371/journal.pbio.1001093. Epub 2011 Jun 28.
9
Giving credit where credit is due: orbitofrontal cortex and valuation in an uncertain world.有其功,必赏其劳:眶额皮质与不确定世界中的价值评估。
Ann N Y Acad Sci. 2011 Dec;1239:14-24. doi: 10.1111/j.1749-6632.2011.06257.x.
10
Contrasting Roles for Orbitofrontal Cortex and Amygdala in Credit Assignment and Learning in Macaques.眶额皮质和杏仁核在猕猴信用分配与学习中的不同作用
Neuron. 2015 Sep 2;87(5):1106-18. doi: 10.1016/j.neuron.2015.08.018.

本文引用的文献

1
Prefrontal cortex state representations shape human credit assignment.前额皮质状态表示塑造人类的信用分配。
Elife. 2023 Jul 3;12:e84888. doi: 10.7554/eLife.84888.
2
The role of the lateral orbitofrontal cortex in creating cognitive maps.外侧眶额皮层在创建认知地图中的作用。
Nat Neurosci. 2023 Jan;26(1):107-115. doi: 10.1038/s41593-022-01216-0. Epub 2022 Dec 22.
3
Prefrontal cortical activation associated with prospective memory while walking around a real-world street environment.在现实世界的街道环境中行走时与前瞻记忆相关的前额叶皮层激活。
Neuroimage. 2022 Sep;258:119392. doi: 10.1016/j.neuroimage.2022.119392. Epub 2022 Jun 15.
4
Neural mechanisms of credit assignment for inferred relationships in a structured world.在结构化世界中对推断关系进行信用分配的神经机制。
Neuron. 2022 Aug 17;110(16):2680-2690.e9. doi: 10.1016/j.neuron.2022.05.021. Epub 2022 Jun 16.
5
The hippocampus and orbitofrontal cortex jointly represent task structure during memory-guided decision making.海马体和眶额皮质在记忆引导的决策过程中共同表示任务结构。
Cell Rep. 2021 Nov 30;37(9):110065. doi: 10.1016/j.celrep.2021.110065.
6
Intrinsic connectivity reveals functionally distinct cortico-hippocampal networks in the human brain.内在连接揭示了人类大脑中功能上不同的皮质-海马网络。
PLoS Biol. 2021 Jun 2;19(6):e3001275. doi: 10.1371/journal.pbio.3001275. eCollection 2021 Jun.
7
The orbital frontal cortex, task structure, and inference.眶额皮质、任务结构与推理。
Behav Neurosci. 2021 Apr;135(2):291-300. doi: 10.1037/bne0000465.
8
The orbitofrontal cartographer.眶额皮质制图师。
Behav Neurosci. 2021 Apr;135(2):267-276. doi: 10.1037/bne0000463.
9
To be specific: The role of orbitofrontal cortex in signaling reward identity.具体来说:眶额皮质在信号奖励身份中的作用。
Behav Neurosci. 2021 Apr;135(2):210-217. doi: 10.1037/bne0000455. Epub 2021 Mar 18.
10
Neural circuits for inference-based decision-making.用于基于推理的决策的神经回路。
Curr Opin Behav Sci. 2021 Oct;41:10-14. doi: 10.1016/j.cobeha.2021.02.004. Epub 2021 Mar 6.