Suppr超能文献

偶发学习中延迟结果的信用分配神经机制。

Neural mechanisms of credit assignment for delayed outcomes during contingent learning.

作者信息

Witkowski Phillip P, Rondot Lindsay, Kurth-Nelson Zeb, Garvert Mona M, Dolan Raymond J, Behrens Timothy E J, Boorman Erie D

机构信息

Center for Mind and Brain, University of California Davis, Davis, CA, 95618.

Department of Psychology, University of California Davis, Davis, CA, 95618.

出版信息

bioRxiv. 2024 Dec 12:2024.08.06.606895. doi: 10.1101/2024.08.06.606895.

Abstract

Adaptive behavior in complex environments critically relies on the ability to appropriately link specific choices or actions to their outcomes. However, the neural mechanisms that support the ability to credit only those past choices believed to have caused the observed outcomes remain unclear. Here, we leverage multivariate pattern analyses of functional magnetic resonance imaging (fMRI) data and an adaptive learning task to shed light on the underlying neural mechanisms of such specific credit assignment. We find that the lateral orbitofrontal cortex (lOFC) and hippocampus (HC) code for the causal choice identity when credit needs to be assigned for choices that are separated from outcomes by a long delay, even when this delayed transition is punctuated by interim decisions. Further, we show when interim decisions must be made, learning is additionally supported by lateral frontopolar cortex (lFPC). Our results indicate that lFPC holds previous causal choices in a "pending" state until a relevant outcome is observed, and the fidelity of these representations predicts the fidelity of subsequent causal choice representations in lOFC and HC during credit assignment. Together, these results highlight the importance of the timely reinstatement of specific causes in lOFC and HC in learning choice-outcome relationships when delays and choices intervene, a critical component of real-world learning and decision making.

摘要

在复杂环境中的适应性行为严重依赖于将特定选择或行动与其结果进行适当关联的能力。然而,支持仅将那些被认为导致了观察到的结果的过去选择进行归因的能力的神经机制仍不清楚。在这里,我们利用功能磁共振成像(fMRI)数据的多变量模式分析和一项适应性学习任务,来揭示这种特定归因的潜在神经机制。我们发现,当需要对与结果有长时间延迟间隔的选择进行归因时,外侧眶额皮质(lOFC)和海马体(HC)会编码因果选择身份,即使这种延迟转换被中间决策打断。此外,我们表明,当必须做出中间决策时,外侧额极皮质(lFPC)会额外支持学习。我们的结果表明,lFPC会将先前的因果选择保持在“待定”状态,直到观察到相关结果,并且这些表征的保真度预测了在归因过程中lOFC和HC中后续因果选择表征的保真度。总之,这些结果凸显了在延迟和选择介入时,及时恢复lOFC和HC中特定原因对于学习选择 - 结果关系的重要性,这是现实世界学习和决策的关键组成部分。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d7a6/11664969/5eb372d03511/nihpp-2024.08.06.606895v2-f0001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验