Suppr超能文献

当稳定的意外事件促进奖励历史的整合时,眶额皮质通过预测编码发出预期结果的信号。

Orbitofrontal Cortex Signals Expected Outcomes with Predictive Codes When Stable Contingencies Promote the Integration of Reward History.

作者信息

Riceberg Justin S, Shapiro Matthew L

机构信息

Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, New York 10029

Department of Neuroscience, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, New York 10029.

出版信息

J Neurosci. 2017 Feb 22;37(8):2010-2021. doi: 10.1523/JNEUROSCI.2951-16.2016. Epub 2017 Jan 23.

Abstract

Memory can inform goal-directed behavior by linking current opportunities to past outcomes. The orbitofrontal cortex (OFC) may guide value-based responses by integrating the history of stimulus-reward associations into expected outcomes, representations of predicted hedonic value and quality. Alternatively, the OFC may rapidly compute flexible "online" reward predictions by associating stimuli with the latest outcome. OFC neurons develop predictive codes when rats learn to associate arbitrary stimuli with outcomes, but the extent to which predictive coding depends on most recent events and the integrated history of rewards is unclear. To investigate how reward history modulates OFC activity, we recorded OFC ensembles as rats performed spatial discriminations that differed only in the number of rewarded trials between goal reversals. The firing rate of single OFC neurons distinguished identical behaviors guided by different goals. When >20 rewarded trials separated goal switches, OFC ensembles developed stable and anticorrelated population vectors that predicted overall choice accuracy and the goal selected in single trials. When <10 rewarded trials separated goal switches, OFC population vectors decorrelated rapidly after each switch, but did not develop anticorrelated firing patterns or predict choice accuracy. The results show that, whereas OFC signals respond rapidly to contingency changes, they predict choices only when reward history is relatively stable, suggesting that consecutive rewarded episodes are needed for OFC computations that integrate reward history into expected outcomes. Adapting to changing contingencies and making decisions engages the orbitofrontal cortex (OFC). Previous work shows that OFC function can either improve or impair learning depending on reward stability, suggesting that OFC guides behavior optimally when contingencies apply consistently. The mechanisms that link reward history to OFC computations remain obscure. Here, we examined OFC unit activity as rodents performed tasks controlled by contingencies that varied reward history. When contingencies were stable, OFC neurons signaled past, present, and pending events; when contingencies were unstable, past and present coding persisted, but predictive coding diminished. The results suggest that OFC mechanisms require stable contingencies across consecutive episodes to integrate reward history, represent predicted outcomes, and inform goal-directed choices.

摘要

记忆可通过将当前机会与过去的结果相联系来指导目标导向行为。眶额皮质(OFC)可能通过将刺激-奖励关联的历史整合到预期结果、预测享乐价值和质量的表征中,来指导基于价值的反应。或者,眶额皮质可能通过将刺激与最新结果相关联,快速计算灵活的“在线”奖励预测。当大鼠学会将任意刺激与结果相关联时,眶额皮质神经元会形成预测编码,但预测编码在多大程度上依赖于最近的事件以及奖励的综合历史尚不清楚。为了研究奖励历史如何调节眶额皮质的活动,我们在大鼠进行空间辨别任务时记录了眶额皮质神经元群,这些任务在目标反转之间仅奖励试验次数不同。单个眶额皮质神经元的放电率区分了由不同目标指导的相同行为。当目标切换之间有超过20次奖励试验时,眶额皮质神经元群形成了稳定且反相关的群体向量,这些向量预测了总体选择准确性和单次试验中选择的目标。当目标切换之间有少于10次奖励试验时,眶额皮质群体向量在每次切换后迅速去相关,但没有形成反相关的放电模式,也没有预测选择准确性。结果表明,虽然眶额皮质信号对意外变化反应迅速,但它们仅在奖励历史相对稳定时才预测选择,这表明将奖励历史整合到预期结果中的眶额皮质计算需要连续的奖励事件。适应不断变化的意外情况并做出决策涉及眶额皮质(OFC)。先前的研究表明,眶额皮质功能根据奖励稳定性既可以改善学习也可以损害学习,这表明当意外情况持续适用时,眶额皮质能最佳地指导行为。将奖励历史与眶额皮质计算联系起来的机制仍然不清楚。在这里,我们在啮齿动物执行由不同奖励历史的意外情况控制的任务时,检查了眶额皮质单位活动。当意外情况稳定时,眶额皮质神经元对过去、现在和即将发生的事件发出信号;当意外情况不稳定时,过去和现在的编码持续存在,但预测编码减弱。结果表明,眶额皮质机制需要连续事件中的稳定意外情况来整合奖励历史、表征预测结果并指导目标导向的选择。

相似文献

3

引用本文的文献

2
A goal pointer for a cognitive map in the orbitofrontal cortex.眶额皮质中认知地图的目标指针。
Curr Opin Neurobiol. 2023 Oct 28;83:102803. doi: 10.1016/j.conb.2023.102803.
6
Organization of orbitofrontal-auditory pathways in the Mongolian gerbil.眶额-听觉通路在蒙古沙鼠中的组织。
J Comp Neurol. 2023 Oct;531(14):1459-1481. doi: 10.1002/cne.25525. Epub 2023 Jul 21.
10

本文引用的文献

1
Decoding subjective decisions from orbitofrontal cortex.从眶额皮质解读主观决策
Nat Neurosci. 2016 Jul;19(7):973-80. doi: 10.1038/nn.4320. Epub 2016 Jun 6.
3
What the orbitofrontal cortex does not do.眶额皮质不具备的功能。
Nat Neurosci. 2015 May;18(5):620-7. doi: 10.1038/nn.3982.
5
Orbitofrontal cortex as a cognitive map of task space.眶额皮质作为任务空间的认知图。
Neuron. 2014 Jan 22;81(2):267-279. doi: 10.1016/j.neuron.2013.11.005.
9
The orbitofrontal cortex and response selection.眶额皮质与反应选择。
Ann N Y Acad Sci. 2011 Dec;1239:25-32. doi: 10.1111/j.1749-6632.2011.06279.x.

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验