• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

眶额神经元发出奖励预测信号,而非奖励预测误差信号。

Orbitofrontal neurons signal reward predictions, not reward prediction errors.

作者信息

Stalnaker Thomas A, Liu Tzu-Lan, Takahashi Yuji K, Schoenbaum Geoffrey

机构信息

National Institute on Drug Abuse Intramural Research Program, Cellular Neurobiology Research Branch, Behavioral Neurophysiology Research Section, 251 Bayview Blvd., Baltimore, MD 21224, United States.

National Institute on Drug Abuse Intramural Research Program, Cellular Neurobiology Research Branch, Behavioral Neurophysiology Research Section, 251 Bayview Blvd., Baltimore, MD 21224, United States.

出版信息

Neurobiol Learn Mem. 2018 Sep;153(Pt B):137-143. doi: 10.1016/j.nlm.2018.01.013. Epub 2018 Jan 31.

DOI:10.1016/j.nlm.2018.01.013
PMID:29408053
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6136456/
Abstract

Neurons in the orbitofrontal cortex (OFC) fire in anticipation of and during rewards. Such firing has been suggested to encode reward predictions and to account in some way for the role of this area in adaptive behavior and learning. However, it has also been reported that neural activity in OFC reflects reward prediction errors, which might drive learning directly. Here we tested this question by analyzing the firing of OFC neurons recorded in an odor discrimination task in which rats were trained to sample odor cues and respond left or right on each trial for reward. Neurons were recorded across blocks of trials in which we switched either the number or the flavor of the reward delivered in each well. Previously we have described how neurons in this dataset fired to the predictive cues (Stalnaker et al., 2014); here we focused on the firing in anticipation of and just after delivery of each drop of reward, looking specifically for differences in firing based on whether the reward number or flavor was unexpected or expected. Unlike dopamine neurons recorded in this setting, which exhibited phasic error-like responses after surprising changes in either reward number or reward flavor (Takahashi et al., 2017), OFC neurons showed no such error correlates and instead fired in a way that reflected reward predictions.

摘要

眶额皮质(OFC)中的神经元在预期奖励和获得奖励期间会产生放电活动。这种放电活动被认为用于编码奖励预测,并在某种程度上解释该区域在适应性行为和学习中的作用。然而,也有报道称,眶额皮质中的神经活动反映了奖励预测误差,这可能直接驱动学习。在这里,我们通过分析在气味辨别任务中记录的眶额皮质神经元的放电情况来测试这个问题,在该任务中,大鼠经过训练对气味线索进行采样,并在每次试验中向左或向右做出反应以获得奖励。在一系列试验块中记录神经元活动,在每个试验块中,我们改变每个孔中给予奖励的数量或味道。此前我们已经描述了该数据集中的神经元如何对预测线索产生放电反应(Stalnaker等人,2014年);在这里,我们关注的是在预期每一滴奖励以及奖励给予之后的放电情况,特别关注基于奖励数量或味道是意外还是预期而产生的放电差异。与在这种情况下记录的多巴胺能神经元不同,多巴胺能神经元在奖励数量或奖励味道出现意外变化后会表现出阶段性的类似误差的反应(Takahashi等人,2017年),眶额皮质神经元没有表现出这种误差相关性,而是以反映奖励预测的方式进行放电。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/e3b454b02e6a/nihms-1504476-f0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/e26282614cc0/nihms-1504476-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/86354c5c8dfe/nihms-1504476-f0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/a790f59f1935/nihms-1504476-f0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/e3b454b02e6a/nihms-1504476-f0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/e26282614cc0/nihms-1504476-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/86354c5c8dfe/nihms-1504476-f0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/a790f59f1935/nihms-1504476-f0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/e3b454b02e6a/nihms-1504476-f0004.jpg

相似文献

1
Orbitofrontal neurons signal reward predictions, not reward prediction errors.眶额神经元发出奖励预测信号,而非奖励预测误差信号。
Neurobiol Learn Mem. 2018 Sep;153(Pt B):137-143. doi: 10.1016/j.nlm.2018.01.013. Epub 2018 Jan 31.
2
Effects of inference on dopaminergic prediction errors depend on orbitofrontal processing.推理对多巴胺能预测误差的影响取决于眶额皮质的加工过程。
Behav Neurosci. 2017 Apr;131(2):127-134. doi: 10.1037/bne0000192.
3
Orbitofrontal Cortex Signals Expected Outcomes with Predictive Codes When Stable Contingencies Promote the Integration of Reward History.当稳定的意外事件促进奖励历史的整合时,眶额皮质通过预测编码发出预期结果的信号。
J Neurosci. 2017 Feb 22;37(8):2010-2021. doi: 10.1523/JNEUROSCI.2951-16.2016. Epub 2017 Jan 23.
4
Medial Orbitofrontal Neurons Preferentially Signal Cues Predicting Changes in Reward during Unblocking.内侧眶额神经元在解除阻塞期间优先发出预测奖励变化的线索信号。
J Neurosci. 2016 Aug 10;36(32):8416-24. doi: 10.1523/JNEUROSCI.1101-16.2016.
5
Neurons in rat orbitofrontal cortex and medial prefrontal cortex exhibit distinct responses in reward and strategy-update in a risk-based decision-making task.在基于风险的决策任务中,大鼠眶额皮层和内侧前额叶皮层的神经元在奖励和策略更新方面表现出不同的反应。
Metab Brain Dis. 2019 Apr;34(2):417-429. doi: 10.1007/s11011-018-0360-x. Epub 2018 Dec 8.
6
Expectancy-related changes in firing of dopamine neurons depend on hippocampus.与期望相关的多巴胺神经元放电变化取决于海马体。
Nat Commun. 2024 Oct 16;15(1):8911. doi: 10.1038/s41467-024-53308-z.
7
Increased firing to cues that predict low-value reward in the medial orbitofrontal cortex.内侧眶额皮质中对预测低价值奖励线索的放电增加。
Cereb Cortex. 2014 Dec;24(12):3310-21. doi: 10.1093/cercor/bht189. Epub 2013 Jul 30.
8
Prefrontal Regulation of Neuronal Activity in the Ventral Tegmental Area.腹侧被盖区神经元活动的前额叶调节
Cereb Cortex. 2016 Oct;26(10):4057-4068. doi: 10.1093/cercor/bhv215. Epub 2015 Sep 22.
9
Orbitofrontal State Representations Are Related to Choice Adaptations and Reward Predictions.眶额状态代表与选择适应和奖励预测有关。
J Neurosci. 2021 Mar 3;41(9):1941-1951. doi: 10.1523/JNEUROSCI.0753-20.2020. Epub 2021 Jan 14.
10
Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex.与期望相关的多巴胺神经元放电变化取决于眶额皮质。
Nat Neurosci. 2011 Oct 30;14(12):1590-7. doi: 10.1038/nn.2957.

引用本文的文献

1
[Synchronized neural rhythms in rat hippocampal CA1 region and orbitofrontal cortex are involved in learning and memory consolidation in spatial goal-directed tasks].大鼠海马CA1区和眶额叶皮质的同步神经节律参与空间目标导向任务中的学习和记忆巩固
Nan Fang Yi Ke Da Xue Xue Bao. 2025 Mar 20;45(3):479-487. doi: 10.12122/j.issn.1673-4254.2025.03.05.
2
Predictive filtering of sensory response via orbitofrontal top-down input.通过眶额皮质自上而下的输入对感觉反应进行预测性过滤。
bioRxiv. 2025 Feb 26:2024.09.17.613562. doi: 10.1101/2024.09.17.613562.
3
Cracking and Packing Information about the Features of Expected Rewards in the Orbitofrontal Cortex.

本文引用的文献

1
Dopamine Neurons Respond to Errors in the Prediction of Sensory Features of Expected Rewards.多巴胺神经元对预期奖励的感觉特征预测错误做出反应。
Neuron. 2017 Sep 13;95(6):1395-1405.e3. doi: 10.1016/j.neuron.2017.08.025.
2
Selective impairment of goal-directed decision-making following lesions to the human ventromedial prefrontal cortex.人类腹内侧前额叶皮质受损后目标导向决策的选择性损伤。
Brain. 2017 Jun 1;140(6):1743-1756. doi: 10.1093/brain/awx105.
3
Two Anatomically and Computationally Distinct Learning Signals Predict Changes to Stimulus-Outcome Associations in Hippocampus.
裂脑术与关于眶额皮层预期奖赏特征的信息包埋。
J Neurosci. 2024 Sep 4;44(36):e0714242024. doi: 10.1523/JNEUROSCI.0714-24.2024.
4
Neurons of Macaque Frontal Eye Field Signal Reward-Related Surprise.猴额眼区神经元信号传递与奖赏相关的意外信息。
J Neurosci. 2024 Sep 18;44(38):e0441242024. doi: 10.1523/JNEUROSCI.0441-24.2024.
5
Chronic Ethanol Exposure Produces Persistent Impairment in Cognitive Flexibility and Decision Signals in the Striatum.长期乙醇暴露会导致纹状体认知灵活性和决策信号持续受损。
bioRxiv. 2025 Feb 25:2024.03.10.584332. doi: 10.1101/2024.03.10.584332.
6
Offline orbitofrontal cortex reactivation depends on recency of place-reward changes and coheres with hippocampal replay.眶额皮质的离线再激活取决于位置-奖励变化的近期性,并与海马体重演相一致。
iScience. 2024 Feb 10;27(3):109205. doi: 10.1016/j.isci.2024.109205. eCollection 2024 Mar 15.
7
Midbrain signaling of identity prediction errors depends on orbitofrontal cortex networks.中脑对身份预测误差的信号取决于眶额皮质网络。
Nat Commun. 2024 Feb 24;15(1):1704. doi: 10.1038/s41467-024-45880-1.
8
Neuronal implementation of the temporal difference learning algorithm in the midbrain dopaminergic system.中脑多巴胺能系统中神经元对时间差分学习算法的实现。
Proc Natl Acad Sci U S A. 2023 Nov 7;120(45):e2309015120. doi: 10.1073/pnas.2309015120. Epub 2023 Oct 30.
9
Blunted neural reward response to alcohol and greater alcohol motivation in binge drinkers in a randomized clinical experiment.在一项随机临床试验中,酗酒者对酒精的神经奖赏反应迟钝且对酒精的动机更强。
Alcohol Clin Exp Res (Hoboken). 2023 Jun;47(6):1067-1078. doi: 10.1111/acer.15082. Epub 2023 Apr 26.
10
The mediodorsal thalamus supports adaptive responding based on stimulus-outcome associations.丘脑背内侧核基于刺激-结果关联支持适应性反应。
Curr Res Neurobiol. 2022 Oct 14;3:100057. doi: 10.1016/j.crneur.2022.100057. eCollection 2022.
两个在解剖学和计算上不同的学习信号预测海马体中刺激-结果关联的变化。
Neuron. 2016 Mar 16;89(6):1343-1354. doi: 10.1016/j.neuron.2016.02.014. Epub 2016 Mar 3.
4
What the orbitofrontal cortex does not do.眶额皮质不具备的功能。
Nat Neurosci. 2015 May;18(5):620-7. doi: 10.1038/nn.3982.
5
Orbitofrontal cortex uses distinct codes for different choice attributes in decisions motivated by curiosity.眶额皮质在由好奇心驱动的决策中,对不同的选择属性使用不同的编码。
Neuron. 2015 Feb 4;85(3):602-14. doi: 10.1016/j.neuron.2014.12.050. Epub 2015 Jan 22.
6
The orbitofrontal oracle: cortical mechanisms for the prediction and evaluation of specific behavioral outcomes.眶额皮质的“预言家”:预测和评估特定行为结果的皮质机制
Neuron. 2014 Dec 17;84(6):1143-56. doi: 10.1016/j.neuron.2014.10.049.
7
Orbitofrontal neurons acquire responses to 'valueless' Pavlovian cues during unblocking.眶额神经元在解除阻断过程中获得对“无价值”巴甫洛夫线索的反应。
Elife. 2014 Jul 18;3:e02653. doi: 10.7554/eLife.02653.
8
Orbitofrontal neurons infer the value and identity of predicted outcomes.眶额神经元推断预测结果的价值和特征。
Nat Commun. 2014 Jun 4;5:3926. doi: 10.1038/ncomms4926.
9
Neural estimates of imagined outcomes in the orbitofrontal cortex drive behavior and learning.眶额皮质对想象结果的神经预测驱动行为和学习。
Neuron. 2013 Oct 16;80(2):507-18. doi: 10.1016/j.neuron.2013.08.008.
10
The orbitofrontal cortex regulates outcome-based decision-making via the lateral striatum.眶额皮层通过外侧纹状体调节基于结果的决策。
Eur J Neurosci. 2013 Aug;38(3):2382-8. doi: 10.1111/ejn.12239. Epub 2013 May 8.