Suppr超能文献

眶额神经元发出奖励预测信号,而非奖励预测误差信号。

Orbitofrontal neurons signal reward predictions, not reward prediction errors.

作者信息

Stalnaker Thomas A, Liu Tzu-Lan, Takahashi Yuji K, Schoenbaum Geoffrey

机构信息

National Institute on Drug Abuse Intramural Research Program, Cellular Neurobiology Research Branch, Behavioral Neurophysiology Research Section, 251 Bayview Blvd., Baltimore, MD 21224, United States.

National Institute on Drug Abuse Intramural Research Program, Cellular Neurobiology Research Branch, Behavioral Neurophysiology Research Section, 251 Bayview Blvd., Baltimore, MD 21224, United States.

出版信息

Neurobiol Learn Mem. 2018 Sep;153(Pt B):137-143. doi: 10.1016/j.nlm.2018.01.013. Epub 2018 Jan 31.

Abstract

Neurons in the orbitofrontal cortex (OFC) fire in anticipation of and during rewards. Such firing has been suggested to encode reward predictions and to account in some way for the role of this area in adaptive behavior and learning. However, it has also been reported that neural activity in OFC reflects reward prediction errors, which might drive learning directly. Here we tested this question by analyzing the firing of OFC neurons recorded in an odor discrimination task in which rats were trained to sample odor cues and respond left or right on each trial for reward. Neurons were recorded across blocks of trials in which we switched either the number or the flavor of the reward delivered in each well. Previously we have described how neurons in this dataset fired to the predictive cues (Stalnaker et al., 2014); here we focused on the firing in anticipation of and just after delivery of each drop of reward, looking specifically for differences in firing based on whether the reward number or flavor was unexpected or expected. Unlike dopamine neurons recorded in this setting, which exhibited phasic error-like responses after surprising changes in either reward number or reward flavor (Takahashi et al., 2017), OFC neurons showed no such error correlates and instead fired in a way that reflected reward predictions.

摘要

眶额皮质(OFC)中的神经元在预期奖励和获得奖励期间会产生放电活动。这种放电活动被认为用于编码奖励预测,并在某种程度上解释该区域在适应性行为和学习中的作用。然而,也有报道称,眶额皮质中的神经活动反映了奖励预测误差,这可能直接驱动学习。在这里,我们通过分析在气味辨别任务中记录的眶额皮质神经元的放电情况来测试这个问题,在该任务中,大鼠经过训练对气味线索进行采样,并在每次试验中向左或向右做出反应以获得奖励。在一系列试验块中记录神经元活动,在每个试验块中,我们改变每个孔中给予奖励的数量或味道。此前我们已经描述了该数据集中的神经元如何对预测线索产生放电反应(Stalnaker等人,2014年);在这里,我们关注的是在预期每一滴奖励以及奖励给予之后的放电情况,特别关注基于奖励数量或味道是意外还是预期而产生的放电差异。与在这种情况下记录的多巴胺能神经元不同,多巴胺能神经元在奖励数量或奖励味道出现意外变化后会表现出阶段性的类似误差的反应(Takahashi等人,2017年),眶额皮质神经元没有表现出这种误差相关性,而是以反映奖励预测的方式进行放电。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7b67/6136456/e26282614cc0/nihms-1504476-f0001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验