有证据表明，多巴胺神经元的延迟期活动对应于奖励不确定性，而非反向传播的时间差分误差。 - Suppr

Suppr

超能文献

Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors.

作者信息

Fiorillo Christopher D, Tobler Philippe N, Schultz Wolfram

机构信息

Department of Neurobiology, Stanford University, Stanford, CA 94305-5125, USA.

出版信息

Behav Brain Funct. 2005 Jun 15;1(1):7. doi: 10.1186/1744-9081-1-7.

DOI:10.1186/1744-9081-1-7

PMID:15958162

原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC1182345/

Abstract

摘要

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1faa/1182345/f80485978d27/1744-9081-1-7-1.jpg

相似文献

Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors.有证据表明，多巴胺神经元的延迟期活动对应于奖励不确定性，而非反向传播的时间差分误差。

Behav Brain Funct. 2005 Jun 15;1(1):7. doi: 10.1186/1744-9081-1-7.

Stimulus representation and the timing of reward-prediction errors in models of the dopamine system.多巴胺系统模型中的刺激表征与奖励预测误差的时间安排。

Neural Comput. 2008 Dec;20(12):3034-54. doi: 10.1162/neco.2008.11-07-654.

Dopamine, uncertainty and TD learning.多巴胺、不确定性与时间差分学习

Behav Brain Funct. 2005 May 4;1:6. doi: 10.1186/1744-9081-1-6.

Discrete coding of reward probability and uncertainty by dopamine neurons.多巴胺神经元对奖励概率和不确定性的离散编码。

Science. 2003 Mar 21;299(5614):1898-902. doi: 10.1126/science.1077349.

Abnormal temporal difference reward-learning signals in major depression.重度抑郁症中异常的时间差异奖励学习信号。

Brain. 2008 Aug;131(Pt 8):2084-93. doi: 10.1093/brain/awn136. Epub 2008 Jun 25.

Long-term reward prediction in TD models of the dopamine system.多巴胺系统TD模型中的长期奖励预测。

Neural Comput. 2002 Nov;14(11):2567-83. doi: 10.1162/089976602760407973.

Dopamine reward prediction errors reflect hidden-state inference across time.多巴胺奖励预测误差反映了跨时间的隐藏状态推理。

Nat Neurosci. 2017 Apr;20(4):581-589. doi: 10.1038/nn.4520. Epub 2017 Mar 6.

Reward acts as a signal to control delay-period activity in delayed-response tasks.奖励在延迟反应任务中作为一种信号来控制延迟期活动。

Neuroreport. 2010 Mar 31;21(5):367-70. doi: 10.1097/WNR.0b013e32833776a3.

Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model.由内部模型再现的多巴胺神经元和皮层神经元的预期反应。

Exp Brain Res. 2001 Sep;140(2):234-40. doi: 10.1007/s002210100814.

Representation and timing in theories of the dopamine system.多巴胺系统理论中的表征与时机

Neural Comput. 2006 Jul;18(7):1637-77. doi: 10.1162/neco.2006.18.7.1637.

引用本文的文献

Neural Differences in Relation to Risk Preferences during Reward Processing: An Event-Related Potential Study.奖励处理过程中与风险偏好相关的神经差异：一项事件相关电位研究。

Brain Sci. 2023 Aug 24;13(9):1235. doi: 10.3390/brainsci13091235.

Blocking D2/D3 dopamine receptors in male participants increases volatility of beliefs when learning to trust others.阻断男性参与者的 D2/D3 多巴胺受体可增加其在学习信任他人时信念的易变性。

Nat Commun. 2023 Jul 8;14(1):4049. doi: 10.1038/s41467-023-39823-5.

Dopamine and the interdependency of time perception and reward.多巴胺与时间感知和奖励的相互依存关系。

Neurosci Biobehav Rev. 2021 Jun;125:380-391. doi: 10.1016/j.neubiorev.2021.02.030. Epub 2021 Feb 27.

Tamping Ramping: Algorithmic, Implementational, and Computational Explanations of Phasic Dopamine Signals in the Accumbens.夯实与增强：伏隔核中阶段性多巴胺信号的算法、实现及计算解释

PLoS Comput Biol. 2015 Dec 23;11(12):e1004622. doi: 10.1371/journal.pcbi.1004622. eCollection 2015 Dec.

Neural Basis of Anhedonia and Amotivation in Patients with Schizophrenia: The Role of Reward System.精神分裂症患者快感缺失和动机缺乏的神经基础：奖赏系统的作用

Curr Neuropharmacol. 2015;13(6):750-9. doi: 10.2174/1570159x13666150612230333.

Neuronal Reward and Decision Signals: From Theories to Data.神经元奖励与决策信号：从理论到数据

Physiol Rev. 2015 Jul;95(3):853-951. doi: 10.1152/physrev.00023.2014.

Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning.概率性巴甫洛夫条件反射过程中多巴胺信号的动态塑造

Neurobiol Learn Mem. 2015 Jan;117:84-92. doi: 10.1016/j.nlm.2014.07.010. Epub 2014 Aug 27.

Bayesian modeling of flexible cognitive control.灵活认知控制的贝叶斯建模

Neurosci Biobehav Rev. 2014 Oct;46 Pt 1:30-43. doi: 10.1016/j.neubiorev.2014.06.001. Epub 2014 Jun 11.

A role for the lateral dorsal tegmentum in memory and decision neural circuitry.外侧背侧被盖区在记忆与决策神经回路中的作用。

Neurobiol Learn Mem. 2015 Jan;117:93-108. doi: 10.1016/j.nlm.2014.05.009. Epub 2014 Jun 6.

Mice infer probabilistic models for timing.老鼠可以推断出时间的概率模型。

Proc Natl Acad Sci U S A. 2013 Oct 15;110(42):17154-9. doi: 10.1073/pnas.1310666110. Epub 2013 Sep 30.

本文引用的文献

Dopamine, uncertainty and TD learning.多巴胺、不确定性与时间差分学习

Behav Brain Funct. 2005 May 4;1:6. doi: 10.1186/1744-9081-1-6.

Adaptive coding of reward value by dopamine neurons.多巴胺神经元对奖励价值的适应性编码。

Science. 2005 Mar 11;307(5715):1642-5. doi: 10.1126/science.1105370.

A representation of the hazard rate of elapsed time in macaque area LIP.猕猴顶内沟区域中经过时间的风险率表示。

Nat Neurosci. 2005 Feb;8(2):234-41. doi: 10.1038/nn1386. Epub 2005 Jan 16.

Discrete coding of reward probability and uncertainty by dopamine neurons.多巴胺神经元对奖励概率和不确定性的离散编码。

Science. 2003 Mar 21;299(5614):1898-902. doi: 10.1126/science.1077349.

Dopamine: generalization and bonuses.多巴胺：泛化与奖励。

Neural Netw. 2002 Jun-Jul;15(4-6):549-59. doi: 10.1016/s0893-6080(02)00048-5.

Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons.猴子尾状核神经元中预期活动的奖励依赖型空间选择性

J Neurophysiol. 2002 Jan;87(1):508-15. doi: 10.1152/jn.00288.2001.

How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues.基底神经节如何利用平行的兴奋性和抑制性学习通路来选择性地响应意外的奖励线索。

J Neurosci. 1999 Dec 1;19(23):10502-11. doi: 10.1523/JNEUROSCI.19-23-10502.1999.

A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task.一种具有类似多巴胺强化信号的神经网络模型，用于学习空间延迟反应任务。

Neuroscience. 1999;91(3):871-90. doi: 10.1016/s0306-4522(98)00697-6.

Dopamine neurons report an error in the temporal prediction of reward during learning.多巴胺神经元在学习过程中报告奖励时间预测的误差。

Nat Neurosci. 1998 Aug;1(4):304-9. doi: 10.1038/1124.

A neural substrate of prediction and reward.预测与奖励的神经基础。

Science. 1997 Mar 14;275(5306):1593-9. doi: 10.1126/science.275.5306.1593.

文献检索

告别复杂PubMed语法，用中文像聊天一样搜索，搜遍4000万医学文献。AI智能推荐，让科研检索更轻松。

立即免费搜索

文件翻译

保留排版，准确专业，支持PDF/Word/PPT等文件格式，支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述，25分钟生成高质量综述，智能提取关键信息，辅助科研写作。

立即免费体验