Department of Psychology and Center for Brain Science, Harvard University, Cambridge, MA, USA.
Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Cambridge, MA, USA.
Nat Neurosci. 2024 Sep;27(9):1645-1655. doi: 10.1038/s41593-024-01705-4. Epub 2024 Jul 25.
The most influential account of phasic dopamine holds that it reports reward prediction errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form, probably too simple and fails to explain all the properties of phasic dopamine observed in behaving animals. This Perspective helps to resolve some of the conflicting interpretations of dopamine that currently exist in the literature. We focus on the following three empirical challenges to the RPE theory of dopamine: why does dopamine (1) ramp up as animals approach rewards, (2) respond to sensory and motor features and (3) influence action selection? We argue that the prediction error concept, once it has been suitably modified and generalized based on an analysis of each computational problem, answers each challenge. Nonetheless, there are a number of additional empirical findings that appear to demand fundamentally different theoretical explanations beyond encoding RPE. Therefore, looking forward, we discuss the prospects for a unifying theory that respects the diversity of dopamine signaling and function as well as the complex circuitry that both underlies and responds to dopaminergic transmission.
相位多巴胺最具影响力的解释认为,它报告了奖励预测误差(RPE)。基于 RPE 的多巴胺信号解释在其原始形式下可能过于简单,无法解释在行为动物中观察到的所有相位多巴胺特性。这种观点有助于解决当前文献中存在的一些关于多巴胺的相互矛盾的解释。我们专注于多巴胺 RPE 理论面临的以下三个经验挑战:为什么多巴胺 (1) 在动物接近奖励时会上升,(2) 对感觉和运动特征做出反应,以及 (3) 影响动作选择?我们认为,一旦根据每个计算问题的分析对预测误差概念进行了适当的修改和推广,它就可以回答每个挑战。尽管如此,还有许多其他经验发现似乎需要超越编码 RPE 的根本不同的理论解释。因此,展望未来,我们讨论了一种统一理论的前景,该理论既尊重多巴胺信号和功能的多样性,也尊重基础和响应多巴胺传递的复杂电路。