Department of Neurology, Northwestern University, Feinberg School of Medicine, Chicago, IL, 60611, USA.
Department of Psychology, Northwestern University, Weinberg College of Arts and Sciences, Evanston, IL, 60208, USA.
Nat Commun. 2018 Apr 23;9(1):1611. doi: 10.1038/s41467-018-04055-5.
There is general consensus that dopaminergic midbrain neurons signal reward prediction errors, computed as the difference between expected and received reward value. However, recent work in rodents shows that these neurons also respond to errors related to inferred value and sensory features, indicating an expanded role for dopamine beyond learning cached values. Here we utilize a transreinforcer reversal learning task and functional magnetic resonance imaging (fMRI) to test whether prediction error signals in the human midbrain are evoked when the expected identity of an appetitive food odor reward is violated, while leaving value matched. We found that midbrain fMRI responses to identity and value errors are correlated, suggesting a common neural origin for these error signals. Moreover, changes in reward-identity expectations, encoded in the orbitofrontal cortex (OFC), are directly related to midbrain activity, demonstrating that identity-based error signals in the midbrain support the formation of outcome identity expectations in OFC.
人们普遍认为,中脑多巴胺能神经元会发出奖励预测误差信号,这是通过预期奖励值与实际奖励值之间的差异来计算的。然而,最近在啮齿动物中的研究表明,这些神经元也会对与推断价值和感觉特征相关的误差做出反应,这表明多巴胺在学习缓存值之外的作用得到了扩展。在这里,我们利用了一种跨强化物反转学习任务和功能磁共振成像(fMRI)来测试在预期的食物气味奖励的身份被违反但价值匹配时,人类中脑的预测误差信号是否会被引发。我们发现,中脑 fMRI 对身份和价值误差的反应是相关的,这表明这些误差信号具有共同的神经起源。此外,眶额皮层(OFC)中编码的奖励身份预期的变化与中脑活动直接相关,这表明中脑中的基于身份的误差信号支持了 OFC 中结果身份预期的形成。