McGuire Joseph T, Nassar Matthew R, Gold Joshua I, Kable Joseph W
Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA.
Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA; Department of Neuroscience, University of Pennsylvania, Philadelphia, PA, USA; Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI, USA.
Neuron. 2014 Nov 19;84(4):870-81. doi: 10.1016/j.neuron.2014.10.013.
Maintaining accurate beliefs in a changing environment requires dynamically adapting the rate at which one learns from new experiences. Beliefs should be stable in the face of noisy data but malleable in periods of change or uncertainty. Here we used computational modeling, psychophysics, and fMRI to show that adaptive learning is not a unitary phenomenon in the brain. Rather, it can be decomposed into three computationally and neuroanatomically distinct factors that were evident in human subjects performing a spatial-prediction task: (1) surprise-driven belief updating, related to BOLD activity in visual cortex; (2) uncertainty-driven belief updating, related to anterior prefrontal and parietal activity; and (3) reward-driven belief updating, a context-inappropriate behavioral tendency related to activity in ventral striatum. These distinct factors converged in a core system governing adaptive learning. This system, which included dorsomedial frontal cortex, responded to all three factors and predicted belief updating both across trials and across individuals.
在不断变化的环境中保持准确的信念需要动态调整从新经验中学习的速度。信念在面对嘈杂数据时应保持稳定,但在变化或不确定时期应具有可塑性。在这里,我们使用计算建模、心理物理学和功能磁共振成像来表明,适应性学习在大脑中不是一种单一的现象。相反,它可以分解为三个在计算和神经解剖学上不同的因素,这些因素在执行空间预测任务的人类受试者中很明显:(1)由意外驱动的信念更新,与视觉皮层中的血氧水平依赖(BOLD)活动有关;(2)由不确定性驱动的信念更新,与前额叶前部和顶叶活动有关;(3)由奖励驱动的信念更新,一种与腹侧纹状体活动相关的与情境不符的行为倾向。这些不同的因素在一个控制适应性学习的核心系统中汇聚。这个系统包括背内侧前额叶皮层,对所有三个因素都有反应,并预测跨试验和跨个体的信念更新。