Department of Experimental Psychology, Ghent University, B-9000 Ghent, Belgium
Department of Experimental Psychology, Ghent University, B-9000 Ghent, Belgium.
J Neurosci. 2021 Feb 24;41(8):1716-1726. doi: 10.1523/JNEUROSCI.1785-20.2020. Epub 2020 Dec 17.
Recent behavioral evidence implicates reward prediction errors (RPEs) as a key factor in the acquisition of episodic memory. Yet, important neural predictions related to the role of RPEs in episodic memory acquisition remain to be tested. Humans (both sexes) performed a novel variable-choice task where we experimentally manipulated RPEs and found support for key neural predictions with fMRI. Our results show that in line with previous behavioral observations, episodic memory accuracy increases with the magnitude of signed (i.e., better/worse-than-expected) RPEs (SRPEs). Neurally, we observe that SRPEs are encoded in the ventral striatum (VS). Crucially, we demonstrate through mediation analysis that activation in the VS mediates the experimental manipulation of SRPEs on episodic memory accuracy. In particular, SRPE-based responses in the VS (during learning) predict the strength of subsequent episodic memory (during recollection). Furthermore, functional connectivity between task-relevant processing areas (i.e., face-selective areas) and hippocampus and ventral striatum increased as a function of RPE value (during learning), suggesting a central role of these areas in episodic memory formation. Our results consolidate reinforcement learning theory and striatal RPEs as key factors subtending the formation of episodic memory. Recent behavioral research has shown that reward prediction errors (RPEs), a key concept of reinforcement learning theory, are crucial to the formation of episodic memories. In this study, we reveal the neural underpinnings of this process. Using fMRI, we show that signed RPEs (SRPEs) are encoded in the ventral striatum (VS), and crucially, that SRPE VS activity is responsible for the subsequent recollection accuracy of one-shot learned episodic memory associations.
最近的行为证据表明,奖励预测误差(RPE)是情景记忆获取的关键因素。然而,与 RPE 在情景记忆获取中的作用相关的重要神经预测仍有待检验。人类(男女)进行了一项新的可变选择任务,我们在该任务中实验性地操纵了 RPE,并通过 fMRI 找到了支持关键神经预测的证据。我们的研究结果表明,与之前的行为观察一致,情景记忆的准确性随着符号(即,好于/差于预期)RPE(SRPE)的幅度而增加。从神经学角度来看,我们观察到 SRPE 是在腹侧纹状体(VS)中编码的。至关重要的是,我们通过中介分析证明,VS 中的激活介导了 SRPE 对情景记忆准确性的实验操纵。具体来说,VS 中基于 SRPE 的反应(在学习期间)预测了随后情景记忆的强度(在回忆期间)。此外,随着 RPE 值的增加(在学习期间),任务相关处理区域(即,面部选择区域)与海马体和腹侧纹状体之间的功能连接性增加,这表明这些区域在情景记忆形成中起着核心作用。我们的研究结果巩固了强化学习理论和纹状体 RPE 作为支撑情景记忆形成的关键因素。最近的行为研究表明,奖励预测误差(RPE)是强化学习理论的一个关键概念,对于情景记忆的形成至关重要。在这项研究中,我们揭示了这一过程的神经基础。使用 fMRI,我们表明符号 RPE(SRPE)是在腹侧纹状体(VS)中编码的,而且至关重要的是,SRPE VS 活动负责单次学习情景记忆关联的后续回忆准确性。