Wellcome Centre for Integrative Neuroimaging, University of Oxford, John Radcliffe Hospital, Oxford OX3 9DU, UK.
Wellcome Centre for Integrative Neuroimaging, University of Oxford, John Radcliffe Hospital, Oxford OX3 9DU, UK.
Neuron. 2021 Feb 17;109(4):713-723.e7. doi: 10.1016/j.neuron.2020.11.024. Epub 2020 Dec 22.
Knowledge of the structure of a problem, such as relationships between stimuli, enables rapid learning and flexible inference. Humans and other animals can abstract this structural knowledge and generalize it to solve new problems. For example, in spatial reasoning, shortest-path inferences are immediate in new environments. Spatial structural transfer is mediated by cells in entorhinal and (in humans) medial prefrontal cortices, which maintain their co-activation structure across different environments and behavioral states. Here, using fMRI, we show that entorhinal and ventromedial prefrontal cortex (vmPFC) representations perform a much broader role in generalizing the structure of problems. We introduce a task-remapping paradigm, where subjects solve multiple reinforcement learning (RL) problems differing in structural or sensory properties. We show that, as with space, entorhinal representations are preserved across different RL problems only if task structure is preserved. In vmPFC and ventral striatum, representations of prediction error also depend on task structure.
对问题结构的了解，例如刺激之间的关系，能够实现快速学习和灵活推理。人类和其他动物可以抽象出这种结构知识，并将其推广到解决新问题中。例如，在空间推理中，最短路径的推断在新环境中是即时的。空间结构的转移是由内嗅皮层和（在人类中）内侧前额叶皮层中的细胞介导的，这些细胞在不同的环境和行为状态下保持其共同激活结构。在这里，我们使用 fMRI 表明，内嗅皮层和腹内侧前额叶皮层（vmPFC）的代表在推广问题结构方面发挥了更广泛的作用。我们引入了一个任务重映射范式，在该范式中，受试者解决多个强化学习（RL）问题，这些问题在结构或感觉属性上有所不同。我们表明，与空间一样，只有在保持任务结构的情况下，内嗅皮层的表示才能在不同的 RL 问题中保留下来。在 vmPFC 和腹侧纹状体中，预测误差的表示也取决于任务结构。
