Donders Institute for Brain, Cognition & Behaviour, Radboud Universiteit, Nijmegen, The Netherlands.
Trends Cogn Sci. 2023 Aug;27(8):702-712. doi: 10.1016/j.tics.2023.05.011. Epub 2023 Jun 23.
A hallmark of biological intelligence is the ability to adaptively draw on past experience to guide behaviour under novel situations. Yet, the neurobiological principles that underlie this form of meta-learning remain relatively unexplored. In this Opinion, we review the existing literature on hippocampal spatial representations and reinforcement learning theory and describe a novel theoretical framework that aims to account for biological meta-learning. We conjecture that so-called hippocampal cognitive maps of familiar environments are part of a larger meta-representation (meta-map) that encodes information states and sources, which support exploration and provides a foundation for learning. We also introduce concrete hypotheses on how these generic states can be encoded using a principle of superposition.
生物智能的一个特点是能够自适应地利用过去的经验来指导新情况下的行为。然而,这种元学习形式的神经生物学原理仍相对未知。在本观点中,我们回顾了关于海马体空间表示和强化学习理论的现有文献,并描述了一个旨在解释生物元学习的新理论框架。我们推测,所谓的熟悉环境的海马体认知图是更大的元表示(元图)的一部分,该元表示编码信息状态和来源,支持探索并为学习提供基础。我们还提出了关于如何使用叠加原理来编码这些通用状态的具体假设。