Scleidorovich Pablo, Fellous Jean-Marc, Weitzenfeld Alfredo
Department of Computer Science and Engineering, University of South Florida, Tampa, FL, United States.
Department of Psychology and Biomedical Engineering, University of Arizona, Tucson, AZ, United States.
Front Comput Neurosci. 2022 Dec 12;16:1039822. doi: 10.3389/fncom.2022.1039822. eCollection 2022.
Extensive studies in rodents show that place cells in the hippocampus have firing patterns that are highly correlated with the animal's location in the environment and are organized in layers of increasing field sizes or scales along its dorsoventral axis. In this study, we use a spatial cognition model to show that different field sizes could be exploited to adapt the place cell representation to different environments according to their size and complexity. Specifically, we provide an in-depth analysis of how to distribute place cell fields according to the obstacles in cluttered environments to optimize learning time and path optimality during goal-oriented spatial navigation tasks. The analysis uses a reinforcement learning (RL) model that assumes that place cells allow encoding the state. While previous studies have suggested exploiting different field sizes to represent areas requiring different spatial resolutions, our work analyzes specific distributions that adapt the representation to the environment, activating larger fields in open areas and smaller fields near goals and subgoals (e.g., obstacle corners). In addition to assessing how the multi-scale representation may be exploited in spatial navigation tasks, our analysis and results suggest place cell representations that can impact the robotics field by reducing the total number of cells for path planning without compromising the quality of the paths learned.
对啮齿动物的广泛研究表明,海马体中的位置细胞具有与动物在环境中的位置高度相关的放电模式,并且沿着其背腹轴以场大小或尺度不断增加的层状形式组织。在本研究中,我们使用一种空间认知模型来表明,可以利用不同的场大小根据不同环境的大小和复杂性来使位置细胞表征适应这些环境。具体而言,我们深入分析了在杂乱环境中如何根据障碍物分布位置细胞场,以在目标导向的空间导航任务中优化学习时间和路径最优性。该分析使用了一种强化学习(RL)模型,该模型假设位置细胞允许对状态进行编码。虽然先前的研究建议利用不同的场大小来表示需要不同空间分辨率的区域,但我们的工作分析了使表征适应环境的特定分布,在开阔区域激活较大的场,在目标和子目标(例如障碍物角落)附近激活较小的场。除了评估多尺度表征在空间导航任务中如何被利用之外,我们的分析和结果还表明,位置细胞表征可以通过减少路径规划所需的细胞总数而不影响所学习路径的质量,从而对机器人领域产生影响。