Shi Qianqian, Liu Faqiang, Li Hongyi, Li Guangyu, Shi Luping, Zhao Rong
Center for Brain-Inspired Computing Research (CBICR), Tsinghua University, Beijing, China.
Department of Precision Instruments, Tsinghua University, Beijing, China.
Nat Commun. 2025 Feb 2;16(1):1272. doi: 10.1038/s41467-025-56405-9.
Current artificial systems suffer from catastrophic forgetting during continual learning, a limitation absent in biological systems. Biological mechanisms leverage the dual representation of specific and generalized memories within corticohippocampal circuits to facilitate lifelong learning. Inspired by this, we develop a corticohippocampal circuits-based hybrid neural network (CH-HNN) that emulates these dual representations, significantly mitigating catastrophic forgetting in both task-incremental and class-incremental learning scenarios. Our CH-HNNs incorporate artificial neural networks and spiking neural networks, leveraging prior knowledge to facilitate new concept learning through episode inference, and offering insights into the neural functions of both feedforward and feedback loops within corticohippocampal circuits. Crucially, CH-HNN operates as a task-agnostic system without increasing memory demands, demonstrating adaptability and robustness in real-world applications. Coupled with the low power consumption inherent to SNNs, our model represents the potential for energy-efficient, continual learning in dynamic environments.
当前的人工系统在持续学习过程中会出现灾难性遗忘,这是生物系统所没有的局限性。生物机制利用皮质-海马回路中特定记忆和广义记忆的双重表征来促进终身学习。受此启发,我们开发了一种基于皮质-海马回路的混合神经网络(CH-HNN),该网络模拟了这些双重表征,在任务增量和类别增量学习场景中显著减轻了灾难性遗忘。我们的CH-HNN结合了人工神经网络和脉冲神经网络,利用先验知识通过情节推理促进新概念学习,并深入了解皮质-海马回路中前馈和反馈回路的神经功能。至关重要的是,CH-HNN作为一个与任务无关的系统运行,而不会增加内存需求,在实际应用中展现出适应性和鲁棒性。再加上脉冲神经网络固有的低功耗,我们的模型代表了在动态环境中实现节能、持续学习的潜力。