Suppr超能文献

受皮质-海马回路启发的用于持续学习的混合神经网络。

Hybrid neural networks for continual learning inspired by corticohippocampal circuits.

作者信息

Shi Qianqian, Liu Faqiang, Li Hongyi, Li Guangyu, Shi Luping, Zhao Rong

机构信息

Center for Brain-Inspired Computing Research (CBICR), Tsinghua University, Beijing, China.

Department of Precision Instruments, Tsinghua University, Beijing, China.

出版信息

Nat Commun. 2025 Feb 2;16(1):1272. doi: 10.1038/s41467-025-56405-9.

Abstract

Current artificial systems suffer from catastrophic forgetting during continual learning, a limitation absent in biological systems. Biological mechanisms leverage the dual representation of specific and generalized memories within corticohippocampal circuits to facilitate lifelong learning. Inspired by this, we develop a corticohippocampal circuits-based hybrid neural network (CH-HNN) that emulates these dual representations, significantly mitigating catastrophic forgetting in both task-incremental and class-incremental learning scenarios. Our CH-HNNs incorporate artificial neural networks and spiking neural networks, leveraging prior knowledge to facilitate new concept learning through episode inference, and offering insights into the neural functions of both feedforward and feedback loops within corticohippocampal circuits. Crucially, CH-HNN operates as a task-agnostic system without increasing memory demands, demonstrating adaptability and robustness in real-world applications. Coupled with the low power consumption inherent to SNNs, our model represents the potential for energy-efficient, continual learning in dynamic environments.

摘要

当前的人工系统在持续学习过程中会出现灾难性遗忘,这是生物系统所没有的局限性。生物机制利用皮质-海马回路中特定记忆和广义记忆的双重表征来促进终身学习。受此启发,我们开发了一种基于皮质-海马回路的混合神经网络(CH-HNN),该网络模拟了这些双重表征,在任务增量和类别增量学习场景中显著减轻了灾难性遗忘。我们的CH-HNN结合了人工神经网络和脉冲神经网络,利用先验知识通过情节推理促进新概念学习,并深入了解皮质-海马回路中前馈和反馈回路的神经功能。至关重要的是,CH-HNN作为一个与任务无关的系统运行,而不会增加内存需求,在实际应用中展现出适应性和鲁棒性。再加上脉冲神经网络固有的低功耗,我们的模型代表了在动态环境中实现节能、持续学习的潜力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/133b/11788432/359b0b9d558b/41467_2025_56405_Fig1_HTML.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验