• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

一种基于无监督 STDP 的尖峰神经网络,灵感来自于具有生物学合理性的学习规则和连接。

An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections.

机构信息

School of Future Technology, University of Chinese Academy of Sciences, Beijing, China; Brain-Inspired Cognitive Intelligence Lab, Institute of Automation, Chinese Academy of Sciences (CAS), Beijing, China.

Brain-Inspired Cognitive Intelligence Lab, Institute of Automation, Chinese Academy of Sciences (CAS), Beijing, China.

出版信息

Neural Netw. 2023 Aug;165:799-808. doi: 10.1016/j.neunet.2023.06.019. Epub 2023 Jun 22.

DOI:10.1016/j.neunet.2023.06.019
PMID:37418862
Abstract

The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual knowledge in a self-organized and unsupervised manner, accomplished through coordinating various learning rules and structures in the human brain. Spike-timing-dependent plasticity (STDP) is a general learning rule in the brain, but spiking neural networks (SNNs) trained with STDP alone is inefficient and perform poorly. In this paper, taking inspiration from short-term synaptic plasticity, we design an adaptive synaptic filter and introduce the adaptive spiking threshold as the neuron plasticity to enrich the representation ability of SNNs. We also introduce an adaptive lateral inhibitory connection to adjust the spikes balance dynamically to help the network learn richer features. To speed up and stabilize the training of unsupervised spiking neural networks, we design a samples temporal batch STDP (STB-STDP), which updates weights based on multiple samples and moments. By integrating the above three adaptive mechanisms and STB-STDP, our model greatly accelerates the training of unsupervised spiking neural networks and improves the performance of unsupervised SNNs on complex tasks. Our model achieves the current state-of-the-art performance of unsupervised STDP-based SNNs in the MNIST and FashionMNIST datasets. Further, we tested on the more complex CIFAR10 dataset, and the results fully illustrate the superiority of our algorithm. Our model is also the first work to apply unsupervised STDP-based SNNs to CIFAR10. At the same time, in the small-sample learning scenario, it will far exceed the supervised ANN using the same structure.

摘要

反向传播算法推动了深度学习的快速发展,但它依赖于大量标记数据,与人类学习仍有很大差距。人类大脑可以快速以自组织和无监督的方式学习各种概念知识,这是通过协调大脑中的各种学习规则和结构来实现的。尖峰时间依赖可塑性(STDP)是大脑中的一种通用学习规则,但仅使用 STDP 训练的尖峰神经网络(SNN)效率低下,性能不佳。在本文中,我们从短期突触可塑性中汲取灵感,设计了一种自适应突触滤波器,并引入自适应尖峰阈值作为神经元可塑性,以丰富 SNN 的表示能力。我们还引入了自适应侧向抑制连接,以动态调整尖峰平衡,帮助网络学习更丰富的特征。为了加快和稳定无监督尖峰神经网络的训练,我们设计了一种样本时间批量 STDP(STB-STDP),它基于多个样本和时刻更新权重。通过整合上述三种自适应机制和 STB-STDP,我们的模型大大加快了无监督尖峰神经网络的训练速度,并提高了无监督 SNN 在复杂任务上的性能。我们的模型在 MNIST 和 FashionMNIST 数据集上实现了无监督基于 STDP 的 SNN 的当前最先进性能。此外,我们在更复杂的 CIFAR10 数据集上进行了测试,结果充分说明了我们算法的优越性。我们的模型也是第一个将无监督基于 STDP 的 SNN 应用于 CIFAR10 的工作。同时,在小样本学习场景中,它将远远超过使用相同结构的监督 ANN。

相似文献

1
An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections.一种基于无监督 STDP 的尖峰神经网络,灵感来自于具有生物学合理性的学习规则和连接。
Neural Netw. 2023 Aug;165:799-808. doi: 10.1016/j.neunet.2023.06.019. Epub 2023 Jun 22.
2
A biologically plausible supervised learning method for spiking neural networks using the symmetric STDP rule.基于对称 STDP 规则的尖峰神经网络的生物合理有监督学习方法。
Neural Netw. 2020 Jan;121:387-395. doi: 10.1016/j.neunet.2019.09.007. Epub 2019 Sep 27.
3
Locally connected spiking neural networks for unsupervised feature learning.用于无监督特征学习的局部连接脉冲神经网络。
Neural Netw. 2019 Nov;119:332-340. doi: 10.1016/j.neunet.2019.08.016. Epub 2019 Aug 26.
4
Competitive Learning in a Spiking Neural Network: Towards an Intelligent Pattern Classifier.尖峰神经网络中的竞争学习:迈向智能模式分类器。
Sensors (Basel). 2020 Jan 16;20(2):500. doi: 10.3390/s20020500.
5
Paired competing neurons improving STDP supervised local learning in Spiking Neural Networks.配对竞争神经元改善脉冲神经网络中基于STDP的监督局部学习
Front Neurosci. 2024 Jul 24;18:1401690. doi: 10.3389/fnins.2024.1401690. eCollection 2024.
6
Tuning Convolutional Spiking Neural Network With Biologically Plausible Reward Propagation.基于生物合理奖励传播的卷积脉冲神经网络调优
IEEE Trans Neural Netw Learn Syst. 2022 Dec;33(12):7621-7631. doi: 10.1109/TNNLS.2021.3085966. Epub 2022 Nov 30.
7
Training Deep Spiking Convolutional Neural Networks With STDP-Based Unsupervised Pre-training Followed by Supervised Fine-Tuning.通过基于STDP的无监督预训练和监督微调来训练深度脉冲卷积神经网络
Front Neurosci. 2018 Aug 3;12:435. doi: 10.3389/fnins.2018.00435. eCollection 2018.
8
HybridSNN: Combining Bio-Machine Strengths by Boosting Adaptive Spiking Neural Networks.HybridSNN:通过提升自适应尖峰神经网络来结合生物机器的优势。
IEEE Trans Neural Netw Learn Syst. 2023 Sep;34(9):5841-5855. doi: 10.1109/TNNLS.2021.3131356. Epub 2023 Sep 1.
9
BackEISNN: A deep spiking neural network with adaptive self-feedback and balanced excitatory-inhibitory neurons.BackEISNN:一种具有自适应自反馈和平衡兴奋抑制神经元的深度尖峰神经网络。
Neural Netw. 2022 Oct;154:68-77. doi: 10.1016/j.neunet.2022.06.036. Epub 2022 Jul 11.
10
[A bio-inspired hierarchical spiking neural network with biological synaptic plasticity for event camera object recognition].一种具有生物突触可塑性的用于事件相机目标识别的生物启发式分层脉冲神经网络
Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2023 Aug 25;40(4):692-699. doi: 10.7507/1001-5515.202207040.

引用本文的文献

1
Manipulation of neuronal activity by an artificial spiking neural network implemented on a closed-loop brain-computer interface in non-human primates.通过在非人类灵长类动物的闭环脑机接口上实现的人工脉冲神经网络对神经元活动进行操控。
J Neural Eng. 2025 Jul 21;22(4):046021. doi: 10.1088/1741-2552/adec1c.
2
Design of CMOS-memristor hybrid synapse and its application for noise-tolerant memristive spiking neural network.互补金属氧化物半导体-忆阻器混合突触的设计及其在抗噪声忆阻尖峰神经网络中的应用。
Front Neurosci. 2025 Mar 5;19:1516971. doi: 10.3389/fnins.2025.1516971. eCollection 2025.
3
An accurate and fast learning approach in the biologically spiking neural network.
生物脉冲神经网络中一种准确且快速的学习方法。
Sci Rep. 2025 Feb 24;15(1):6585. doi: 10.1038/s41598-025-90113-0.
4
Brain-inspired biomimetic robot control: a review.受大脑启发的仿生机器人控制:综述
Front Neurorobot. 2024 Aug 19;18:1395617. doi: 10.3389/fnbot.2024.1395617. eCollection 2024.
5
BrainCog: A spiking neural network based, brain-inspired cognitive intelligence engine for brain-inspired AI and brain simulation.BrainCog:一种基于脉冲神经网络的、受大脑启发的认知智能引擎,用于受大脑启发的人工智能和大脑模拟。
Patterns (N Y). 2023 Jul 6;4(8):100789. doi: 10.1016/j.patter.2023.100789. eCollection 2023 Aug 11.