• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于对称 STDP 规则的尖峰神经网络的生物合理有监督学习方法。

A biologically plausible supervised learning method for spiking neural networks using the symmetric STDP rule.

机构信息

Research Center for Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, 100190 Beijing, China; University of Chinese Academy of Sciences, 100049 Beijing, China.

Research Center for Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, 100190 Beijing, China.

出版信息

Neural Netw. 2020 Jan;121:387-395. doi: 10.1016/j.neunet.2019.09.007. Epub 2019 Sep 27.

DOI:10.1016/j.neunet.2019.09.007
PMID:31593843
Abstract

Spiking neural networks (SNNs) possess energy-efficient potential due to event-based computation. However, supervised training of SNNs remains a challenge as spike activities are non-differentiable. Previous SNNs training methods can be generally categorized into two basic classes, i.e., backpropagation-like training methods and plasticity-based learning methods. The former methods are dependent on energy-inefficient real-valued computation and non-local transmission, as also required in artificial neural networks (ANNs), whereas the latter are either considered to be biologically implausible or exhibit poor performance. Hence, biologically plausible (bio-plausible) high-performance supervised learning (SL) methods for SNNs remain deficient. In this paper, we proposed a novel bio-plausible SNN model for SL based on the symmetric spike-timing dependent plasticity (sym-STDP) rule found in neuroscience. By combining the sym-STDP rule with bio-plausible synaptic scaling and intrinsic plasticity of the dynamic threshold, our SNN model implemented SL well and achieved good performance in the benchmark recognition task (MNIST dataset). To reveal the underlying mechanism of our SL model, we visualized both layer-based activities and synaptic weights using the t-distributed stochastic neighbor embedding (t-SNE) method after training and found that they were well clustered, thereby demonstrating excellent classification ability. Furthermore, to verify the robustness of our model, we trained it on another more realistic dataset (Fashion-MNIST), which also showed good performance. As the learning rules were bio-plausible and based purely on local spike events, our model could be easily applied to neuromorphic hardware for online training and may be helpful for understanding SL information processing at the synaptic level in biological neural systems.

摘要

尖峰神经网络 (SNN) 由于基于事件的计算而具有节能潜力。然而,由于尖峰活动不可微,SNN 的监督训练仍然是一个挑战。以前的 SNN 训练方法通常可以分为两类,即类似于反向传播的训练方法和基于可塑性的学习方法。前者方法依赖于能量效率低的实值计算和非局部传输,这也是人工神经网络 (ANN) 所需要的,而后者要么被认为在生物学上不可信,要么表现不佳。因此,用于 SNN 的生物学上合理 (bio-plausible) 的高性能监督学习 (SL) 方法仍然不足。在本文中,我们提出了一种基于神经科学中发现的对称尖峰时间依赖可塑性 (sym-STDP) 规则的新型生物学合理的 SNN SL 模型。通过将 sym-STDP 规则与生物学合理的突触缩放和动态阈值的内在可塑性相结合,我们的 SNN 模型很好地实现了 SL,并在基准识别任务 (MNIST 数据集) 中取得了良好的性能。为了揭示我们的 SL 模型的潜在机制,我们在训练后使用 t 分布随机邻域嵌入 (t-SNE) 方法对基于层的活动和突触权重进行可视化,发现它们聚类良好,从而证明了出色的分类能力。此外,为了验证我们模型的鲁棒性,我们在另一个更现实的数据集 (Fashion-MNIST) 上对其进行了训练,结果也表现良好。由于学习规则是生物学合理的,并且完全基于局部尖峰事件,因此我们的模型可以很容易地应用于神经形态硬件进行在线训练,并且可能有助于理解生物神经网络中突触水平的 SL 信息处理。

相似文献

1
A biologically plausible supervised learning method for spiking neural networks using the symmetric STDP rule.基于对称 STDP 规则的尖峰神经网络的生物合理有监督学习方法。
Neural Netw. 2020 Jan;121:387-395. doi: 10.1016/j.neunet.2019.09.007. Epub 2019 Sep 27.
2
SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training.SSTDP:用于高效脉冲神经网络训练的监督式脉冲时间依赖可塑性
Front Neurosci. 2021 Nov 4;15:756876. doi: 10.3389/fnins.2021.756876. eCollection 2021.
3
An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections.一种基于无监督 STDP 的尖峰神经网络,灵感来自于具有生物学合理性的学习规则和连接。
Neural Netw. 2023 Aug;165:799-808. doi: 10.1016/j.neunet.2023.06.019. Epub 2023 Jun 22.
4
Deep learning in spiking neural networks.深度学习在尖峰神经网络中的应用。
Neural Netw. 2019 Mar;111:47-63. doi: 10.1016/j.neunet.2018.12.002. Epub 2018 Dec 18.
5
Tuning Convolutional Spiking Neural Network With Biologically Plausible Reward Propagation.基于生物合理奖励传播的卷积脉冲神经网络调优
IEEE Trans Neural Netw Learn Syst. 2022 Dec;33(12):7621-7631. doi: 10.1109/TNNLS.2021.3085966. Epub 2022 Nov 30.
6
Locally connected spiking neural networks for unsupervised feature learning.用于无监督特征学习的局部连接脉冲神经网络。
Neural Netw. 2019 Nov;119:332-340. doi: 10.1016/j.neunet.2019.08.016. Epub 2019 Aug 26.
7
Paired competing neurons improving STDP supervised local learning in Spiking Neural Networks.配对竞争神经元改善脉冲神经网络中基于STDP的监督局部学习
Front Neurosci. 2024 Jul 24;18:1401690. doi: 10.3389/fnins.2024.1401690. eCollection 2024.
8
Categorization and decision-making in a neurobiologically plausible spiking network using a STDP-like learning rule.使用类似于 STDP 的学习规则在具有神经生物学合理性的尖峰网络中进行分类和决策。
Neural Netw. 2013 Dec;48:109-24. doi: 10.1016/j.neunet.2013.07.012. Epub 2013 Aug 14.
9
Competitive Learning in a Spiking Neural Network: Towards an Intelligent Pattern Classifier.尖峰神经网络中的竞争学习:迈向智能模式分类器。
Sensors (Basel). 2020 Jan 16;20(2):500. doi: 10.3390/s20020500.
10
Biologically plausible deep learning - But how far can we go with shallow networks?生物学上合理的深度学习——但我们可以在浅层网络中走多远?
Neural Netw. 2019 Oct;118:90-101. doi: 10.1016/j.neunet.2019.06.001. Epub 2019 Jun 20.

引用本文的文献

1
Brain-inspired learning rules for spiking neural network-based control: a tutorial.基于脉冲神经网络控制的受脑启发学习规则:教程
Biomed Eng Lett. 2024 Dec 2;15(1):37-55. doi: 10.1007/s13534-024-00436-6. eCollection 2025 Jan.
2
Contrastive signal-dependent plasticity: Self-supervised learning in spiking neural circuits.对比信号依赖可塑性:尖峰神经网络电路中的自监督学习。
Sci Adv. 2024 Oct 25;10(43):eadn6076. doi: 10.1126/sciadv.adn6076. Epub 2024 Oct 23.
3
Brain-inspired biomimetic robot control: a review.受大脑启发的仿生机器人控制:综述
Front Neurorobot. 2024 Aug 19;18:1395617. doi: 10.3389/fnbot.2024.1395617. eCollection 2024.
4
Real-time execution of SNN models with synaptic plasticity for handwritten digit recognition on SIMD hardware.基于突触可塑性的SNN模型在SIMD硬件上进行手写数字识别的实时执行。
Front Neurosci. 2024 Aug 6;18:1425861. doi: 10.3389/fnins.2024.1425861. eCollection 2024.
5
Paired competing neurons improving STDP supervised local learning in Spiking Neural Networks.配对竞争神经元改善脉冲神经网络中基于STDP的监督局部学习
Front Neurosci. 2024 Jul 24;18:1401690. doi: 10.3389/fnins.2024.1401690. eCollection 2024.
6
Neuromorphic Computing of Optoelectronic Artificial BFCO/AZO Heterostructure Memristors Synapses.光电人工BFCO/AZO异质结构忆阻器突触的神经形态计算
Nanomaterials (Basel). 2024 Mar 27;14(7):583. doi: 10.3390/nano14070583.
7
Rethinking skip connections in Spiking Neural Networks with Time-To-First-Spike coding.基于首次放电时间编码对脉冲神经网络中的跳跃连接进行重新思考。
Front Neurosci. 2024 Feb 14;18:1346805. doi: 10.3389/fnins.2024.1346805. eCollection 2024.
8
Training multi-layer spiking neural networks with plastic synaptic weights and delays.使用可塑性突触权重和延迟训练多层脉冲神经网络。
Front Neurosci. 2024 Jan 24;17:1253830. doi: 10.3389/fnins.2023.1253830. eCollection 2023.
9
Emergence of brain-inspired small-world spiking neural network through neuroevolution.通过神经进化产生受大脑启发的小世界脉冲神经网络。
iScience. 2024 Jan 9;27(2):108845. doi: 10.1016/j.isci.2024.108845. eCollection 2024 Feb 16.
10
Gradient-based feature-attribution explainability methods for spiking neural networks.基于梯度的脉冲神经网络特征归因可解释性方法
Front Neurosci. 2023 Sep 27;17:1153999. doi: 10.3389/fnins.2023.1153999. eCollection 2023.