• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于双阈值和增强方案构建准确高效的深度脉冲神经网络

Constructing Accurate and Efficient Deep Spiking Neural Networks With Double-Threshold and Augmented Schemes.

作者信息

Yu Qiang, Ma Chenxiang, Song Shiming, Zhang Gaoyan, Dang Jianwu, Tan Kay Chen

出版信息

IEEE Trans Neural Netw Learn Syst. 2022 Apr;33(4):1714-1726. doi: 10.1109/TNNLS.2020.3043415. Epub 2022 Apr 4.

DOI:10.1109/TNNLS.2020.3043415
PMID:33471769
Abstract

Spiking neural networks (SNNs) are considered as a potential candidate to overcome current challenges, such as the high-power consumption encountered by artificial neural networks (ANNs); however, there is still a gap between them with respect to the recognition accuracy on various tasks. A conversion strategy was, thus, introduced recently to bridge this gap by mapping a trained ANN to an SNN. However, it is still unclear that to what extent this obtained SNN can benefit both the accuracy advantage from ANN and high efficiency from the spike-based paradigm of computation. In this article, we propose two new conversion methods, namely TerMapping and AugMapping. The TerMapping is a straightforward extension of a typical threshold-balancing method with a double-threshold scheme, while the AugMapping additionally incorporates a new scheme of augmented spike that employs a spike coefficient to carry the number of typical all-or-nothing spikes occurring at a time step. We examine the performance of our methods based on the MNIST, Fashion-MNIST, and CIFAR10 data sets. The results show that the proposed double-threshold scheme can effectively improve the accuracies of the converted SNNs. More importantly, the proposed AugMapping is more advantageous for constructing accurate, fast, and efficient deep SNNs compared with other state-of-the-art approaches. Our study, therefore, provides new approaches for further integration of advanced techniques in ANNs to improve the performance of SNNs, which could be of great merit to applied developments with spike-based neuromorphic computing.

摘要

脉冲神经网络(SNN)被认为是克服当前挑战的潜在候选者,比如人工神经网络(ANN)所面临的高功耗问题;然而,在各种任务的识别准确率方面,它们之间仍存在差距。因此,最近引入了一种转换策略,通过将训练好的ANN映射到SNN来弥合这一差距。然而,目前尚不清楚由此得到的SNN在多大程度上既能受益于ANN的准确率优势,又能受益于基于脉冲的计算范式的高效率。在本文中,我们提出了两种新的转换方法,即TerMapping和AugMapping。TerMapping是一种典型阈值平衡方法的直接扩展,采用双阈值方案,而AugMapping还额外引入了一种增强脉冲的新方案,该方案使用脉冲系数来承载在一个时间步长内出现的典型非此即彼脉冲的数量。我们基于MNIST、Fashion-MNIST和CIFAR10数据集检验了我们方法的性能。结果表明,所提出的双阈值方案能够有效提高转换后的SNN的准确率。更重要的是,与其他现有方法相比,所提出的AugMapping在构建准确、快速且高效的深度SNN方面更具优势。因此,我们的研究为进一步整合ANN中的先进技术以提高SNN的性能提供了新方法,这对于基于脉冲的神经形态计算的应用开发可能具有重要价值。

相似文献

1
Constructing Accurate and Efficient Deep Spiking Neural Networks With Double-Threshold and Augmented Schemes.基于双阈值和增强方案构建准确高效的深度脉冲神经网络
IEEE Trans Neural Netw Learn Syst. 2022 Apr;33(4):1714-1726. doi: 10.1109/TNNLS.2020.3043415. Epub 2022 Apr 4.
2
A TTFS-based energy and utilization efficient neuromorphic CNN accelerator.一种基于时间到第一个尖峰(TTFS)的能量与利用率高效的神经形态卷积神经网络加速器。
Front Neurosci. 2023 May 5;17:1121592. doi: 10.3389/fnins.2023.1121592. eCollection 2023.
3
Rethinking the performance comparison between SNNS and ANNS.重新思考 SNNS 和 ANNS 的性能比较。
Neural Netw. 2020 Jan;121:294-307. doi: 10.1016/j.neunet.2019.09.005. Epub 2019 Sep 19.
4
High-performance deep spiking neural networks via at-most-two-spike exponential coding.基于最多两次尖峰的指数编码的高性能深度尖峰神经网络。
Neural Netw. 2024 Aug;176:106346. doi: 10.1016/j.neunet.2024.106346. Epub 2024 Apr 27.
5
High-accuracy deep ANN-to-SNN conversion using quantization-aware training framework and calcium-gated bipolar leaky integrate and fire neuron.使用量化感知训练框架和钙门控双极泄漏积分发放神经元实现高精度深度人工神经网络到脉冲神经网络的转换。
Front Neurosci. 2023 Mar 8;17:1141701. doi: 10.3389/fnins.2023.1141701. eCollection 2023.
6
SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training.SSTDP:用于高效脉冲神经网络训练的监督式脉冲时间依赖可塑性
Front Neurosci. 2021 Nov 4;15:756876. doi: 10.3389/fnins.2021.756876. eCollection 2021.
7
Enabling Spike-Based Backpropagation for Training Deep Neural Network Architectures.实现基于尖峰的反向传播以训练深度神经网络架构。
Front Neurosci. 2020 Feb 28;14:119. doi: 10.3389/fnins.2020.00119. eCollection 2020.
8
A universal ANN-to-SNN framework for achieving high accuracy and low latency deep Spiking Neural Networks.一种通用的 ANN-to-SNN 框架,可实现高精度和低延迟的深度尖峰神经网络。
Neural Netw. 2024 Jun;174:106244. doi: 10.1016/j.neunet.2024.106244. Epub 2024 Mar 15.
9
Optimizing Deeper Spiking Neural Networks for Dynamic Vision Sensing.深度尖峰神经网络在动态视觉传感中的优化。
Neural Netw. 2021 Dec;144:686-698. doi: 10.1016/j.neunet.2021.09.022. Epub 2021 Oct 5.
10
Training much deeper spiking neural networks with a small number of time-steps.用少量时间步训练更深的尖峰神经网络。
Neural Netw. 2022 Sep;153:254-268. doi: 10.1016/j.neunet.2022.06.001. Epub 2022 Jun 15.

引用本文的文献

1
Learnable axonal delay in spiking neural networks improves spoken word recognition.脉冲神经网络中可学习的轴突延迟改善了口语单词识别。
Front Neurosci. 2023 Nov 9;17:1275944. doi: 10.3389/fnins.2023.1275944. eCollection 2023.
2
A low cost neuromorphic learning engine based on a high performance supervised SNN learning algorithm.一种基于高性能监督 SNN 学习算法的低成本神经形态学习引擎。
Sci Rep. 2023 Apr 18;13(1):6280. doi: 10.1038/s41598-023-32120-7.
3
Adaptive SNN for Anthropomorphic Finger Control.自适应 SNN 用于拟人手指控制。
Sensors (Basel). 2021 Apr 13;21(8):2730. doi: 10.3390/s21082730.