• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

在脉冲神经网络中,将噪声作为计算和学习的一种资源加以利用。

Exploiting noise as a resource for computation and learning in spiking neural networks.

作者信息

Ma Gehua, Yan Rui, Tang Huajin

机构信息

College of Computer Science and Technology, Zhejiang University, Hangzhou, PRC.

College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, PRC.

出版信息

Patterns (N Y). 2023 Sep 4;4(10):100831. doi: 10.1016/j.patter.2023.100831. eCollection 2023 Oct 13.

DOI:10.1016/j.patter.2023.100831
PMID:37876899
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10591140/
Abstract

Networks of spiking neurons underpin the extraordinary information-processing capabilities of the brain and have become pillar models in neuromorphic artificial intelligence. Despite extensive research on spiking neural networks (SNNs), most studies are established on deterministic models, overlooking the inherent non-deterministic, noisy nature of neural computations. This study introduces the noisy SNN (NSNN) and the noise-driven learning (NDL) rule by incorporating noisy neuronal dynamics to exploit the computational advantages of noisy neural processing. The NSNN provides a theoretical framework that yields scalable, flexible, and reliable computation and learning. We demonstrate that this framework leads to spiking neural models with competitive performance, improved robustness against challenging perturbations compared with deterministic SNNs, and better reproducing probabilistic computation in neural coding. Generally, this study offers a powerful and easy-to-use tool for machine learning, neuromorphic intelligence practitioners, and computational neuroscience researchers.

摘要

脉冲神经元网络支撑着大脑非凡的信息处理能力,并已成为神经形态人工智能的支柱模型。尽管对脉冲神经网络(SNN)进行了广泛研究,但大多数研究都是基于确定性模型建立的,忽略了神经计算固有的非确定性、噪声本质。本研究通过纳入噪声神经元动力学引入了噪声脉冲神经网络(NSNN)和噪声驱动学习(NDL)规则,以利用噪声神经处理的计算优势。NSNN提供了一个理论框架,可实现可扩展、灵活且可靠的计算与学习。我们证明,该框架能产生具有竞争力性能的脉冲神经模型,与确定性SNN相比,对具有挑战性的扰动具有更强的鲁棒性,并且能更好地再现神经编码中的概率计算。总体而言,本研究为机器学习、神经形态智能从业者和计算神经科学研究人员提供了一个强大且易于使用的工具。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/4b6c16aa1fc6/gr9.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/c40d02306944/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/7761c00d6712/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/4f0bd6f64e93/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/52cd2b57f62e/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/f8ec3c2740e6/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/bc4de54d1d15/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/c3225431e3c6/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/19fd2239ece5/gr8.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/4b6c16aa1fc6/gr9.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/c40d02306944/gr1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/7761c00d6712/gr2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/4f0bd6f64e93/gr3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/52cd2b57f62e/gr4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/f8ec3c2740e6/gr5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/bc4de54d1d15/gr6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/c3225431e3c6/gr7.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/19fd2239ece5/gr8.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f219/10591140/4b6c16aa1fc6/gr9.jpg

相似文献

1
Exploiting noise as a resource for computation and learning in spiking neural networks.在脉冲神经网络中,将噪声作为计算和学习的一种资源加以利用。
Patterns (N Y). 2023 Sep 4;4(10):100831. doi: 10.1016/j.patter.2023.100831. eCollection 2023 Oct 13.
2
Neuromorphic Sentiment Analysis Using Spiking Neural Networks.基于尖峰神经网络的神经形态情绪分析。
Sensors (Basel). 2023 Sep 6;23(18):7701. doi: 10.3390/s23187701.
3
Supervised Learning in All FeFET-Based Spiking Neural Network: Opportunities and Challenges.基于全铁电场效应晶体管的脉冲神经网络中的监督学习:机遇与挑战。
Front Neurosci. 2020 Jun 24;14:634. doi: 10.3389/fnins.2020.00634. eCollection 2020.
4
Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligence.硬件尖峰神经元在嵌入式人工智能中的设计空间探索。
Neural Netw. 2020 Jan;121:366-386. doi: 10.1016/j.neunet.2019.09.024. Epub 2019 Sep 26.
5
SHIP: a computational framework for simulating and validating novel technologies in hardware spiking neural networks.SHIP:一种用于模拟和验证硬件脉冲神经网络中的新技术的计算框架。
Front Neurosci. 2024 Jan 8;17:1270090. doi: 10.3389/fnins.2023.1270090. eCollection 2023.
6
HybridSNN: Combining Bio-Machine Strengths by Boosting Adaptive Spiking Neural Networks.HybridSNN:通过提升自适应尖峰神经网络来结合生物机器的优势。
IEEE Trans Neural Netw Learn Syst. 2023 Sep;34(9):5841-5855. doi: 10.1109/TNNLS.2021.3131356. Epub 2023 Sep 1.
7
Deep CovDenseSNN: A hierarchical event-driven dynamic framework with spiking neurons in noisy environment.深协卷积密集型时空神经网络:在噪声环境中具有尖峰神经元的分层事件驱动动态框架。
Neural Netw. 2020 Jan;121:512-519. doi: 10.1016/j.neunet.2019.08.034. Epub 2019 Sep 28.
8
A Hybrid Neural Coding Approach for Pattern Recognition With Spiking Neural Networks.一种用于脉冲神经网络模式识别的混合神经编码方法。
IEEE Trans Pattern Anal Mach Intell. 2024 May;46(5):3064-3078. doi: 10.1109/TPAMI.2023.3339211. Epub 2024 Apr 3.
9
SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training.SSTDP:用于高效脉冲神经网络训练的监督式脉冲时间依赖可塑性
Front Neurosci. 2021 Nov 4;15:756876. doi: 10.3389/fnins.2021.756876. eCollection 2021.
10
Rethinking the performance comparison between SNNS and ANNS.重新思考 SNNS 和 ANNS 的性能比较。
Neural Netw. 2020 Jan;121:294-307. doi: 10.1016/j.neunet.2019.09.005. Epub 2019 Sep 19.

本文引用的文献

1
Nature-inspired self-organizing collision avoidance for drone swarm based on reward-modulated spiking neural network.基于奖励调制脉冲神经网络的无人机群自然启发式自组织避碰
Patterns (N Y). 2022 Oct 28;3(11):100611. doi: 10.1016/j.patter.2022.100611. eCollection 2022 Nov 11.
2
Data-driven artificial and spiking neural networks for inverse kinematics in neurorobotics.用于神经机器人学中逆运动学的数据驱动人工神经网络和脉冲神经网络
Patterns (N Y). 2021 Nov 18;3(1):100391. doi: 10.1016/j.patter.2021.100391. eCollection 2022 Jan 14.
3
Surrogate gradients for analog neuromorphic computing.
模拟神经形态计算的替代梯度。
Proc Natl Acad Sci U S A. 2022 Jan 25;119(4). doi: 10.1073/pnas.2109194119.
4
Brain-inspired global-local learning incorporated with neuromorphic computing.脑启发式全局-局部学习与神经形态计算相结合。
Nat Commun. 2022 Jan 10;13(1):65. doi: 10.1038/s41467-021-27653-2.
5
Unraveling neural coding of dynamic natural visual scenes via convolutional recurrent neural networks.通过卷积递归神经网络解析动态自然视觉场景的神经编码
Patterns (N Y). 2021 Sep 17;2(10):100350. doi: 10.1016/j.patter.2021.100350. eCollection 2021 Oct 8.
6
Computational models of category-selective brain regions enable high-throughput tests of selectivity.类别选择性脑区的计算模型能够实现高吞吐量的选择性测试。
Nat Commun. 2021 Sep 20;12(1):5540. doi: 10.1038/s41467-021-25409-6.
7
LIAF-Net: Leaky Integrate and Analog Fire Network for Lightweight and Efficient Spatiotemporal Information Processing.LIAF-Net:用于轻量级和高效时空信息处理的漏积分和模拟火灾网络。
IEEE Trans Neural Netw Learn Syst. 2022 Nov;33(11):6249-6262. doi: 10.1109/TNNLS.2021.3073016. Epub 2022 Oct 27.
8
The Remarkable Robustness of Surrogate Gradient Learning for Instilling Complex Function in Spiking Neural Networks.尖峰神经网络中复杂功能的代理梯度学习的显著稳健性。
Neural Comput. 2021 Mar 26;33(4):899-925. doi: 10.1162/neco_a_01367.
9
How Neuronal Noises Influence the Spiking Neural Networks's Cognitive Learning Process: A Preliminary Study.神经元噪声如何影响脉冲神经网络的认知学习过程:一项初步研究。
Brain Sci. 2021 Jan 25;11(2):153. doi: 10.3390/brainsci11020153.
10
Unsupervised neural network models of the ventral visual stream.腹侧视觉流的无监督神经网络模型。
Proc Natl Acad Sci U S A. 2021 Jan 19;118(3). doi: 10.1073/pnas.2014196118.