• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

以及稀疏二元巧合(SBC)存储器:用于神经形态架构的快速、稳健学习与推理。

and Sparse Binary Coincidence (SBC) memories: Fast, robust learning and inference for neuromorphic architectures.

作者信息

Hopkins Michael, Fil Jakub, Jones Edward George, Furber Steve

机构信息

Advanced Processor Technologies Group, Department of Computer Science, The University of Manchester, Manchester, United Kingdom.

出版信息

Front Neuroinform. 2023 Mar 21;17:1125844. doi: 10.3389/fninf.2023.1125844. eCollection 2023.

DOI:10.3389/fninf.2023.1125844
PMID:37025552
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10071999/
Abstract

We present an innovative working mechanism (the ) and surrounding infrastructure () based upon a novel synthesis of ideas from sparse coding, computational neuroscience and information theory that enables fast and adaptive learning and accurate, robust inference. The mechanism is designed to be implemented efficiently on current and future neuromorphic devices as well as on more conventional CPU and memory architectures. An example implementation on the SpiNNaker neuromorphic platform has been developed and initial results are presented. The SBC memory stores coincidences between features detected in class examples in a training set, and infers the class of a previously unseen test example by identifying the class with which it shares the highest number of feature coincidences. A number of SBC memories may be combined in a to increase the diversity of the contributing feature coincidences. The resulting inference mechanism is shown to have excellent classification performance on benchmarks such as MNIST and EMNIST, achieving classification accuracy with single-pass learning approaching that of state-of-the-art deep networks with much larger tuneable parameter spaces and much higher training costs. It can also be made very robust to noise. is designed to be very efficient in training and inference on both conventional and neuromorphic architectures. It provides a unique combination of single-pass, single-shot and continuous supervised learning; following a very simple unsupervised phase. Accurate classification inference that is very robust against imperfect inputs has been demonstrated. These contributions make it uniquely well-suited for edge and IoT applications.

摘要

我们提出了一种创新的工作机制()及其周边基础设施(),该机制基于稀疏编码、计算神经科学和信息论的新颖思想综合,能够实现快速自适应学习以及准确、稳健的推理。该机制旨在能够在当前和未来的神经形态设备以及更传统的CPU和内存架构上高效实现。已在SpiNNaker神经形态平台上开发了一个示例实现,并展示了初步结果。SBC内存存储训练集中类别示例中检测到的特征之间的重合情况,并通过识别与之前未见过的测试示例共享最多特征重合的类别来推断其类别。多个SBC内存可以组合在一个 中,以增加贡献特征重合的多样性。结果表明,所得的推理机制在MNIST和EMNIST等基准测试中具有出色的分类性能,通过单通道学习实现的分类准确率接近具有大得多的可调参数空间和高得多训练成本的最先进深度网络。它对噪声也非常鲁棒。 旨在在传统架构和神经形态架构上的训练和推理中都非常高效。它提供了单通道、单次和连续监督学习的独特组合;在一个非常简单的无监督阶段之后。已经证明了对不完美输入具有很强鲁棒性的准确分类推理。这些贡献使其非常适合边缘和物联网应用。

相似文献

1
and Sparse Binary Coincidence (SBC) memories: Fast, robust learning and inference for neuromorphic architectures.以及稀疏二元巧合(SBC)存储器:用于神经形态架构的快速、稳健学习与推理。
Front Neuroinform. 2023 Mar 21;17:1125844. doi: 10.3389/fninf.2023.1125844. eCollection 2023.
2
Event-driven implementation of deep spiking convolutional neural networks for supervised classification using the SpiNNaker neuromorphic platform.基于 SpiNNaker 神经形态平台的用于监督分类的深度尖峰卷积神经网络的事件驱动实现。
Neural Netw. 2020 Jan;121:319-328. doi: 10.1016/j.neunet.2019.09.008. Epub 2019 Sep 24.
3
Liquid State Machine on SpiNNaker for Spatio-Temporal Classification Tasks.用于时空分类任务的SpiNNaker上的液态机器
Front Neurosci. 2022 Mar 14;16:819063. doi: 10.3389/fnins.2022.819063. eCollection 2022.
4
Neural Coding in Spiking Neural Networks: A Comparative Study for Robust Neuromorphic Systems.脉冲神经网络中的神经编码:对鲁棒神经形态系统的比较研究
Front Neurosci. 2021 Mar 4;15:638474. doi: 10.3389/fnins.2021.638474. eCollection 2021.
5
SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training.SSTDP:用于高效脉冲神经网络训练的监督式脉冲时间依赖可塑性
Front Neurosci. 2021 Nov 4;15:756876. doi: 10.3389/fnins.2021.756876. eCollection 2021.
6
Hardware-Efficient On-line Learning through Pipelined Truncated-Error Backpropagation in Binary-State Networks.通过二进制状态网络中的流水线截断误差反向传播实现硬件高效在线学习。
Front Neurosci. 2017 Sep 6;11:496. doi: 10.3389/fnins.2017.00496. eCollection 2017.
7
Fast and Accurate Sparse Coding of Visual Stimuli With a Simple, Ultralow-Energy Spiking Architecture.快速且准确的视觉刺激稀疏编码,采用简单、超低能耗的尖峰架构。
IEEE Trans Neural Netw Learn Syst. 2019 Jul;30(7):2173-2187. doi: 10.1109/TNNLS.2018.2878002. Epub 2018 Nov 20.
8
Memristor Neural Network Training with Clock Synchronous Neuromorphic System.基于时钟同步神经形态系统的忆阻器神经网络训练
Micromachines (Basel). 2019 Jun 8;10(6):384. doi: 10.3390/mi10060384.
9
E-prop on SpiNNaker 2: Exploring online learning in spiking RNNs on neuromorphic hardware.SpiNNaker 2上的E-prop:探索神经形态硬件上脉冲循环神经网络中的在线学习。
Front Neurosci. 2022 Nov 28;16:1018006. doi: 10.3389/fnins.2022.1018006. eCollection 2022.
10
Memristors for Neuromorphic Circuits and Artificial Intelligence Applications.用于神经形态电路和人工智能应用的忆阻器
Materials (Basel). 2020 Feb 20;13(4):938. doi: 10.3390/ma13040938.

本文引用的文献

1
Liquid State Machine on SpiNNaker for Spatio-Temporal Classification Tasks.用于时空分类任务的SpiNNaker上的液态机器
Front Neurosci. 2022 Mar 14;16:819063. doi: 10.3389/fnins.2022.819063. eCollection 2022.
2
Global organization of neuronal activity only requires unstructured local connectivity.全球神经元活动组织只需要非结构化的局部连接。
Elife. 2022 Jan 20;11:e68422. doi: 10.7554/eLife.68422.
3
Efficient-CapsNet: capsule network with self-attention routing.高效胶囊网络:具有自注意力路由的胶囊网络。
Sci Rep. 2021 Jul 19;11(1):14634. doi: 10.1038/s41598-021-93977-0.
4
Efficient Spike-Driven Learning With Dendritic Event-Based Processing.基于树突事件处理的高效尖峰驱动学习
Front Neurosci. 2021 Feb 19;15:601109. doi: 10.3389/fnins.2021.601109. eCollection 2021.
5
BiCoSS: Toward Large-Scale Cognition Brain With Multigranular Neuromorphic Architecture.BiCoSS:具有多粒度神经形态架构的大规模认知脑。
IEEE Trans Neural Netw Learn Syst. 2022 Jul;33(7):2801-2815. doi: 10.1109/TNNLS.2020.3045492. Epub 2022 Jul 6.
6
Dendritic solutions to the credit assignment problem.树突状解决信用分配问题。
Curr Opin Neurobiol. 2019 Feb;54:28-36. doi: 10.1016/j.conb.2018.08.003. Epub 2018 Sep 8.
7
Spiking neural networks for computer vision.用于计算机视觉的脉冲神经网络。
Interface Focus. 2018 Aug 6;8(4):20180007. doi: 10.1098/rsfs.2018.0007. Epub 2018 Jun 15.
8
Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades.利用扫视将静态图像数据集转换为脉冲神经形态数据集
Front Neurosci. 2015 Nov 16;9:437. doi: 10.3389/fnins.2015.00437. eCollection 2015.
9
Synaptic clustering within dendrites: an emerging theory of memory formation.树突内的突触聚集:一种新兴的记忆形成理论。
Prog Neurobiol. 2015 Mar;126:19-35. doi: 10.1016/j.pneurobio.2014.12.002. Epub 2015 Jan 8.
10
Coding and decoding with dendrites.利用树突进行编码和解码。
J Physiol Paris. 2014 Feb;108(1):18-27. doi: 10.1016/j.jphysparis.2013.05.003. Epub 2013 May 31.