• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

略读数字:尖峰编码图像的神经形态分类

Skimming Digits: Neuromorphic Classification of Spike-Encoded Images.

作者信息

Cohen Gregory K, Orchard Garrick, Leng Sio-Hoi, Tapson Jonathan, Benosman Ryad B, van Schaik André

机构信息

Biomedical Engineering and Neuroscience, The MARCS Institute, Western Sydney UniversitySydney, NSW, Australia; Natural Vision and Computation Team, Vision Institute, University Pierre and Marie Curie-Centre National de la Recherche ScientifiqueParis, France.

Temasek Labs (TLAB), National University of SingaporeSingapore, Singapore; Neuromorphic Engineering and Robotics, Singapore Institute for Neurotechnology (SINAPSE), National University of SingaporeSingapore, Singapore.

出版信息

Front Neurosci. 2016 Apr 28;10:184. doi: 10.3389/fnins.2016.00184. eCollection 2016.

DOI:10.3389/fnins.2016.00184
PMID:27199646
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC4848313/
Abstract

The growing demands placed upon the field of computer vision have renewed the focus on alternative visual scene representations and processing paradigms. Silicon retinea provide an alternative means of imaging the visual environment, and produce frame-free spatio-temporal data. This paper presents an investigation into event-based digit classification using N-MNIST, a neuromorphic dataset created with a silicon retina, and the Synaptic Kernel Inverse Method (SKIM), a learning method based on principles of dendritic computation. As this work represents the first large-scale and multi-class classification task performed using the SKIM network, it explores different training patterns and output determination methods necessary to extend the original SKIM method to support multi-class problems. Making use of SKIM networks applied to real-world datasets, implementing the largest hidden layer sizes and simultaneously training the largest number of output neurons, the classification system achieved a best-case accuracy of 92.87% for a network containing 10,000 hidden layer neurons. These results represent the highest accuracies achieved against the dataset to date and serve to validate the application of the SKIM method to event-based visual classification tasks. Additionally, the study found that using a square pulse as the supervisory training signal produced the highest accuracy for most output determination methods, but the results also demonstrate that an exponential pattern is better suited to hardware implementations as it makes use of the simplest output determination method based on the maximum value.

摘要

计算机视觉领域不断增长的需求,重新聚焦于替代视觉场景表示和处理范式。硅视网膜提供了一种对视觉环境进行成像的替代方法,并产生无帧的时空数据。本文介绍了一项使用N-MNIST(一个用硅视网膜创建的神经形态数据集)和突触核逆方法(SKIM,一种基于树突计算原理的学习方法)进行基于事件的数字分类的研究。由于这项工作代表了首次使用SKIM网络执行的大规模多类分类任务,它探索了将原始SKIM方法扩展以支持多类问题所需的不同训练模式和输出确定方法。通过将SKIM网络应用于真实世界数据集,实现最大的隐藏层大小并同时训练最多数量的输出神经元,该分类系统对于包含10,000个隐藏层神经元的网络,实现了92.87%的最佳准确率。这些结果代表了迄今为止针对该数据集所取得的最高准确率,并有助于验证SKIM方法在基于事件的视觉分类任务中的应用。此外,研究发现,对于大多数输出确定方法,使用方波作为监督训练信号可产生最高准确率,但结果也表明指数模式更适合硬件实现,因为它使用基于最大值的最简单输出确定方法。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/141842164fcf/fnins-10-00184-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/d6fef4025eac/fnins-10-00184-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/b4917e5286e6/fnins-10-00184-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/34bf4b976c2e/fnins-10-00184-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/16b34241788e/fnins-10-00184-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/dfbadd146fe3/fnins-10-00184-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/395a37ea9fe8/fnins-10-00184-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/141842164fcf/fnins-10-00184-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/d6fef4025eac/fnins-10-00184-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/b4917e5286e6/fnins-10-00184-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/34bf4b976c2e/fnins-10-00184-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/16b34241788e/fnins-10-00184-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/dfbadd146fe3/fnins-10-00184-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/395a37ea9fe8/fnins-10-00184-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4c29/4848313/141842164fcf/fnins-10-00184-g0007.jpg

相似文献

1
Skimming Digits: Neuromorphic Classification of Spike-Encoded Images.略读数字:尖峰编码图像的神经形态分类
Front Neurosci. 2016 Apr 28;10:184. doi: 10.3389/fnins.2016.00184. eCollection 2016.
2
Benchmarking Spike-Based Visual Recognition: A Dataset and Evaluation.基于脉冲的视觉识别基准测试:数据集与评估
Front Neurosci. 2016 Nov 2;10:496. doi: 10.3389/fnins.2016.00496. eCollection 2016.
3
Multiclass Classification by Adaptive Network of Dendritic Neurons with Binary Synapses Using Structural Plasticity.使用结构可塑性的具有二元突触的树突神经元自适应网络进行多类分类
Front Neurosci. 2016 Mar 31;10:113. doi: 10.3389/fnins.2016.00113. eCollection 2016.
4
Event-driven implementation of deep spiking convolutional neural networks for supervised classification using the SpiNNaker neuromorphic platform.基于 SpiNNaker 神经形态平台的用于监督分类的深度尖峰卷积神经网络的事件驱动实现。
Neural Netw. 2020 Jan;121:319-328. doi: 10.1016/j.neunet.2019.09.008. Epub 2019 Sep 24.
5
Feature Representations for Neuromorphic Audio Spike Streams.神经形态音频脉冲流的特征表示
Front Neurosci. 2018 Feb 9;12:23. doi: 10.3389/fnins.2018.00023. eCollection 2018.
6
Synthesizing Images From Spatio-Temporal Representations Using Spike-Based Backpropagation.使用基于脉冲的反向传播从时空表示中合成图像。
Front Neurosci. 2019 Jun 18;13:621. doi: 10.3389/fnins.2019.00621. eCollection 2019.
7
Liquid State Machine on SpiNNaker for Spatio-Temporal Classification Tasks.用于时空分类任务的SpiNNaker上的液态机器
Front Neurosci. 2022 Mar 14;16:819063. doi: 10.3389/fnins.2022.819063. eCollection 2022.
8
On Practical Issues for Stochastic STDP Hardware With 1-bit Synaptic Weights.关于具有1位突触权重的随机STDP硬件的实际问题。
Front Neurosci. 2018 Oct 15;12:665. doi: 10.3389/fnins.2018.00665. eCollection 2018.
9
Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition.用于在线时空谱模式识别的动态进化尖峰神经网络。
Neural Netw. 2013 May;41:188-201. doi: 10.1016/j.neunet.2012.11.014. Epub 2012 Dec 20.
10
Training Deep Spiking Neural Networks Using Backpropagation.使用反向传播训练深度脉冲神经网络。
Front Neurosci. 2016 Nov 8;10:508. doi: 10.3389/fnins.2016.00508. eCollection 2016.

引用本文的文献

1
Encoding integers and rationals on neuromorphic computers using virtual neuron.使用虚拟神经元在神经形态计算机上对整数和有理数进行编码。
Sci Rep. 2023 Jul 6;13(1):10975. doi: 10.1038/s41598-023-35005-x.
2
MAP-SNN: Mapping spike activities with multiplicity, adaptability, and plasticity into bio-plausible spiking neural networks.MAP-SNN:将具有多样性、适应性和可塑性的脉冲活动映射到具有生物合理性的脉冲神经网络中。
Front Neurosci. 2022 Sep 20;16:945037. doi: 10.3389/fnins.2022.945037. eCollection 2022.
3
Is Neuromorphic MNIST Neuromorphic? Analyzing the Discriminative Power of Neuromorphic Datasets in the Time Domain.

本文引用的文献

1
Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades.利用扫视将静态图像数据集转换为脉冲神经形态数据集
Front Neurosci. 2015 Nov 16;9:437. doi: 10.3389/fnins.2015.00437. eCollection 2015.
2
HFirst: A Temporal Approach to Object Recognition.HFirst:一种基于时间的目标识别方法。
IEEE Trans Pattern Anal Mach Intell. 2015 Oct;37(10):2028-40. doi: 10.1109/TPAMI.2015.2392947.
3
What can neuromorphic event-driven precise timing add to spike-based pattern recognition?神经形态事件驱动的精确计时能为基于尖峰的模式识别增添什么?
神经形态MNIST数据集是神经形态的吗?分析神经形态数据集在时域中的判别能力。
Front Neurosci. 2021 Mar 25;15:608567. doi: 10.3389/fnins.2021.608567. eCollection 2021.
4
Event-Based Computation for Touch Localization Based on Precise Spike Timing.基于精确脉冲时间的触摸定位的基于事件的计算
Front Neurosci. 2020 May 19;14:420. doi: 10.3389/fnins.2020.00420. eCollection 2020.
5
Event-Based Feature Extraction Using Adaptive Selection Thresholds.基于事件的特征提取使用自适应选择阈值。
Sensors (Basel). 2020 Mar 13;20(6):1600. doi: 10.3390/s20061600.
6
Bio-Inspired Evolutionary Model of Spiking Neural Networks in Ionic Liquid Space.离子液体空间中脉冲神经网络的生物启发式进化模型
Front Neurosci. 2019 Nov 8;13:1085. doi: 10.3389/fnins.2019.01085. eCollection 2019.
7
Spatio-Temporal Backpropagation for Training High-Performance Spiking Neural Networks.用于训练高性能脉冲神经网络的时空反向传播
Front Neurosci. 2018 May 23;12:331. doi: 10.3389/fnins.2018.00331. eCollection 2018.
8
Feature Representations for Neuromorphic Audio Spike Streams.神经形态音频脉冲流的特征表示
Front Neurosci. 2018 Feb 9;12:23. doi: 10.3389/fnins.2018.00023. eCollection 2018.
9
An Event-Driven Classifier for Spiking Neural Networks Fed with Synthetic or Dynamic Vision Sensor Data.一种用于尖峰神经网络的事件驱动分类器,其输入为合成或动态视觉传感器数据。
Front Neurosci. 2017 Jun 28;11:350. doi: 10.3389/fnins.2017.00350. eCollection 2017.
10
Training Deep Spiking Neural Networks Using Backpropagation.使用反向传播训练深度脉冲神经网络。
Front Neurosci. 2016 Nov 8;10:508. doi: 10.3389/fnins.2016.00508. eCollection 2016.
Neural Comput. 2015 Mar;27(3):561-93. doi: 10.1162/NECO_a_00703. Epub 2015 Jan 20.
4
Artificial brains. A million spiking-neuron integrated circuit with a scalable communication network and interface.人工大脑。具有可扩展通信网络和接口的 100 万个尖峰神经元集成电路。
Science. 2014 Aug 8;345(6197):668-73. doi: 10.1126/science.1254642. Epub 2014 Aug 7.
5
Real-time classification and sensor fusion with a spiking deep belief network.基于尖峰神经网络的实时分类与传感器融合。
Front Neurosci. 2013 Oct 8;7:178. doi: 10.3389/fnins.2013.00178. eCollection 2013.
6
Mapping from frame-driven to frame-free event-driven vision systems by low-rate rate coding and coincidence processing--application to feedforward ConvNets.通过低速率率编码和符合处理从基于帧的到无帧的事件驱动视觉系统的映射 - 应用于前馈 ConvNets。
IEEE Trans Pattern Anal Mach Intell. 2013 Nov;35(11):2706-19. doi: 10.1109/TPAMI.2013.71.
7
Synthesis of neural networks for spatio-temporal spike pattern recognition and processing.神经网络的时空尖峰模式识别与处理合成。
Front Neurosci. 2013 Aug 30;7:153. doi: 10.3389/fnins.2013.00153. eCollection 2013.