• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于电阻式记忆阵列的脉冲神经网络的无监督学习

Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks.

作者信息

Guo Yilong, Wu Huaqiang, Gao Bin, Qian He

机构信息

Institute of Microelectronics, Tsinghua University, Beijing, China.

出版信息

Front Neurosci. 2019 Aug 6;13:812. doi: 10.3389/fnins.2019.00812. eCollection 2019.

DOI:10.3389/fnins.2019.00812
PMID:31447634
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6691091/
Abstract

Spiking Neural Networks (SNNs) offer great potential to promote both the performance and efficiency of real-world computing systems, considering the biological plausibility of SNNs. The emerging analog Resistive Random Access Memory (RRAM) devices have drawn increasing interest as potential neuromorphic hardware for implementing practical SNNs. In this article, we propose a novel training approach (called greedy training) for SNNs by diluting spike events on the temporal dimension with necessary controls on input encoding phase switching, endowing SNNs with the ability to cooperate with the inevitable conductance variations of RRAM devices. The SNNs could utilize Spike-Timing-Dependent Plasticity (STDP) as the unsupervised learning rule, and this plasticity has been observed on our one-transistor-one-resistor (1T1R) RRAM devices under voltage pulses with designed waveforms. We have also conducted handwritten digit recognition task simulations on MNIST dataset. The results show that the unsupervised SNNs trained by the proposed method could mitigate the requirement for the number of gradual levels of RRAM devices, and also have immunity to both cycle-to-cycle and device-to-device RRAM conductance variations. Unsupervised SNNs trained by the proposed methods could cooperate with real RRAM devices with non-ideal behaviors better, promising high feasibility of RRAM array based neuromorphic systems for online training.

摘要

考虑到脉冲神经网络(SNN)的生物合理性,它在提升现实世界计算系统的性能和效率方面具有巨大潜力。新兴的模拟电阻式随机存取存储器(RRAM)器件作为实现实用SNN的潜在神经形态硬件,已引起越来越多的关注。在本文中,我们提出了一种新颖的SNN训练方法(称为贪婪训练),通过在时间维度上稀释脉冲事件,并对输入编码相位切换进行必要控制,使SNN能够与RRAM器件不可避免的电导变化协同工作。SNN可以利用基于脉冲时间的可塑性(STDP)作为无监督学习规则,并且在具有设计波形的电压脉冲下,我们在单晶体管单电阻(1T1R)RRAM器件上观察到了这种可塑性。我们还在MNIST数据集上进行了手写数字识别任务模拟。结果表明,通过所提出的方法训练的无监督SNN可以减轻对RRAM器件渐变电平数量的要求,并且对RRAM的逐周期和器件间电导变化具有免疫力。通过所提出的方法训练的无监督SNN可以更好地与具有非理想行为的实际RRAM器件协同工作,这为基于RRAM阵列的神经形态系统进行在线训练提供了很高的可行性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/65e2f637ae1c/fnins-13-00812-g0011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/f1915b941848/fnins-13-00812-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/8e347fcf5509/fnins-13-00812-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/b96e78c1edba/fnins-13-00812-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/ad3992b53bc9/fnins-13-00812-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/113f387bac45/fnins-13-00812-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/8ce310ec698a/fnins-13-00812-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/9902165c721c/fnins-13-00812-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/48163fdd09c4/fnins-13-00812-g0008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/5129876dc2fd/fnins-13-00812-g0009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/282f84072bb7/fnins-13-00812-g0010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/65e2f637ae1c/fnins-13-00812-g0011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/f1915b941848/fnins-13-00812-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/8e347fcf5509/fnins-13-00812-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/b96e78c1edba/fnins-13-00812-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/ad3992b53bc9/fnins-13-00812-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/113f387bac45/fnins-13-00812-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/8ce310ec698a/fnins-13-00812-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/9902165c721c/fnins-13-00812-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/48163fdd09c4/fnins-13-00812-g0008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/5129876dc2fd/fnins-13-00812-g0009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/282f84072bb7/fnins-13-00812-g0010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e64a/6691091/65e2f637ae1c/fnins-13-00812-g0011.jpg

相似文献

1
Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks.基于电阻式记忆阵列的脉冲神经网络的无监督学习
Front Neurosci. 2019 Aug 6;13:812. doi: 10.3389/fnins.2019.00812. eCollection 2019.
2
Non-linear Memristive Synaptic Dynamics for Efficient Unsupervised Learning in Spiking Neural Networks.用于脉冲神经网络中高效无监督学习的非线性忆阻突触动力学
Front Neurosci. 2021 Feb 1;15:580909. doi: 10.3389/fnins.2021.580909. eCollection 2021.
3
The Characteristics of Binary Spike-Time-Dependent Plasticity in HfO-Based RRAM and Applications for Pattern Recognition.基于HfO的阻变随机存取存储器中二元脉冲时间依赖可塑性的特性及其在模式识别中的应用
Nanoscale Res Lett. 2017 Dec;12(1):244. doi: 10.1186/s11671-017-2023-y. Epub 2017 Apr 4.
4
Unsupervised learning in hexagonal boron nitride memristor-based spiking neural networks.基于六方氮化硼忆阻器的脉冲神经网络中的无监督学习。
Nanotechnology. 2023 Aug 17;34(44). doi: 10.1088/1361-6528/acebf5.
5
SSTDP: Supervised Spike Timing Dependent Plasticity for Efficient Spiking Neural Network Training.SSTDP:用于高效脉冲神经网络训练的监督式脉冲时间依赖可塑性
Front Neurosci. 2021 Nov 4;15:756876. doi: 10.3389/fnins.2021.756876. eCollection 2021.
6
A biologically plausible supervised learning method for spiking neural networks using the symmetric STDP rule.基于对称 STDP 规则的尖峰神经网络的生物合理有监督学习方法。
Neural Netw. 2020 Jan;121:387-395. doi: 10.1016/j.neunet.2019.09.007. Epub 2019 Sep 27.
7
Spiking Neural Networks Based on OxRAM Synapses for Real-Time Unsupervised Spike Sorting.基于氧化物随机存取存储器突触的脉冲神经网络用于实时无监督脉冲排序
Front Neurosci. 2016 Nov 3;10:474. doi: 10.3389/fnins.2016.00474. eCollection 2016.
8
Spiking Neural Networks with Unsupervised Learning Based on STDP Using Resistive Synaptic Devices and Analog CMOS Neuron Circuit.基于 STDP 的使用阻变突触器件和模拟 CMOS 神经元电路的无监督学习尖峰神经网络。
J Nanosci Nanotechnol. 2018 Sep 1;18(9):6588-6592. doi: 10.1166/jnn.2018.15700.
9
Spike-Timing Dependent Plasticity in Unipolar Silicon Oxide RRAM Devices.单极氧化硅阻变随机存取存储器(RRAM)器件中的尖峰时间依赖性可塑性
Front Neurosci. 2018 Feb 8;12:57. doi: 10.3389/fnins.2018.00057. eCollection 2018.
10
An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections.一种基于无监督 STDP 的尖峰神经网络,灵感来自于具有生物学合理性的学习规则和连接。
Neural Netw. 2023 Aug;165:799-808. doi: 10.1016/j.neunet.2023.06.019. Epub 2023 Jun 22.

引用本文的文献

1
Hybrid CMOS-Memristor synapse circuits for implementing Ca ion-based plasticity model.用于实现基于钙离子可塑性模型的混合互补金属氧化物半导体-忆阻器突触电路。
Sci Rep. 2024 Aug 2;14(1):17915. doi: 10.1038/s41598-024-68359-x.
2
Voltage-dependent synaptic plasticity: Unsupervised probabilistic Hebbian plasticity rule based on neurons membrane potential.电压依赖性突触可塑性:基于神经元膜电位的无监督概率赫布可塑性规则。
Front Neurosci. 2022 Oct 21;16:983950. doi: 10.3389/fnins.2022.983950. eCollection 2022.
3
Superconducting disordered neural networks for neuromorphic processing with fluxons.

本文引用的文献

1
Spike-timing-dependent plasticity learning of coincidence detection with passively integrated memristive circuits.基于被动集成忆阻器电路的尖峰时间依赖可塑性学习的一致性检测。
Nat Commun. 2018 Dec 14;9(1):5311. doi: 10.1038/s41467-018-07757-y.
2
Neuromorphic computing with multi-memristive synapses.基于多忆阻器突触的神经形态计算。
Nat Commun. 2018 Jun 28;9(1):2514. doi: 10.1038/s41467-018-04933-y.
3
Memristive neural network for on-line learning and tracking with brain-inspired spike timing dependent plasticity.基于神经启发的尖峰时间依赖可塑性的忆阻神经网络的在线学习和跟踪。
用于通量子神经形态处理的超导无序神经网络。
Sci Adv. 2022 Apr 22;8(16):eabn4485. doi: 10.1126/sciadv.abn4485.
4
Engineering Spiking Neurons Using Threshold Switching Devices for High-Efficient Neuromorphic Computing.使用阈值开关器件设计脉冲神经元用于高效神经形态计算
Front Neurosci. 2022 Jan 5;15:786694. doi: 10.3389/fnins.2021.786694. eCollection 2021.
5
MSPAN: A Memristive Spike-Based Computing Engine With Adaptive Neuron for Edge Arrhythmia Detection.MSPAN:一种用于边缘性心律失常检测的具有自适应神经元的基于忆阻器尖峰的计算引擎。
Front Neurosci. 2021 Dec 15;15:761127. doi: 10.3389/fnins.2021.761127. eCollection 2021.
6
Synaptic Plasticity in Memristive Artificial Synapses and Their Robustness Against Noisy Inputs.忆阻式人工突触中的突触可塑性及其对噪声输入的鲁棒性
Front Neurosci. 2021 Jul 14;15:660894. doi: 10.3389/fnins.2021.660894. eCollection 2021.
7
Neurohybrid Memristive CMOS-Integrated Systems for Biosensors and Neuroprosthetics.用于生物传感器和神经假体的神经混合忆阻式CMOS集成系统。
Front Neurosci. 2020 Apr 28;14:358. doi: 10.3389/fnins.2020.00358. eCollection 2020.
8
Perovskite neural trees.钙钛矿神经树。
Nat Commun. 2020 May 7;11(1):2245. doi: 10.1038/s41467-020-16105-y.
Sci Rep. 2017 Jul 13;7(1):5288. doi: 10.1038/s41598-017-05480-0.
4
Face classification using electronic synapses.基于电子突触的人脸分类。
Nat Commun. 2017 May 12;8:15199. doi: 10.1038/ncomms15199.
5
Acceleration of Deep Neural Network Training with Resistive Cross-Point Devices: Design Considerations.利用电阻式交叉点器件加速深度神经网络训练:设计考量
Front Neurosci. 2016 Jul 21;10:333. doi: 10.3389/fnins.2016.00333. eCollection 2016.
6
Unsupervised learning of digit recognition using spike-timing-dependent plasticity.使用基于脉冲时间依赖可塑性的无监督数字识别学习。
Front Comput Neurosci. 2015 Aug 3;9:99. doi: 10.3389/fncom.2015.00099. eCollection 2015.
7
Fully parallel write/read in resistive synaptic array for accelerating on-chip learning.用于加速片上学习的电阻式突触阵列的全并行读写。
Nanotechnology. 2015 Nov 13;26(45):455204. doi: 10.1088/0957-4484/26/45/455204.
8
A reconfigurable on-line learning spiking neuromorphic processor comprising 256 neurons and 128K synapses.一种可重构的在线学习脉冲神经形态处理器,包含256个神经元和128K个突触。
Front Neurosci. 2015 Apr 29;9:141. doi: 10.3389/fnins.2015.00141. eCollection 2015.
9
A 2-transistor/1-resistor artificial synapse capable of communication and stochastic learning in neuromorphic systems.一种能够在神经形态系统中进行通信和随机学习的双晶体管/单电阻人工突触。
Front Neurosci. 2015 Jan 15;8:438. doi: 10.3389/fnins.2014.00438. eCollection 2014.
10
Synaptic electronics: materials, devices and applications.突触电子学:材料、器件与应用。
Nanotechnology. 2013 Sep 27;24(38):382001. doi: 10.1088/0957-4484/24/38/382001. Epub 2013 Sep 2.