• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于大规模脉冲神经网络中基于脉冲时间依赖可塑性的内存高效神经元和突触

Memory-efficient neurons and synapses for spike-timing-dependent-plasticity in large-scale spiking networks.

作者信息

Urbizagastegui Pablo, van Schaik André, Wang Runchun

机构信息

International Centre for Neuromorphic Systems, The MARCS Institute for Brain, Behavior, and Development, Western Sydney University, Kingswood, NSW, Australia.

出版信息

Front Neurosci. 2024 Sep 6;18:1450640. doi: 10.3389/fnins.2024.1450640. eCollection 2024.

DOI:10.3389/fnins.2024.1450640
PMID:39308944
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11412959/
Abstract

This paper addresses the challenges posed by frequent memory access during simulations of large-scale spiking neural networks involving synaptic plasticity. We focus on the memory accesses performed during a common synaptic plasticity rule since this can be a significant factor limiting the efficiency of the simulations. We propose neuron models that are represented by only three state variables, which are engineered to enforce the appropriate neuronal dynamics. Additionally, memory retrieval is executed solely by fetching postsynaptic variables, promoting a contiguous memory storage and leveraging the capabilities of burst mode operations to reduce the overhead associated with each access. Different plasticity rules could be implemented despite the adopted simplifications, each leading to a distinct synaptic weight distribution (i.e., unimodal and bimodal). Moreover, our method requires fewer average memory accesses compared to a naive approach. We argue that the strategy described can speed up memory transactions and reduce latencies while maintaining a small memory footprint.

摘要

本文探讨了在涉及突触可塑性的大规模脉冲神经网络模拟过程中频繁内存访问所带来的挑战。我们关注在常见突触可塑性规则执行期间的内存访问,因为这可能是限制模拟效率的一个重要因素。我们提出仅由三个状态变量表示的神经元模型,这些变量经过设计以强制实现适当的神经元动态。此外,内存检索仅通过获取突触后变量来执行,促进连续内存存储并利用突发模式操作的能力来减少每次访问的开销。尽管采用了简化方法,但仍可实现不同的可塑性规则,每种规则都会导致独特的突触权重分布(即单峰和双峰)。此外,与简单方法相比,我们的方法平均内存访问次数更少。我们认为所描述的策略可以加快内存事务处理并减少延迟,同时保持较小的内存占用。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/701b10971974/fnins-18-1450640-g0010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/189617d43538/fnins-18-1450640-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/6124c03a6ad0/fnins-18-1450640-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/7bbb9cf9fb6c/fnins-18-1450640-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/e34ee3ea6b91/fnins-18-1450640-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/730792457ead/fnins-18-1450640-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/05a0edb7e78f/fnins-18-1450640-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/a9d2a63258c5/fnins-18-1450640-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/7eb9fb954c6a/fnins-18-1450640-g0008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/a3bef2538e26/fnins-18-1450640-g0009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/701b10971974/fnins-18-1450640-g0010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/189617d43538/fnins-18-1450640-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/6124c03a6ad0/fnins-18-1450640-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/7bbb9cf9fb6c/fnins-18-1450640-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/e34ee3ea6b91/fnins-18-1450640-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/730792457ead/fnins-18-1450640-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/05a0edb7e78f/fnins-18-1450640-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/a9d2a63258c5/fnins-18-1450640-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/7eb9fb954c6a/fnins-18-1450640-g0008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/a3bef2538e26/fnins-18-1450640-g0009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9e15/11412959/701b10971974/fnins-18-1450640-g0010.jpg

相似文献

1
Memory-efficient neurons and synapses for spike-timing-dependent-plasticity in large-scale spiking networks.用于大规模脉冲神经网络中基于脉冲时间依赖可塑性的内存高效神经元和突触
Front Neurosci. 2024 Sep 6;18:1450640. doi: 10.3389/fnins.2024.1450640. eCollection 2024.
2
A neuromorphic implementation of multiple spike-timing synaptic plasticity rules for large-scale neural networks.一种用于大规模神经网络的多种尖峰时间突触可塑性规则的神经形态实现。
Front Neurosci. 2015 May 20;9:180. doi: 10.3389/fnins.2015.00180. eCollection 2015.
3
A forecast-based STDP rule suitable for neuromorphic implementation.一种适用于神经形态实现的基于预测的 STDP 规则。
Neural Netw. 2012 Aug;32:3-14. doi: 10.1016/j.neunet.2012.02.018. Epub 2012 Feb 14.
4
Distinct Heterosynaptic Plasticity in Fast Spiking and Non-Fast-Spiking Inhibitory Neurons in Rat Visual Cortex.大鼠视觉皮层中快速放电和非快速放电抑制性神经元的异突触可塑性不同。
J Neurosci. 2019 Aug 28;39(35):6865-6878. doi: 10.1523/JNEUROSCI.3039-18.2019. Epub 2019 Jul 12.
5
Optimality model of unsupervised spike-timing-dependent plasticity: synaptic memory and weight distribution.无监督的尖峰时间依赖性可塑性的最优性模型:突触记忆与权重分布
Neural Comput. 2007 Mar;19(3):639-71. doi: 10.1162/neco.2007.19.3.639.
6
Modeling the Short-Term Dynamics of Excitatory Spike Transmission.建模兴奋性尖峰传输的短期动力学。
J Neurosci. 2020 May 20;40(21):4185-4202. doi: 10.1523/JNEUROSCI.1482-19.2020. Epub 2020 Apr 17.
7
Toward Robust Cognitive 3D Brain-Inspired Cross-Paradigm System.迈向强大的认知3D脑启发式跨范式系统。
Front Neurosci. 2021 Jun 25;15:690208. doi: 10.3389/fnins.2021.690208. eCollection 2021.
8
Analog-digital simulations of full conductance-based networks of spiking neurons with spike timing dependent plasticity.基于全电导的具有脉冲时间依赖可塑性的脉冲神经元网络的模拟数字仿真。
Network. 2006 Sep;17(3):211-33. doi: 10.1080/09548980600711124.
9
Categorization and decision-making in a neurobiologically plausible spiking network using a STDP-like learning rule.使用类似于 STDP 的学习规则在具有神经生物学合理性的尖峰网络中进行分类和决策。
Neural Netw. 2013 Dec;48:109-24. doi: 10.1016/j.neunet.2013.07.012. Epub 2013 Aug 14.
10
Memory-Efficient Synaptic Connectivity for Spike-Timing- Dependent Plasticity.用于基于尖峰时间依赖性可塑性的内存高效突触连接
Front Neurosci. 2019 Apr 24;13:357. doi: 10.3389/fnins.2019.00357. eCollection 2019.

本文引用的文献

1
Introducing the Dendrify framework for incorporating dendrites to spiking neural networks.引入 Dendrify 框架,将树突整合到尖峰神经网络中。
Nat Commun. 2023 Jan 10;14(1):131. doi: 10.1038/s41467-022-35747-8.
2
Brian2CUDA: Flexible and Efficient Simulation of Spiking Neural Network Models on GPUs.Brian2CUDA:在图形处理器上对脉冲神经网络模型进行灵活高效的模拟。
Front Neuroinform. 2022 Oct 31;16:883700. doi: 10.3389/fninf.2022.883700. eCollection 2022.
3
A data-based large-scale model for primary visual cortex enables brain-like robust and versatile visual processing.
一种基于数据的初级视觉皮层大规模模型实现了类似大脑的强大且通用的视觉处理。
Sci Adv. 2022 Nov 4;8(44):eabq7592. doi: 10.1126/sciadv.abq7592. Epub 2022 Nov 2.
4
Neural heterogeneity promotes robust learning.神经异质性促进了稳健的学习。
Nat Commun. 2021 Oct 4;12(1):5791. doi: 10.1038/s41467-021-26022-3.
5
Brian 2, an intuitive and efficient neural simulator.Brian 2,一个直观高效的神经模拟器。
Elife. 2019 Aug 20;8:e47314. doi: 10.7554/eLife.47314.
6
Memory-Efficient Synaptic Connectivity for Spike-Timing- Dependent Plasticity.用于基于尖峰时间依赖性可塑性的内存高效突触连接
Front Neurosci. 2019 Apr 24;13:357. doi: 10.3389/fnins.2019.00357. eCollection 2019.
7
GPUs Outperform Current HPC and Neuromorphic Solutions in Terms of Speed and Energy When Simulating a Highly-Connected Cortical Model.在模拟高度连接的皮质模型时,图形处理器(GPU)在速度和能源方面优于当前的高性能计算(HPC)和神经形态解决方案。
Front Neurosci. 2018 Dec 12;12:941. doi: 10.3389/fnins.2018.00941. eCollection 2018.
8
Large-Scale Neuromorphic Spiking Array Processors: A Quest to Mimic the Brain.大规模神经形态脉冲阵列处理器:对模仿大脑的探索。
Front Neurosci. 2018 Dec 3;12:891. doi: 10.3389/fnins.2018.00891. eCollection 2018.
9
A 0.086-mm 12.7-pJ/SOP 64k-Synapse 256-Neuron Online-Learning Digital Spiking Neuromorphic Processor in 28-nm CMOS.在 28nmCMOS 中,实现了一款 0.086mm²、12.7pJ/SOP、64k 突触、256 神经元、在线学习、数字尖峰神经形态处理器。
IEEE Trans Biomed Circuits Syst. 2019 Feb;13(1):145-158. doi: 10.1109/TBCAS.2018.2880425. Epub 2018 Nov 9.
10
A multi-scale layer-resolved spiking network model of resting-state dynamics in macaque visual cortical areas.猴视觉皮层静息态动力学的多尺度分层尖峰网络模型。
PLoS Comput Biol. 2018 Oct 18;14(10):e1006359. doi: 10.1371/journal.pcbi.1006359. eCollection 2018 Oct.