Suppr超能文献

SpykeTorch:每个神经元最多一个脉冲的卷积脉冲神经网络的高效模拟

SpykeTorch: Efficient Simulation of Convolutional Spiking Neural Networks With at Most One Spike per Neuron.

作者信息

Mozafari Milad, Ganjtabesh Mohammad, Nowzari-Dalini Abbas, Masquelier Timothée

机构信息

Department of Computer Science, School of Mathematics, Statistics, and Computer Science, University of Tehran, Tehran, Iran.

CERCO UMR 5549, CNRS - Université Toulouse 3, Toulouse, France.

出版信息

Front Neurosci. 2019 Jul 12;13:625. doi: 10.3389/fnins.2019.00625. eCollection 2019.

Abstract

Application of deep convolutional spiking neural networks (SNNs) to artificial intelligence (AI) tasks has recently gained a lot of interest since SNNs are hardware-friendly and energy-efficient. Unlike the non-spiking counterparts, most of the existing SNN simulation frameworks are not practically efficient enough for large-scale AI tasks. In this paper, we introduce SpykeTorch, an open-source high-speed simulation framework based on PyTorch. This framework simulates convolutional SNNs with at most one spike per neuron and the rank-order encoding scheme. In terms of learning rules, both spike-timing-dependent plasticity (STDP) and reward-modulated STDP (R-STDP) are implemented, but other rules could be implemented easily. Apart from the aforementioned properties, SpykeTorch is highly generic and capable of reproducing the results of various studies. Computations in the proposed framework are tensor-based and totally done by PyTorch functions, which in turn brings the ability of just-in-time optimization for running on CPUs, GPUs, or Multi-GPU platforms.

摘要

深度卷积脉冲神经网络(SNN)在人工智能(AI)任务中的应用近来备受关注,因为SNN对硬件友好且节能。与非脉冲神经网络不同,现有的大多数SNN模拟框架在处理大规模AI任务时实际效率不够高。在本文中,我们介绍了SpykeTorch,一个基于PyTorch的开源高速模拟框架。该框架使用每个神经元最多一个脉冲和秩次编码方案来模拟卷积SNN。在学习规则方面,既实现了脉冲时间依赖可塑性(STDP),也实现了奖励调制STDP(R-STDP),但其他规则也能轻松实现。除了上述特性外,SpykeTorch具有高度通用性,能够重现各种研究的结果。所提出框架中的计算基于张量,完全由PyTorch函数完成,这反过来又带来了在CPU、GPU或多GPU平台上运行时即时优化的能力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4111/6640212/ff4b0efb1c13/fnins-13-00625-g0001.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验