Suppr超能文献

GLSNN:一种基于全局反馈对齐和局部STDP可塑性的多层脉冲神经网络。

GLSNN: A Multi-Layer Spiking Neural Network Based on Global Feedback Alignment and Local STDP Plasticity.

作者信息

Zhao Dongcheng, Zeng Yi, Zhang Tielin, Shi Mengting, Zhao Feifei

机构信息

Research Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, China.

School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China.

出版信息

Front Comput Neurosci. 2020 Nov 12;14:576841. doi: 10.3389/fncom.2020.576841. eCollection 2020.

Abstract

Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation.

摘要

脉冲神经网络(SNNs)被认为是第三代人工神经网络,它与生物大脑中的信息处理更为紧密相关。然而,如何以脉冲的形式高效且稳健地训练非微分的SNN仍然是一个挑战。在此,我们从大脑中具有生物学合理性的结构和功能启发出发,给出一种训练SNN的替代方法。首先,受显著的自上而下结构连接的启发,设计了一种全局随机反馈对齐,以帮助SNN将误差目标直接从输出层传播到前几层。然后,受生物系统局部可塑性的启发,其中突触更多地由相邻神经元进行调节,使用差分STDP来优化局部可塑性。在基准MNIST(98.62%)和Fashion MNIST(89.05%)上的大量实验结果表明,所提出的算法与几种使用反向传播训练的先进SNN相比表现良好。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/52da/7689090/0f416397c2f0/fncom-14-576841-g0001.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验