Suppr超能文献

一种基于梯度下降的用于脉冲神经元的在线监督学习方法。

An online supervised learning method based on gradient descent for spiking neurons.

作者信息

Xu Yan, Yang Jing, Zhong Shuiming

机构信息

College of Information Science & Technology, Nanjing Agricultural University, Nanjing 210095, China.

School of Management, Beijing Normal University, Zhuhai Campus, Zhuhai 519087, China.

出版信息

Neural Netw. 2017 Sep;93:7-20. doi: 10.1016/j.neunet.2017.04.010. Epub 2017 Apr 27.

Abstract

The purpose of supervised learning with temporal encoding for spiking neurons is to make the neurons emit a specific spike train encoded by precise firing times of spikes. The gradient-descent-based (GDB) learning methods are widely used and verified in the current research. Although the existing GDB multi-spike learning (or spike sequence learning) methods have good performance, they work in an offline manner and still have some limitations. This paper proposes an online GDB spike sequence learning method for spiking neurons that is based on the online adjustment mechanism of real biological neuron synapses. The method constructs error function and calculates the adjustment of synaptic weights as soon as the neurons emit a spike during their running process. We analyze and synthesize desired and actual output spikes to select appropriate input spikes in the calculation of weight adjustment in this paper. The experimental results show that our method obviously improves learning performance compared with the offline learning manner and has certain advantage on learning accuracy compared with other learning methods. Stronger learning ability determines that the method has large pattern storage capacity.

摘要

用于脉冲神经元的带时间编码的监督学习的目的是使神经元发出由精确的脉冲发放时间编码的特定脉冲序列。基于梯度下降(GDB)的学习方法在当前研究中被广泛使用并得到验证。尽管现有的GDB多脉冲学习(或脉冲序列学习)方法具有良好的性能,但它们以离线方式工作,仍然存在一些局限性。本文提出了一种基于真实生物神经元突触在线调整机制的用于脉冲神经元的在线GDB脉冲序列学习方法。该方法在神经元运行过程中一旦发出脉冲就构建误差函数并计算突触权重的调整。在本文权重调整的计算中,我们分析并合成期望和实际输出脉冲以选择合适的输入脉冲。实验结果表明,与离线学习方式相比,我们的方法明显提高了学习性能,并且与其他学习方法相比在学习精度上具有一定优势。更强的学习能力决定了该方法具有较大的模式存储容量。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验