Suppr超能文献

一种基于梯度下降的用于脉冲神经元的在线监督学习方法。

An online supervised learning method based on gradient descent for spiking neurons.

作者信息

Xu Yan, Yang Jing, Zhong Shuiming

机构信息

College of Information Science & Technology, Nanjing Agricultural University, Nanjing 210095, China.

School of Management, Beijing Normal University, Zhuhai Campus, Zhuhai 519087, China.

出版信息

Neural Netw. 2017 Sep;93:7-20. doi: 10.1016/j.neunet.2017.04.010. Epub 2017 Apr 27.

Abstract

The purpose of supervised learning with temporal encoding for spiking neurons is to make the neurons emit a specific spike train encoded by precise firing times of spikes. The gradient-descent-based (GDB) learning methods are widely used and verified in the current research. Although the existing GDB multi-spike learning (or spike sequence learning) methods have good performance, they work in an offline manner and still have some limitations. This paper proposes an online GDB spike sequence learning method for spiking neurons that is based on the online adjustment mechanism of real biological neuron synapses. The method constructs error function and calculates the adjustment of synaptic weights as soon as the neurons emit a spike during their running process. We analyze and synthesize desired and actual output spikes to select appropriate input spikes in the calculation of weight adjustment in this paper. The experimental results show that our method obviously improves learning performance compared with the offline learning manner and has certain advantage on learning accuracy compared with other learning methods. Stronger learning ability determines that the method has large pattern storage capacity.

摘要

用于脉冲神经元的带时间编码的监督学习的目的是使神经元发出由精确的脉冲发放时间编码的特定脉冲序列。基于梯度下降(GDB)的学习方法在当前研究中被广泛使用并得到验证。尽管现有的GDB多脉冲学习(或脉冲序列学习)方法具有良好的性能,但它们以离线方式工作,仍然存在一些局限性。本文提出了一种基于真实生物神经元突触在线调整机制的用于脉冲神经元的在线GDB脉冲序列学习方法。该方法在神经元运行过程中一旦发出脉冲就构建误差函数并计算突触权重的调整。在本文权重调整的计算中,我们分析并合成期望和实际输出脉冲以选择合适的输入脉冲。实验结果表明,与离线学习方式相比,我们的方法明显提高了学习性能,并且与其他学习方法相比在学习精度上具有一定优势。更强的学习能力决定了该方法具有较大的模式存储容量。

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验