Xu Yan, Yang Jing, Zhong Shuiming
College of Information Science & Technology, Nanjing Agricultural University, Nanjing 210095, China.
School of Management, Beijing Normal University, Zhuhai Campus, Zhuhai 519087, China.
Neural Netw. 2017 Sep;93:7-20. doi: 10.1016/j.neunet.2017.04.010. Epub 2017 Apr 27.
The purpose of supervised learning with temporal encoding for spiking neurons is to make the neurons emit a specific spike train encoded by precise firing times of spikes. The gradient-descent-based (GDB) learning methods are widely used and verified in the current research. Although the existing GDB multi-spike learning (or spike sequence learning) methods have good performance, they work in an offline manner and still have some limitations. This paper proposes an online GDB spike sequence learning method for spiking neurons that is based on the online adjustment mechanism of real biological neuron synapses. The method constructs error function and calculates the adjustment of synaptic weights as soon as the neurons emit a spike during their running process. We analyze and synthesize desired and actual output spikes to select appropriate input spikes in the calculation of weight adjustment in this paper. The experimental results show that our method obviously improves learning performance compared with the offline learning manner and has certain advantage on learning accuracy compared with other learning methods. Stronger learning ability determines that the method has large pattern storage capacity.
用于脉冲神经元的带时间编码的监督学习的目的是使神经元发出由精确的脉冲发放时间编码的特定脉冲序列。基于梯度下降(GDB)的学习方法在当前研究中被广泛使用并得到验证。尽管现有的GDB多脉冲学习(或脉冲序列学习)方法具有良好的性能,但它们以离线方式工作,仍然存在一些局限性。本文提出了一种基于真实生物神经元突触在线调整机制的用于脉冲神经元的在线GDB脉冲序列学习方法。该方法在神经元运行过程中一旦发出脉冲就构建误差函数并计算突触权重的调整。在本文权重调整的计算中,我们分析并合成期望和实际输出脉冲以选择合适的输入脉冲。实验结果表明,与离线学习方式相比,我们的方法明显提高了学习性能,并且与其他学习方法相比在学习精度上具有一定优势。更强的学习能力决定了该方法具有较大的模式存储容量。