Temasek Laboratories, 5A Engineering Drive 1, #09-02, Singapore 117411, Singapore.
School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore 639798, Singapore.
Neural Netw. 2017 Dec;96:33-46. doi: 10.1016/j.neunet.2017.08.010. Epub 2017 Sep 12.
Supervised learning algorithms in a spiking neural network either learn a spike-train pattern for a single neuron receiving input spike-train from multiple input synapses or learn to output the first spike time in a feedforward network setting. In this paper, we build upon spike-event based weight update strategy to learn continuous spike-train in a spiking neural network with a hidden layer using a dead zone on-off based adaptive learning rate rule which ensures convergence of the learning process in the sense of weight convergence and robustness of the learning process to external disturbances. Based on different benchmark problems, we compare this new method with other relevant spike-train learning algorithms. The results show that the speed of learning is much improved and the rate of successful learning is also greatly improved.
在尖峰神经网络中,监督学习算法要么学习单个神经元接收来自多个输入突触的输入尖峰序列的尖峰序列模式,要么学习在前馈网络设置中输出第一个尖峰时间。在本文中,我们基于基于尖峰事件的权重更新策略,使用基于死区开-关的自适应学习率规则在具有隐藏层的尖峰神经网络中学习连续尖峰序列,该规则确保了学习过程在权重收敛意义上的收敛和对外部干扰的学习过程的鲁棒性。基于不同的基准问题,我们将这种新方法与其他相关的尖峰序列学习算法进行了比较。结果表明,学习速度大大提高,成功学习的比率也大大提高。