Suppr超能文献

一种基于新的递归最小二乘法的尖峰神经元学习算法。

A new recursive least squares-based learning algorithm for spiking neurons.

机构信息

Department of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, PR China.

Department of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, PR China.

出版信息

Neural Netw. 2021 Jun;138:110-125. doi: 10.1016/j.neunet.2021.01.016. Epub 2021 Feb 7.

Abstract

Spiking neural networks (SNNs) are regarded as effective models for processing spatio-temporal information. However, their inherent complexity of temporal coding makes it an arduous task to put forward an effective supervised learning algorithm, which still puzzles researchers in this area. In this paper, we propose a Recursive Least Squares-Based Learning Rule (RLSBLR) for SNN to generate the desired spatio-temporal spike train. During the learning process of our method, the weight update is driven by the cost function defined by the difference between the membrane potential and the firing threshold. The amount of weight modification depends not only on the impact of the current error function, but also on the previous error functions which are evaluated by current weights. In order to improve the learning performance, we integrate a modified synaptic delay learning to the proposed RLSBLR. We conduct experiments in different settings, such as spiking lengths, number of inputs, firing rates, noises and learning parameters, to thoroughly investigate the performance of this learning algorithm. The proposed RLSBLR is compared with competitive algorithms of Perceptron-Based Spiking Neuron Learning Rule (PBSNLR) and Remote Supervised Method (ReSuMe). Experimental results demonstrate that the proposed RLSBLR can achieve higher learning accuracy, higher efficiency and better robustness against different types of noise. In addition, we apply the proposed RLSBLR to open source database TIDIGITS, and the results show that our algorithm has a good practical application performance.

摘要

尖峰神经网络 (SNN) 被认为是处理时空信息的有效模型。然而,其时间编码的固有复杂性使得提出有效的监督学习算法成为一项艰巨的任务,这仍然困扰着该领域的研究人员。在本文中,我们提出了一种用于 SNN 的基于递归最小二乘的学习规则 (RLSBLR),以生成期望的时空尖峰序列。在我们方法的学习过程中,权重更新由膜电位与触发阈值之间的差值定义的代价函数驱动。权重修改的量不仅取决于当前误差函数的影响,还取决于当前权重评估的先前误差函数。为了提高学习性能,我们将修改后的突触延迟学习集成到所提出的 RLSBLR 中。我们在不同的设置下进行实验,例如尖峰长度、输入数量、发射率、噪声和学习参数,以彻底研究该学习算法的性能。将所提出的 RLSBLR 与基于感知器的尖峰神经元学习规则 (PBSNLR) 和远程监督方法 (ReSuMe) 的竞争算法进行了比较。实验结果表明,所提出的 RLSBLR 可以实现更高的学习精度、更高的效率和对不同类型噪声更好的鲁棒性。此外,我们将所提出的 RLSBLR 应用于开源数据库 TIDIGITS,结果表明我们的算法具有良好的实际应用性能。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验