Zhao Dongcheng, Zeng Yi, Zhang Tielin, Shi Mengting, Zhao Feifei
Research Center for Brain-Inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China.
Front Comput Neurosci. 2020 Nov 12;14:576841. doi: 10.3389/fncom.2020.576841. eCollection 2020.
Spiking Neural Networks (SNNs) are considered as the third generation of artificial neural networks, which are more closely with information processing in biological brains. However, it is still a challenge for how to train the non-differential SNN efficiently and robustly with the form of spikes. Here we give an alternative method to train SNNs by biologically-plausible structural and functional inspirations from the brain. Firstly, inspired by the significant top-down structural connections, a global random feedback alignment is designed to help the SNN propagate the error target from the output layer directly to the previous few layers. Then inspired by the local plasticity of the biological system in which the synapses are more tuned by the neighborhood neurons, a differential STDP is used to optimize local plasticity. Extensive experimental results on the benchmark MNIST (98.62%) and Fashion MNIST (89.05%) have shown that the proposed algorithm performs favorably against several state-of-the-art SNNs trained with backpropagation.
脉冲神经网络(SNNs)被认为是第三代人工神经网络,它与生物大脑中的信息处理更为紧密相关。然而,如何以脉冲的形式高效且稳健地训练非微分的SNN仍然是一个挑战。在此,我们从大脑中具有生物学合理性的结构和功能启发出发,给出一种训练SNN的替代方法。首先,受显著的自上而下结构连接的启发,设计了一种全局随机反馈对齐,以帮助SNN将误差目标直接从输出层传播到前几层。然后,受生物系统局部可塑性的启发,其中突触更多地由相邻神经元进行调节,使用差分STDP来优化局部可塑性。在基准MNIST(98.62%)和Fashion MNIST(89.05%)上的大量实验结果表明,所提出的算法与几种使用反向传播训练的先进SNN相比表现良好。