Patiño-Saucedo Alberto, Rostro-González Horacio, Serrano-Gotarredona Teresa, Linares-Barranco Bernabé
Department of Electronics Engineering, University of Guanajuato, Salamanca, Mexico.
Instituto de Microelectrónica de Sevilla (IMSE-CNM), Consejo Superior de Investigaciones Científicas (CSIC) and Univ. de Sevilla, Seville, Spain.
Front Neurosci. 2022 Mar 14;16:819063. doi: 10.3389/fnins.2022.819063. eCollection 2022.
Liquid State Machines (LSMs) are computing reservoirs composed of recurrently connected Spiking Neural Networks which have attracted research interest for their modeling capacity of biological structures and as promising pattern recognition tools suitable for their implementation in neuromorphic processors, benefited from the modest use of computing resources in their training process. However, it has been difficult to optimize LSMs for solving complex tasks such as event-based computer vision and few implementations in large-scale neuromorphic processors have been attempted. In this work, we show that offline-trained LSMs implemented in the SpiNNaker neuromorphic processor are able to classify visual events, achieving state-of-the-art performance in the event-based N-MNIST dataset. The training of the readout layer is performed using a recent adaptation of back-propagation-through-time (BPTT) for SNNs, while the internal weights of the reservoir are kept static. Results show that mapping our LSM from a Deep Learning framework to SpiNNaker does not affect the performance of the classification task. Additionally, we show that weight quantization, which substantially reduces the memory footprint of the LSM, has a small impact on its performance.
液态机器(LSM)是由循环连接的脉冲神经网络组成的计算单元,因其对生物结构的建模能力以及作为适用于神经形态处理器实现的有前景的模式识别工具而吸引了研究兴趣,这得益于其在训练过程中对计算资源的适度使用。然而,优化LSM以解决诸如基于事件的计算机视觉等复杂任务一直很困难,并且在大规模神经形态处理器中的实现尝试很少。在这项工作中,我们表明在SpiNNaker神经形态处理器中实现的离线训练LSM能够对视觉事件进行分类,在基于事件的N-MNIST数据集中达到了当前的最佳性能。读出层的训练使用了最近针对脉冲神经网络的时间反向传播(BPTT)的一种改编方法,而计算单元的内部权重保持不变。结果表明,将我们的LSM从深度学习框架映射到SpiNNaker不会影响分类任务的性能。此外,我们表明权重量化虽然大幅减少了LSM的内存占用,但对其性能影响较小。