Muliukov Artem R, Rodriguez Laurent, Miramond Benoit, Khacef Lyes, Schmidt Joachim, Berthet Quentin, Upegui Andres
Université Côte d'Azur, Laboratoire d'Electronique, Antennes et Télécommunications, CNRS, Biot, France.
Bio-Inspired Circuits and Systems Lab, Zernike Institute for Advanced Materials, Groningen Cognitive Systems and Materials Center, University of Groningen, Groningen, Netherlands.
Front Neurosci. 2022 Mar 2;16:825879. doi: 10.3389/fnins.2022.825879. eCollection 2022.
The field of artificial intelligence has significantly advanced over the past decades, inspired by discoveries from the fields of biology and neuroscience. The idea of this work is inspired by the process of self-organization of cortical areas in the human brain from both afferent and lateral/internal connections. In this work, we develop a brain-inspired neural model associating Self-Organizing Maps (SOM) and Hebbian learning in the Reentrant SOM (ReSOM) model. The framework is applied to multimodal classification problems. Compared to existing methods based on unsupervised learning with post-labeling, the model enhances the state-of-the-art results. This work also demonstrates the distributed and scalable nature of the model through both simulation results and hardware execution on a dedicated FPGA-based platform named SCALP (Self-configurable 3D Cellular Adaptive Platform). SCALP boards can be interconnected in a modular way to support the structure of the neural model. Such a unified software and hardware approach enables the processing to be scaled and allows information from several modalities to be merged dynamically. The deployment on hardware boards provides performance results of parallel execution on several devices, with the communication between each board through dedicated serial links. The proposed unified architecture, composed of the ReSOM model and the SCALP hardware platform, demonstrates a significant increase in accuracy thanks to multimodal association, and a good trade-off between latency and power consumption compared to a centralized GPU implementation.
在过去几十年中,受生物学和神经科学领域发现的启发,人工智能领域取得了显著进展。这项工作的灵感来自于人脑皮质区域从传入连接和横向/内部连接进行自组织的过程。在这项工作中,我们开发了一种受大脑启发的神经模型,将自组织映射(SOM)和折返自组织映射(ReSOM)模型中的赫布学习相结合。该框架应用于多模态分类问题。与现有的基于无监督学习和后标记的方法相比,该模型提升了当前的最优结果。这项工作还通过模拟结果以及在名为SCALP(自配置3D细胞自适应平台)的专用基于FPGA的平台上的硬件执行,展示了该模型的分布式和可扩展特性。SCALP板可以以模块化方式互连,以支持神经模型的结构。这种统一的软件和硬件方法使处理能够扩展,并允许动态合并来自多种模态的信息。在硬件板上的部署提供了在多个设备上并行执行的性能结果,每个板之间通过专用串行链路进行通信。所提出的由ReSOM模型和SCALP硬件平台组成的统一架构,由于多模态关联,显著提高了准确性,并且与集中式GPU实现相比,在延迟和功耗之间实现了良好的权衡。