Watfa Mohamed, Garcia-Ortiz Alberto, Sassatelli Gilles
LIRMM, University of Montpellier, CNRS, Montpellier, France.
ITEM, University of Bremen, Bremen, Germany.
Front Comput Neurosci. 2023 Mar 3;17:1114651. doi: 10.3389/fncom.2023.1114651. eCollection 2023.
Over the past decade a body of work has emerged and shown the disruptive potential of neuromorphic systems across a broad range of studies, often combining novel machine learning models and nanotechnologies. Still, the scope of investigations often remains limited to simple problems since the process of building, training, and evaluating mixed-signal neural models is slow and laborious. In this paper, we introduce an open-source framework, called EBANA, that provides a unified, modularized, and extensible infrastructure, similar to conventional machine learning pipelines, for building and validating analog neural networks (ANNs). It uses Python as interface language with a syntax similar to Keras, while hiding the complexity of the underlying analog simulations. It already includes the most common building blocks and maintains sufficient modularity and extensibility to easily incorporate new concepts, electrical, and technological models. These features make EBANA suitable for researchers and practitioners to experiment with different design topologies and explore the various tradeoffs that exist in the design space. We illustrate the framework capabilities by elaborating on the increasingly popular Energy-Based Models (EBMs), used in conjunction with the local Equilibrium Propagation (EP) training algorithm. Our experiments cover 3 datasets having up to 60,000 entries and explore network topologies generating circuits in excess of 1,000 electrical nodes that can be extensively benchmarked with ease and in reasonable time thanks to the native EBANA parallelization capability.
在过去十年中,一系列研究成果涌现出来,展示了神经形态系统在广泛研究中的颠覆性潜力,这些研究通常结合了新颖的机器学习模型和纳米技术。然而,由于构建、训练和评估混合信号神经模型的过程缓慢且费力,研究范围往往仍局限于简单问题。在本文中,我们介绍了一个名为EBANA的开源框架,它提供了一个统一、模块化且可扩展的基础设施,类似于传统机器学习管道,用于构建和验证模拟神经网络(ANN)。它使用Python作为接口语言,语法类似于Keras,同时隐藏了底层模拟的复杂性。它已经包含了最常见的构建模块,并保持了足够的模块化和可扩展性,以便轻松纳入新的概念、电气和技术模型。这些特性使EBANA适合研究人员和从业者试验不同的设计拓扑结构,并探索设计空间中存在的各种权衡。我们通过详细阐述越来越流行的基于能量的模型(EBM)来说明该框架的能力,该模型与局部平衡传播(EP)训练算法结合使用。我们的实验涵盖了3个数据集,每个数据集最多有60,000个条目,并探索了生成超过1000个电气节点电路的网络拓扑结构,由于EBANA的原生并行化能力,可以轻松且在合理时间内对其进行广泛的基准测试。