• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于能量的模拟神经网络框架。

Energy-based analog neural network framework.

作者信息

Watfa Mohamed, Garcia-Ortiz Alberto, Sassatelli Gilles

机构信息

LIRMM, University of Montpellier, CNRS, Montpellier, France.

ITEM, University of Bremen, Bremen, Germany.

出版信息

Front Comput Neurosci. 2023 Mar 3;17:1114651. doi: 10.3389/fncom.2023.1114651. eCollection 2023.

DOI:10.3389/fncom.2023.1114651
PMID:36936192
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10020340/
Abstract

Over the past decade a body of work has emerged and shown the disruptive potential of neuromorphic systems across a broad range of studies, often combining novel machine learning models and nanotechnologies. Still, the scope of investigations often remains limited to simple problems since the process of building, training, and evaluating mixed-signal neural models is slow and laborious. In this paper, we introduce an open-source framework, called EBANA, that provides a unified, modularized, and extensible infrastructure, similar to conventional machine learning pipelines, for building and validating analog neural networks (ANNs). It uses Python as interface language with a syntax similar to Keras, while hiding the complexity of the underlying analog simulations. It already includes the most common building blocks and maintains sufficient modularity and extensibility to easily incorporate new concepts, electrical, and technological models. These features make EBANA suitable for researchers and practitioners to experiment with different design topologies and explore the various tradeoffs that exist in the design space. We illustrate the framework capabilities by elaborating on the increasingly popular Energy-Based Models (EBMs), used in conjunction with the local Equilibrium Propagation (EP) training algorithm. Our experiments cover 3 datasets having up to 60,000 entries and explore network topologies generating circuits in excess of 1,000 electrical nodes that can be extensively benchmarked with ease and in reasonable time thanks to the native EBANA parallelization capability.

摘要

在过去十年中,一系列研究成果涌现出来,展示了神经形态系统在广泛研究中的颠覆性潜力,这些研究通常结合了新颖的机器学习模型和纳米技术。然而,由于构建、训练和评估混合信号神经模型的过程缓慢且费力,研究范围往往仍局限于简单问题。在本文中,我们介绍了一个名为EBANA的开源框架,它提供了一个统一、模块化且可扩展的基础设施,类似于传统机器学习管道,用于构建和验证模拟神经网络(ANN)。它使用Python作为接口语言,语法类似于Keras,同时隐藏了底层模拟的复杂性。它已经包含了最常见的构建模块,并保持了足够的模块化和可扩展性,以便轻松纳入新的概念、电气和技术模型。这些特性使EBANA适合研究人员和从业者试验不同的设计拓扑结构,并探索设计空间中存在的各种权衡。我们通过详细阐述越来越流行的基于能量的模型(EBM)来说明该框架的能力,该模型与局部平衡传播(EP)训练算法结合使用。我们的实验涵盖了3个数据集,每个数据集最多有60,000个条目,并探索了生成超过1000个电气节点电路的网络拓扑结构,由于EBANA的原生并行化能力,可以轻松且在合理时间内对其进行广泛的基准测试。

相似文献

1
Energy-based analog neural network framework.基于能量的模拟神经网络框架。
Front Comput Neurosci. 2023 Mar 3;17:1114651. doi: 10.3389/fncom.2023.1114651. eCollection 2023.
2
Nengo and Low-Power AI Hardware for Robust, Embedded Neurorobotics.用于稳健嵌入式神经机器人技术的Nengo与低功耗人工智能硬件。
Front Neurorobot. 2020 Oct 9;14:568359. doi: 10.3389/fnbot.2020.568359. eCollection 2020.
3
Macromolecular crowding: chemistry and physics meet biology (Ascona, Switzerland, 10-14 June 2012).大分子拥挤现象:化学与物理邂逅生物学(瑞士阿斯科纳,2012年6月10日至14日)
Phys Biol. 2013 Aug;10(4):040301. doi: 10.1088/1478-3975/10/4/040301. Epub 2013 Aug 2.
4
Configurable analog-digital conversion using the neural engineering framework.使用神经工程框架实现可配置的模拟-数字转换。
Front Neurosci. 2014 Jul 22;8:201. doi: 10.3389/fnins.2014.00201. eCollection 2014.
5
Rethinking the performance comparison between SNNS and ANNS.重新思考 SNNS 和 ANNS 的性能比较。
Neural Netw. 2020 Jan;121:294-307. doi: 10.1016/j.neunet.2019.09.005. Epub 2019 Sep 19.
6
Memristors for Neuromorphic Circuits and Artificial Intelligence Applications.用于神经形态电路和人工智能应用的忆阻器
Materials (Basel). 2020 Feb 20;13(4):938. doi: 10.3390/ma13040938.
7
Comparing SNNs and RNNs on neuromorphic vision datasets: Similarities and differences.在神经形态视觉数据集上比较 SNNs 和 RNNs:相似性和差异。
Neural Netw. 2020 Dec;132:108-120. doi: 10.1016/j.neunet.2020.08.001. Epub 2020 Aug 17.
8
Equilibrium Propagation for Memristor-Based Recurrent Neural Networks.基于忆阻器的递归神经网络的平衡传播
Front Neurosci. 2020 Mar 24;14:240. doi: 10.3389/fnins.2020.00240. eCollection 2020.
9
i-PI 3.0: A flexible and efficient framework for advanced atomistic simulations.i-PI 3.0:用于高级原子模拟的灵活高效框架。
J Chem Phys. 2024 Aug 14;161(6). doi: 10.1063/5.0215869.
10
PiNN: A Python Library for Building Atomic Neural Networks of Molecules and Materials.PiNN:一个用于构建分子和材料原子神经网络的 Python 库。
J Chem Inf Model. 2020 Mar 23;60(3):1184-1193. doi: 10.1021/acs.jcim.9b00994. Epub 2020 Jan 29.

引用本文的文献

1
Defect-Tolerant Memristor Crossbar Circuits for Local Learning Neural Networks.用于局部学习神经网络的容错忆阻器交叉开关电路
Nanomaterials (Basel). 2025 Jan 28;15(3):213. doi: 10.3390/nano15030213.

本文引用的文献

1
EqSpike: spike-driven equilibrium propagation for neuromorphic implementations.EqSpike:用于神经形态实现的脉冲驱动平衡传播
iScience. 2021 Feb 20;24(3):102222. doi: 10.1016/j.isci.2021.102222. eCollection 2021 Mar 19.
2
Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing Its Gradient Estimator Bias.通过大幅降低梯度估计偏差将平衡传播扩展到深度卷积神经网络
Front Neurosci. 2021 Feb 18;15:633674. doi: 10.3389/fnins.2021.633674. eCollection 2021.
3
Equilibrium Propagation for Memristor-Based Recurrent Neural Networks.
基于忆阻器的递归神经网络的平衡传播
Front Neurosci. 2020 Mar 24;14:240. doi: 10.3389/fnins.2020.00240. eCollection 2020.
4
Training LSTM Networks With Resistive Cross-Point Devices.使用电阻式交叉点器件训练长短期记忆网络
Front Neurosci. 2018 Oct 24;12:745. doi: 10.3389/fnins.2018.00745. eCollection 2018.
5
Equilibrium Propagation: Bridging the Gap between Energy-Based Models and Backpropagation.平衡传播:弥合基于能量模型与反向传播之间的差距
Front Comput Neurosci. 2017 May 4;11:24. doi: 10.3389/fncom.2017.00024. eCollection 2017.
6
Acceleration of Deep Neural Network Training with Resistive Cross-Point Devices: Design Considerations.利用电阻式交叉点器件加速深度神经网络训练:设计考量
Front Neurosci. 2016 Jul 21;10:333. doi: 10.3389/fnins.2016.00333. eCollection 2016.