• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

多层物理神经网络中的神经形态过参数化与少样本学习

Neuromorphic overparameterisation and few-shot learning in multilayer physical neural networks.

作者信息

Stenning Kilian D, Gartside Jack C, Manneschi Luca, Cheung Christopher T S, Chen Tony, Vanstone Alex, Love Jake, Holder Holly, Caravelli Francesco, Kurebayashi Hidekazu, Everschor-Sitte Karin, Vasilaki Eleni, Branford Will R

机构信息

Blackett Laboratory, Imperial College London, London, SW7 2AZ, United Kingdom.

London Centre for Nanotechnology, Imperial College London, London, SW7 2AZ, United Kingdom.

出版信息

Nat Commun. 2024 Aug 27;15(1):7377. doi: 10.1038/s41467-024-50633-1.

DOI:10.1038/s41467-024-50633-1
PMID:39191747
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11350220/
Abstract

Physical neuromorphic computing, exploiting the complex dynamics of physical systems, has seen rapid advancements in sophistication and performance. Physical reservoir computing, a subset of neuromorphic computing, faces limitations due to its reliance on single systems. This constrains output dimensionality and dynamic range, limiting performance to a narrow range of tasks. Here, we engineer a suite of nanomagnetic array physical reservoirs and interconnect them in parallel and series to create a multilayer neural network architecture. The output of one reservoir is recorded, scaled and virtually fed as input to the next reservoir. This networked approach increases output dimensionality, internal dynamics and computational performance. We demonstrate that a physical neuromorphic system can achieve an overparameterised state, facilitating meta-learning on small training sets and yielding strong performance across a wide range of tasks. Our approach's efficacy is further demonstrated through few-shot learning, where the system rapidly adapts to new tasks.

摘要

利用物理系统复杂动力学的物理神经形态计算在复杂度和性能方面取得了快速进展。物理储层计算作为神经形态计算的一个子集,由于依赖单一系统而面临局限性。这限制了输出维度和动态范围,将性能限制在狭窄的任务范围内。在此,我们设计了一套纳米磁体阵列物理储层,并将它们并联和串联互连,以创建一个多层神经网络架构。一个储层的输出被记录、缩放并虚拟地作为输入馈送到下一个储层。这种网络化方法增加了输出维度、内部动力学和计算性能。我们证明,一个物理神经形态系统可以实现过参数化状态,便于在小训练集上进行元学习,并在广泛的任务中产生强大性能。我们方法的有效性通过少样本学习得到进一步证明,即系统能快速适应新任务。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/041370af8dc3/41467_2024_50633_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/a75f54c0047c/41467_2024_50633_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/8cfd036043f7/41467_2024_50633_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/f4e241244682/41467_2024_50633_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/cd74ce932bd0/41467_2024_50633_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/6f82bc828ae2/41467_2024_50633_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/c570bcb6f8b3/41467_2024_50633_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/041370af8dc3/41467_2024_50633_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/a75f54c0047c/41467_2024_50633_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/8cfd036043f7/41467_2024_50633_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/f4e241244682/41467_2024_50633_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/cd74ce932bd0/41467_2024_50633_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/6f82bc828ae2/41467_2024_50633_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/c570bcb6f8b3/41467_2024_50633_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b54e/11350220/041370af8dc3/41467_2024_50633_Fig7_HTML.jpg

相似文献

1
Neuromorphic overparameterisation and few-shot learning in multilayer physical neural networks.多层物理神经网络中的神经形态过参数化与少样本学习
Nat Commun. 2024 Aug 27;15(1):7377. doi: 10.1038/s41467-024-50633-1.
2
Experimental Demonstration of Reservoir Computing with Self-Assembled Percolating Networks of Nanoparticles.利用纳米粒子自组装渗流网络进行储层计算的实验演示。
Adv Mater. 2024 Jul;36(29):e2402319. doi: 10.1002/adma.202402319. Epub 2024 May 10.
3
Multilayer Reservoir Computing Based on Ferroelectric α-In Se for Hierarchical Information Processing.基于铁电α-In Se的多层储层计算用于分层信息处理
Adv Mater. 2022 Dec;34(48):e2108826. doi: 10.1002/adma.202108826. Epub 2022 Feb 17.
4
Brain-inspired global-local learning incorporated with neuromorphic computing.脑启发式全局-局部学习与神经形态计算相结合。
Nat Commun. 2022 Jan 10;13(1):65. doi: 10.1038/s41467-021-27653-2.
5
All-memristive neuromorphic computing with level-tuned neurons.基于可调谐神经元的全忆阻器神经形态计算。
Nanotechnology. 2016 Sep 2;27(35):355205. doi: 10.1088/0957-4484/27/35/355205. Epub 2016 Jul 26.
6
Recent advances in physical reservoir computing: A review.近期物理存储计算的进展:综述。
Neural Netw. 2019 Jul;115:100-123. doi: 10.1016/j.neunet.2019.03.005. Epub 2019 Mar 20.
7
Neural and Synaptic Array Transceiver: A Brain-Inspired Computing Framework for Embedded Learning.神经与突触阵列收发器:一种用于嵌入式学习的受大脑启发的计算框架。
Front Neurosci. 2018 Aug 29;12:583. doi: 10.3389/fnins.2018.00583. eCollection 2018.
8
Reservoir computing using networks of memristors: effects of topology and heterogeneity.基于忆阻器网络的储层计算:拓扑和非均匀性的影响。
Nanoscale. 2023 Jun 8;15(22):9663-9674. doi: 10.1039/d2nr07275k.
9
Polaritonic Neuromorphic Computing Outperforms Linear Classifiers.原句为英文,无译文。
Nano Lett. 2020 May 13;20(5):3506-3512. doi: 10.1021/acs.nanolett.0c00435. Epub 2020 Apr 14.
10
Neuromorphic Sentiment Analysis Using Spiking Neural Networks.基于尖峰神经网络的神经形态情绪分析。
Sensors (Basel). 2023 Sep 6;23(18):7701. doi: 10.3390/s23187701.

引用本文的文献

1
Exploring subthreshold processing for next-generation TinyAI.探索下一代微型人工智能的亚阈值处理。
Front Comput Neurosci. 2025 Jul 31;19:1638782. doi: 10.3389/fncom.2025.1638782. eCollection 2025.
2
Controllable gliders in a nanomagnetic metamaterial.纳米磁性超材料中的可控滑翔器。
Nat Commun. 2025 Aug 13;16(1):7500. doi: 10.1038/s41467-025-62515-1.
3
Ultrastrong magnon-magnon coupling and chiral spin-texture control in a dipolar 3D multilayered artificial spin-vortex ice.偶极三维多层人工自旋涡旋冰中的超强磁振子-磁振子耦合及手性自旋纹理控制

本文引用的文献

1
Powering AI at the edge: A robust, memristor-based binarized neural network with near-memory computing and miniaturized solar cell.边缘端的人工智能驱动:一种基于忆阻器的强大二值化神经网络,具备近内存计算和小型化太阳能电池。
Nat Commun. 2024 Jan 25;15(1):741. doi: 10.1038/s41467-024-44766-6.
2
Opportunities for neuromorphic computing algorithms and applications.神经形态计算算法与应用的机遇。
Nat Comput Sci. 2022 Jan;2(1):10-19. doi: 10.1038/s43588-021-00184-y. Epub 2022 Jan 31.
3
Multilayer spintronic neural networks with radiofrequency connections.
Nat Commun. 2024 May 14;15(1):4077. doi: 10.1038/s41467-024-48080-z.
具有射频连接的多层自旋电子神经网络。
Nat Nanotechnol. 2023 Nov;18(11):1273-1280. doi: 10.1038/s41565-023-01452-w. Epub 2023 Jul 27.
4
Distinguishing artificial spin ice states using magnetoresistance effect for neuromorphic computing.利用磁电阻效应区分人工自旋冰态用于神经形态计算。
Nat Commun. 2023 May 4;14(1):2562. doi: 10.1038/s41467-023-38286-y.
5
Reconfigurable training and reservoir computing in an artificial spin-vortex ice via spin-wave fingerprinting.基于自旋波指纹的人工自旋涡旋冰中的可重构训练和储层计算。
Nat Nanotechnol. 2022 May;17(5):460-469. doi: 10.1038/s41565-022-01091-7. Epub 2022 May 5.
6
Deep physical neural networks trained with backpropagation.基于反向传播算法训练的深度物理神经网络。
Nature. 2022 Jan;601(7894):549-555. doi: 10.1038/s41586-021-04223-6. Epub 2022 Jan 26.
7
Deep time-delay reservoir computing: Dynamics and memory capacity.深度时间延迟储层计算:动力学与存储容量。
Chaos. 2020 Sep;30(9):093124. doi: 10.1063/5.0017974.
8
Reconciling modern machine-learning practice and the classical bias-variance trade-off.调和现代机器学习实践与经典偏差-方差权衡。
Proc Natl Acad Sci U S A. 2019 Aug 6;116(32):15849-15854. doi: 10.1073/pnas.1903070116. Epub 2019 Jul 24.
9
Recent advances in physical reservoir computing: A review.近期物理存储计算的进展:综述。
Neural Netw. 2019 Jul;115:100-123. doi: 10.1016/j.neunet.2019.03.005. Epub 2019 Mar 20.
10
Design of deep echo state networks.深度回声状态网络设计。
Neural Netw. 2018 Dec;108:33-47. doi: 10.1016/j.neunet.2018.08.002. Epub 2018 Aug 8.