• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

通过替代梯度脉冲神经网络探索语音感知过程中的神经振荡。

Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks.

作者信息

Bittar Alexandre, Garner Philip N

机构信息

Idiap Research Institute, Audio Inference, Martigny, Switzerland.

École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.

出版信息

Front Neurosci. 2024 Sep 25;18:1449181. doi: 10.3389/fnins.2024.1449181. eCollection 2024.

DOI:10.3389/fnins.2024.1449181
PMID:39385848
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11461475/
Abstract

Understanding cognitive processes in the brain demands sophisticated models capable of replicating neural dynamics at large scales. We present a physiologically inspired speech recognition architecture, compatible and scalable with deep learning frameworks, and demonstrate that end-to-end gradient descent training leads to the emergence of neural oscillations in the central spiking neural network. Significant cross-frequency couplings, indicative of these oscillations, are measured within and across network layers during speech processing, whereas no such interactions are observed when handling background noise inputs. Furthermore, our findings highlight the crucial inhibitory role of feedback mechanisms, such as spike frequency adaptation and recurrent connections, in regulating and synchronizing neural activity to improve recognition performance. Overall, on top of developing our understanding of synchronization phenomena notably observed in the human auditory pathway, our architecture exhibits dynamic and efficient information processing, with relevance to neuromorphic technology.

摘要

理解大脑中的认知过程需要能够在大规模上复制神经动力学的复杂模型。我们提出了一种受生理启发的语音识别架构,它与深度学习框架兼容且可扩展,并证明端到端梯度下降训练会导致中央脉冲神经网络中出现神经振荡。在语音处理过程中,在网络层内和跨网络层测量到了指示这些振荡的显著交叉频率耦合,而在处理背景噪声输入时未观察到此类相互作用。此外,我们的研究结果强调了反馈机制(如脉冲频率适应和递归连接)在调节和同步神经活动以提高识别性能方面的关键抑制作用。总体而言,除了增进我们对在人类听觉通路中显著观察到的同步现象的理解之外,我们的架构还展现出动态且高效的信息处理能力,与神经形态技术相关。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/a47093852f86/fnins-18-1449181-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/b6fe15fd866c/fnins-18-1449181-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/9618e16bdc2d/fnins-18-1449181-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/3e83bde51c2f/fnins-18-1449181-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/7eb5faf0f29f/fnins-18-1449181-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/594ac689f3d9/fnins-18-1449181-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/a47093852f86/fnins-18-1449181-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/b6fe15fd866c/fnins-18-1449181-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/9618e16bdc2d/fnins-18-1449181-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/3e83bde51c2f/fnins-18-1449181-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/7eb5faf0f29f/fnins-18-1449181-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/594ac689f3d9/fnins-18-1449181-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/774a/11461475/a47093852f86/fnins-18-1449181-g0006.jpg

相似文献

1
Exploring neural oscillations during speech perception via surrogate gradient spiking neural networks.通过替代梯度脉冲神经网络探索语音感知过程中的神经振荡。
Front Neurosci. 2024 Sep 25;18:1449181. doi: 10.3389/fnins.2024.1449181. eCollection 2024.
2
Surrogate gradients for analog neuromorphic computing.模拟神经形态计算的替代梯度。
Proc Natl Acad Sci U S A. 2022 Jan 25;119(4). doi: 10.1073/pnas.2109194119.
3
Auditory perception architecture with spiking neural network and implementation on FPGA.具有尖峰神经网络的听觉感知架构及其在 FPGA 上的实现。
Neural Netw. 2023 Aug;165:31-42. doi: 10.1016/j.neunet.2023.05.026. Epub 2023 May 23.
4
Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms.探索用于嵌入式平台上分类任务的优化尖峰神经网络架构。
Sensors (Basel). 2021 May 7;21(9):3240. doi: 10.3390/s21093240.
5
Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognition.用于大词汇量自动语音识别的深度脉冲神经网络。
Front Neurosci. 2020 Mar 17;14:199. doi: 10.3389/fnins.2020.00199. eCollection 2020.
6
Neuromorphic Sentiment Analysis Using Spiking Neural Networks.基于尖峰神经网络的神经形态情绪分析。
Sensors (Basel). 2023 Sep 6;23(18):7701. doi: 10.3390/s23187701.
7
Training Deep Spiking Convolutional Neural Networks With STDP-Based Unsupervised Pre-training Followed by Supervised Fine-Tuning.通过基于STDP的无监督预训练和监督微调来训练深度脉冲卷积神经网络
Front Neurosci. 2018 Aug 3;12:435. doi: 10.3389/fnins.2018.00435. eCollection 2018.
8
Co-learning synaptic delays, weights and adaptation in spiking neural networks.在脉冲神经网络中协同学习突触延迟、权重和适应性。
Front Neurosci. 2024 Apr 12;18:1360300. doi: 10.3389/fnins.2024.1360300. eCollection 2024.
9
A surrogate gradient spiking baseline for speech command recognition.用于语音命令识别的替代梯度脉冲基线
Front Neurosci. 2022 Aug 22;16:865897. doi: 10.3389/fnins.2022.865897. eCollection 2022.
10
The Remarkable Robustness of Surrogate Gradient Learning for Instilling Complex Function in Spiking Neural Networks.尖峰神经网络中复杂功能的代理梯度学习的显著稳健性。
Neural Comput. 2021 Mar 26;33(4):899-925. doi: 10.1162/neco_a_01367.

本文引用的文献

1
Co-learning synaptic delays, weights and adaptation in spiking neural networks.在脉冲神经网络中协同学习突触延迟、权重和适应性。
Front Neurosci. 2024 Apr 12;18:1360300. doi: 10.3389/fnins.2024.1360300. eCollection 2024.
2
Learnable axonal delay in spiking neural networks improves spoken word recognition.脉冲神经网络中可学习的轴突延迟改善了口语单词识别。
Front Neurosci. 2023 Nov 9;17:1275944. doi: 10.3389/fnins.2023.1275944. eCollection 2023.
3
Neurobiological mechanisms for language, symbols and concepts: Clues from brain-constrained deep neural networks.
神经生物学机制语言、符号和概念:来自受大脑约束的深度神经网络的线索。
Prog Neurobiol. 2023 Nov;230:102511. doi: 10.1016/j.pneurobio.2023.102511. Epub 2023 Jul 22.
4
A surrogate gradient spiking baseline for speech command recognition.用于语音命令识别的替代梯度脉冲基线
Front Neurosci. 2022 Aug 22;16:865897. doi: 10.3389/fnins.2022.865897. eCollection 2022.
5
Delta- and theta-band cortical tracking and phase-amplitude coupling to sung speech by infants.婴儿对 sung 语音的 delta 和 theta 波段皮质跟踪和相位-幅度耦合。
Neuroimage. 2022 Feb 15;247:118698. doi: 10.1016/j.neuroimage.2021.118698. Epub 2021 Nov 16.
6
Modelling concrete and abstract concepts using brain-constrained deep neural networks.使用受大脑约束的深度神经网络对具体和抽象概念进行建模。
Psychol Res. 2022 Nov;86(8):2533-2559. doi: 10.1007/s00426-021-01591-6.
7
Working Memory and Cross-Frequency Coupling of Neuronal Oscillations.工作记忆与神经元振荡的交叉频率耦合
Front Psychol. 2021 Oct 21;12:756661. doi: 10.3389/fpsyg.2021.756661. eCollection 2021.
8
Neural heterogeneity promotes robust learning.神经异质性促进了稳健的学习。
Nat Commun. 2021 Oct 4;12(1):5791. doi: 10.1038/s41467-021-26022-3.
9
Theta-phase dependent neuronal coding during sequence learning in human single neurons.人类单个神经元在序列学习中的θ相依赖性神经元编码。
Nat Commun. 2021 Aug 10;12(1):4839. doi: 10.1038/s41467-021-25150-0.
10
Spike frequency adaptation supports network computations on temporally dispersed information.棘波频率适应支持在时间上离散的信息上进行网络计算。
Elife. 2021 Jul 26;10:e65459. doi: 10.7554/eLife.65459.