• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用尖峰神经网络匹配序列学习中的回忆和存储。

Matching recall and storage in sequence learning with spiking neural networks.

机构信息

Department of Physiology, and Center for Cognition, Learning, and Memory, University of Bern, CH-3012 Bern, Switzerland.

出版信息

J Neurosci. 2013 Jun 5;33(23):9565-75. doi: 10.1523/JNEUROSCI.4098-12.2013.

DOI:10.1523/JNEUROSCI.4098-12.2013
PMID:23739954
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6619697/
Abstract

Storing and recalling spiking sequences is a general problem the brain needs to solve. It is, however, unclear what type of biologically plausible learning rule is suited to learn a wide class of spatiotemporal activity patterns in a robust way. Here we consider a recurrent network of stochastic spiking neurons composed of both visible and hidden neurons. We derive a generic learning rule that is matched to the neural dynamics by minimizing an upper bound on the Kullback-Leibler divergence from the target distribution to the model distribution. The derived learning rule is consistent with spike-timing dependent plasticity in that a presynaptic spike preceding a postsynaptic spike elicits potentiation while otherwise depression emerges. Furthermore, the learning rule for synapses that target visible neurons can be matched to the recently proposed voltage-triplet rule. The learning rule for synapses that target hidden neurons is modulated by a global factor, which shares properties with astrocytes and gives rise to testable predictions.

摘要

存储和回忆尖峰序列是大脑需要解决的一个普遍问题。然而,目前还不清楚哪种具有生物学合理性的学习规则适合以稳健的方式学习广泛的时空活动模式。在这里,我们考虑了一个由可见神经元和隐藏神经元组成的随机尖峰神经元的递归网络。我们通过最小化目标分布与模型分布之间的 Kullback-Leibler 散度的上限,推导出了一个与神经动力学相匹配的通用学习规则。推导出的学习规则与尖峰时间依赖可塑性一致,即前一个突触的尖峰在随后的突触的尖峰之前引发增强,否则会出现抑制。此外,针对可见神经元的突触的学习规则可以与最近提出的电压三联体规则相匹配。针对隐藏神经元的突触的学习规则由一个全局因素调制,该因素与星形胶质细胞具有相同的特性,并产生可测试的预测。

相似文献

1
Matching recall and storage in sequence learning with spiking neural networks.用尖峰神经网络匹配序列学习中的回忆和存储。
J Neurosci. 2013 Jun 5;33(23):9565-75. doi: 10.1523/JNEUROSCI.4098-12.2013.
2
Reinforcement Learning in Spiking Neural Networks with Stochastic and Deterministic Synapses.具有随机和确定性突触的尖峰神经网络中的强化学习。
Neural Comput. 2019 Dec;31(12):2368-2389. doi: 10.1162/neco_a_01238. Epub 2019 Oct 15.
3
Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity.通过调节尖峰时间依赖性突触可塑性进行强化学习。
Neural Comput. 2007 Jun;19(6):1468-502. doi: 10.1162/neco.2007.19.6.1468.
4
Stochastic variational learning in recurrent spiking networks.递归尖峰网络中的随机变分学习。
Front Comput Neurosci. 2014 Apr 4;8:38. doi: 10.3389/fncom.2014.00038. eCollection 2014.
5
Synaptic dynamics: linear model and adaptation algorithm.突触动力学:线性模型与自适应算法。
Neural Netw. 2014 Aug;56:49-68. doi: 10.1016/j.neunet.2014.04.001. Epub 2014 Apr 28.
6
Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning.监督学习中用于精确动作电位发放的最优时间依赖可塑性。
Neural Comput. 2006 Jun;18(6):1318-48. doi: 10.1162/neco.2006.18.6.1318.
7
Spatiotemporal learning in analog neural networks using spike-timing-dependent synaptic plasticity.利用依赖于脉冲时间的突触可塑性在模拟神经网络中进行时空学习。
Phys Rev E Stat Nonlin Soft Matter Phys. 2007 May;75(5 Pt 1):051917. doi: 10.1103/PhysRevE.75.051917. Epub 2007 May 29.
8
STDP provides the substrate for igniting synfire chains by spatiotemporal input patterns.突触时间依赖性可塑性通过时空输入模式为点燃同步放电链提供了基础。
Neural Comput. 2008 Feb;20(2):415-35. doi: 10.1162/neco.2007.11-05-043.
9
Synaptic balancing: A biologically plausible local learning rule that provably increases neural network noise robustness without sacrificing task performance.突触平衡:一种具有生物学合理性的局部学习规则,可在不牺牲任务性能的情况下显著提高神经网络的噪声鲁棒性。
PLoS Comput Biol. 2022 Sep 19;18(9):e1010418. doi: 10.1371/journal.pcbi.1010418. eCollection 2022 Sep.
10
A biologically plausible supervised learning method for spiking neural networks using the symmetric STDP rule.基于对称 STDP 规则的尖峰神经网络的生物合理有监督学习方法。
Neural Netw. 2020 Jan;121:387-395. doi: 10.1016/j.neunet.2019.09.007. Epub 2019 Sep 27.

引用本文的文献

1
Embedding stochastic dynamics of the environment in spontaneous activity by prediction-based plasticity.通过基于预测的可塑性将环境的随机动力学嵌入自发活动中。
Elife. 2025 Jun 11;13:RP95243. doi: 10.7554/eLife.95243.
2
Synapses learn to utilize stochastic pre-synaptic release for the prediction of postsynaptic dynamics.突触学会利用随机的前突触释放来预测后突触动力学。
PLoS Comput Biol. 2024 Nov 4;20(11):e1012531. doi: 10.1371/journal.pcbi.1012531. eCollection 2024 Nov.
3
Fast adaptation to rule switching using neuronal surprise.利用神经元惊讶实现快速规则切换适应。
PLoS Comput Biol. 2024 Feb 20;20(2):e1011839. doi: 10.1371/journal.pcbi.1011839. eCollection 2024 Feb.
4
Local minimization of prediction errors drives learning of invariant object representations in a generative network model of visual perception.预测误差的局部最小化驱动视觉感知生成网络模型中不变物体表征的学习。
Front Comput Neurosci. 2023 Sep 25;17:1207361. doi: 10.3389/fncom.2023.1207361. eCollection 2023.
5
Error-based or target-based? A unified framework for learning in recurrent spiking networks.基于错误的还是基于目标的?递归尖峰网络学习的统一框架。
PLoS Comput Biol. 2022 Jun 21;18(6):e1010221. doi: 10.1371/journal.pcbi.1010221. eCollection 2022 Jun.
6
Learning as filtering: Implications for spike-based plasticity.学习即滤波:对基于尖峰的可塑性的启示。
PLoS Comput Biol. 2022 Feb 23;18(2):e1009721. doi: 10.1371/journal.pcbi.1009721. eCollection 2022 Feb.
7
Self-healing codes: How stable neural populations can track continually reconfiguring neural representations.自修复代码:稳定的神经群体如何跟踪不断重新配置的神经表示。
Proc Natl Acad Sci U S A. 2022 Feb 15;119(7). doi: 10.1073/pnas.2106692119.
8
Canonical neural networks perform active inference.规范神经网络执行主动推理。
Commun Biol. 2022 Jan 14;5(1):55. doi: 10.1038/s42003-021-02994-2.
9
Brain-inspired global-local learning incorporated with neuromorphic computing.脑启发式全局-局部学习与神经形态计算相结合。
Nat Commun. 2022 Jan 10;13(1):65. doi: 10.1038/s41467-021-27653-2.
10
Mapping input noise to escape noise in integrate-and-fire neurons: a level-crossing approach.将输入噪声映射到整合-触发神经元中的逃逸噪声:一种穿越水平的方法。
Biol Cybern. 2021 Oct;115(5):539-562. doi: 10.1007/s00422-021-00899-1. Epub 2021 Oct 19.

本文引用的文献

1
Astrocyte signaling controls spike timing-dependent depression at neocortical synapses.星形胶质细胞信号控制新皮层突触的依赖于发放频率的突触抑制。
Nat Neurosci. 2012 Mar 25;15(5):746-53. doi: 10.1038/nn.3075.
2
Activity recall in a visual cortical ensemble.视觉皮层神经元集群中的活动记忆。
Nat Neurosci. 2012 Jan 22;15(3):449-55, S1-2. doi: 10.1038/nn.3036.
3
Local Ca2+ detection and modulation of synaptic release by astrocytes.星形胶质细胞对局部 Ca2+ 的检测及对突触释放的调制。
Nat Neurosci. 2011 Sep 11;14(10):1276-84. doi: 10.1038/nn.2929.
4
Internal representation of task rules by recurrent dynamics: the importance of the diversity of neural responses.递归动力学对任务规则的内部表示:神经反应多样性的重要性。
Front Comput Neurosci. 2010 Oct 4;4:24. doi: 10.3389/fncom.2010.00024. eCollection 2010.
5
Connectivity reflects coding: a model of voltage-based STDP with homeostasis.连接反映编码:具有内稳态的基于电压的 STDP 的模型。
Nat Neurosci. 2010 Mar;13(3):344-52. doi: 10.1038/nn.2479. Epub 2010 Jan 24.
6
Long-term potentiation depends on release of D-serine from astrocytes.长时程增强取决于星型胶质细胞中 D-丝氨酸的释放。
Nature. 2010 Jan 14;463(7278):232-6. doi: 10.1038/nature08673.
7
Supervised learning in spiking neural networks with ReSuMe: sequence learning, classification, and spike shifting.基于 ReSuMe 的尖峰神经网络监督学习:序列学习、分类和尖峰转移。
Neural Comput. 2010 Feb;22(2):467-510. doi: 10.1162/neco.2009.11-08-901.
8
Bayesian retrieval in associative memories with storage errors.存在存储错误的联想记忆中的贝叶斯检索
IEEE Trans Neural Netw. 1998;9(4):705-13. doi: 10.1109/72.701183.
9
Triplets of spikes in a model of spike timing-dependent plasticity.依赖于尖峰时间的可塑性模型中的尖峰三联体
J Neurosci. 2006 Sep 20;26(38):9673-82. doi: 10.1523/JNEUROSCI.1425-06.2006.
10
Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning.监督学习中用于精确动作电位发放的最优时间依赖可塑性。
Neural Comput. 2006 Jun;18(6):1318-48. doi: 10.1162/neco.2006.18.6.1318.