• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

持续性和序列性活动的无监督学习

Unsupervised Learning of Persistent and Sequential Activity.

作者信息

Pereira Ulises, Brunel Nicolas

机构信息

Department of Statistics, The University of Chicago, Chicago, IL, United States.

Department of Neurobiology, The University of Chicago, Chicago, IL, United States.

出版信息

Front Comput Neurosci. 2020 Jan 17;13:97. doi: 10.3389/fncom.2019.00097. eCollection 2019.

DOI:10.3389/fncom.2019.00097
PMID:32009924
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6978734/
Abstract

Two strikingly distinct types of activity have been observed in various brain structures during delay periods of delayed response tasks: Persistent activity (PA), in which a sub-population of neurons maintains an elevated firing rate throughout an entire delay period; and Sequential activity (SA), in which sub-populations of neurons are activated sequentially in time. It has been hypothesized that both types of dynamics can be "learned" by the relevant networks from the statistics of their inputs, thanks to mechanisms of synaptic plasticity. However, the necessary conditions for a synaptic plasticity rule and input statistics to learn these two types of dynamics in a stable fashion are still unclear. In particular, it is unclear whether a single learning rule is able to learn both types of activity patterns, depending on the statistics of the inputs driving the network. Here, we first characterize the complete bifurcation diagram of a firing rate model of multiple excitatory populations with an inhibitory mechanism, as a function of the parameters characterizing its connectivity. We then investigate how an unsupervised temporally asymmetric Hebbian plasticity rule shapes the dynamics of the network. Consistent with previous studies, we find that for stable learning of PA and SA, an additional stabilization mechanism is necessary. We show that a generalized version of the standard multiplicative homeostatic plasticity (Renart et al., 2003; Toyoizumi et al., 2014) stabilizes learning by effectively excitatory connections during stimulation and those connections during retrieval. Using the bifurcation diagram derived for fixed connectivity, we study analytically the temporal evolution and the steady state of the learned recurrent architecture as a function of parameters characterizing the external inputs. Slow changing stimuli lead to PA, while fast changing stimuli lead to SA. Our network model shows how a network with plastic synapses can stably and flexibly learn PA and SA in an unsupervised manner.

摘要

在延迟反应任务的延迟期内,已在各种脑结构中观察到两种截然不同的活动类型:持续活动(PA),即神经元亚群在整个延迟期内维持升高的放电率;以及序列活动(SA),即神经元亚群在时间上依次被激活。据推测,由于突触可塑性机制,这两种动力学类型都可以被相关网络从其输入的统计信息中“学习”。然而,突触可塑性规则和输入统计信息以稳定方式学习这两种动力学类型的必要条件仍不清楚。特别是,尚不清楚单一学习规则是否能够根据驱动网络的输入统计信息来学习这两种活动模式。在此,我们首先将具有抑制机制的多个兴奋性群体的放电率模型的完整分岔图表征为其连接性特征参数的函数。然后,我们研究无监督的时间不对称赫布可塑性规则如何塑造网络的动力学。与先前的研究一致,我们发现为了稳定学习PA和SA,需要一种额外的稳定机制。我们表明,标准乘法稳态可塑性(Renart等人,2003年;Toyoizumi等人,2014年)的广义版本通过在刺激期间有效增强兴奋性连接以及在检索期间削弱那些连接来稳定学习。利用针对固定连接性导出的分岔图,我们分析研究了作为外部输入特征参数函数的学习到的循环架构的时间演化和稳态。缓慢变化的刺激导致PA,而快速变化的刺激导致SA。我们的网络模型展示了具有可塑性突触的网络如何以无监督方式稳定且灵活地学习PA和SA。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/78849feb04cb/fncom-13-00097-g0011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/889fe39b1e89/fncom-13-00097-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/0fb7898cbf19/fncom-13-00097-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/4d3972113974/fncom-13-00097-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/dadd364b5bee/fncom-13-00097-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/526785a67b7d/fncom-13-00097-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/accbb2297586/fncom-13-00097-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/2de8e364934d/fncom-13-00097-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/c6cd4f323258/fncom-13-00097-g0008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/9362aa529bee/fncom-13-00097-g0009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/60f33ffa3890/fncom-13-00097-g0010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/78849feb04cb/fncom-13-00097-g0011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/889fe39b1e89/fncom-13-00097-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/0fb7898cbf19/fncom-13-00097-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/4d3972113974/fncom-13-00097-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/dadd364b5bee/fncom-13-00097-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/526785a67b7d/fncom-13-00097-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/accbb2297586/fncom-13-00097-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/2de8e364934d/fncom-13-00097-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/c6cd4f323258/fncom-13-00097-g0008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/9362aa529bee/fncom-13-00097-g0009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/60f33ffa3890/fncom-13-00097-g0010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/712c/6978734/78849feb04cb/fncom-13-00097-g0011.jpg

相似文献

1
Unsupervised Learning of Persistent and Sequential Activity.持续性和序列性活动的无监督学习
Front Comput Neurosci. 2020 Jan 17;13:97. doi: 10.3389/fncom.2019.00097. eCollection 2019.
2
Characteristics of sequential activity in networks with temporally asymmetric Hebbian learning.具有时间不对称赫布学习的网络中的序列活动特征。
Proc Natl Acad Sci U S A. 2020 Nov 24;117(47):29948-29958. doi: 10.1073/pnas.1918674117. Epub 2020 Nov 11.
3
Partial Breakdown of Input Specificity of STDP at Individual Synapses Promotes New Learning.单个突触处STDP输入特异性的部分瓦解促进新的学习。
J Neurosci. 2016 Aug 24;36(34):8842-55. doi: 10.1523/JNEUROSCI.0552-16.2016.
4
Dynamic control of sequential retrieval speed in networks with heterogeneous learning rules.具有异质学习规则的网络中顺序检索速度的动态控制。
Elife. 2024 Aug 28;12:RP88805. doi: 10.7554/eLife.88805.
5
Hebbian learning of context in recurrent neural networks.循环神经网络中上下文的赫布学习
Neural Comput. 1996 Nov 15;8(8):1677-710. doi: 10.1162/neco.1996.8.8.1677.
6
Sparse coding with a somato-dendritic rule.具有树突规则的稀疏编码。
Neural Netw. 2020 Nov;131:37-49. doi: 10.1016/j.neunet.2020.06.007. Epub 2020 Jun 26.
7
Complementary Inhibitory Weight Profiles Emerge from Plasticity and Allow Flexible Switching of Receptive Fields.互补性抑制权重分布源于可塑性,并允许感受野的灵活切换。
J Neurosci. 2020 Dec 9;40(50):9634-9649. doi: 10.1523/JNEUROSCI.0276-20.2020. Epub 2020 Nov 9.
8
Unsupervised discrimination of patterns in spiking neural networks with excitatory and inhibitory synaptic plasticity.具有兴奋性和抑制性突触可塑性的脉冲神经网络中模式的无监督辨别
Front Comput Neurosci. 2014 Dec 15;8:159. doi: 10.3389/fncom.2014.00159. eCollection 2014.
9
Excitatory, inhibitory, and structural plasticity produce correlated connectivity in random networks trained to solve paired-stimulus tasks.兴奋、抑制和结构可塑性在被训练解决成对刺激任务的随机网络中产生相关的连接。
Front Comput Neurosci. 2011 Sep 12;5:37. doi: 10.3389/fncom.2011.00037. eCollection 2011.
10
Synaptic Plasticity in Cortical Inhibitory Neurons: What Mechanisms May Help to Balance Synaptic Weight Changes?皮质抑制性神经元中的突触可塑性:哪些机制可能有助于平衡突触权重变化?
Front Cell Neurosci. 2020 Sep 4;14:204. doi: 10.3389/fncel.2020.00204. eCollection 2020.

引用本文的文献

1
Discovering plasticity rules that organize and maintain neural circuits.发现组织和维持神经回路的可塑性规则。
bioRxiv. 2024 Nov 18:2024.11.18.623688. doi: 10.1101/2024.11.18.623688.
2
Dynamic control of sequential retrieval speed in networks with heterogeneous learning rules.具有异质学习规则的网络中顺序检索速度的动态控制。
Elife. 2024 Aug 28;12:RP88805. doi: 10.7554/eLife.88805.
3
Recall tempo of Hebbian sequences depends on the interplay of Hebbian kernel with tutor signal timing.赫布序列的回忆速度取决于赫布核与导师信号定时的相互作用。

本文引用的文献

1
Discrete attractor dynamics underlies persistent activity in the frontal cortex.离散吸引子动力学是额叶皮层持续活动的基础。
Nature. 2019 Feb;566(7743):212-217. doi: 10.1038/s41586-019-0919-7. Epub 2019 Feb 6.
2
Theta-modulation drives the emergence of connectivity patterns underlying replay in a network model of place cells.Theta 调制驱动了位置细胞网络模型中重放背后连通模式的出现。
Elife. 2018 Oct 25;7:e37388. doi: 10.7554/eLife.37388.
3
Attractor Dynamics in Networks with Learning Rules Inferred from In Vivo Data.从活体数据中推断出学习规则的网络中的吸引子动力学。
Proc Natl Acad Sci U S A. 2024 Aug 6;121(32):e2309876121. doi: 10.1073/pnas.2309876121. Epub 2024 Jul 30.
4
Anti-Hebbian plasticity drives sequence learning in striatum.抗赫布可塑性驱动纹状体中的序列学习。
Commun Biol. 2024 May 9;7(1):555. doi: 10.1038/s42003-024-06203-8.
5
Optogenetic manipulation of inhibitory interneurons can be used to validate a model of spatiotemporal sequence learning.抑制性中间神经元的光遗传学操纵可用于验证时空序列学习模型。
Front Comput Neurosci. 2023 Jun 9;17:1198128. doi: 10.3389/fncom.2023.1198128. eCollection 2023.
6
Mesoscopic description of hippocampal replay and metastability in spiking neural networks with short-term plasticity.具有短期可塑性的尖峰神经网络中海马体重放和亚稳性的介观描述。
PLoS Comput Biol. 2022 Dec 22;18(12):e1010809. doi: 10.1371/journal.pcbi.1010809. eCollection 2022 Dec.
7
Dynamic branching in a neural network model for probabilistic prediction of sequences.神经网络模型中的动态分支用于序列概率预测。
J Comput Neurosci. 2022 Nov;50(4):537-557. doi: 10.1007/s10827-022-00830-y. Epub 2022 Aug 10.
8
Leveraging Continuous Vital Sign Measurements for Real-Time Assessment of Autonomic Nervous System Dysfunction After Brain Injury: A Narrative Review of Current and Future Applications.利用连续生命体征测量实时评估脑损伤后自主神经系统功能障碍:当前和未来应用的叙述性综述。
Neurocrit Care. 2022 Aug;37(Suppl 2):206-219. doi: 10.1007/s12028-022-01491-6. Epub 2022 Apr 12.
9
Thunderstruck: The ACDC model of flexible sequences and rhythms in recurrent neural circuits.震撼:在递归神经网络电路中灵活序列和节律的 ACDC 模型。
PLoS Comput Biol. 2022 Feb 2;18(2):e1009854. doi: 10.1371/journal.pcbi.1009854. eCollection 2022 Feb.
10
Metastable attractors explain the variable timing of stable behavioral action sequences.亚稳态吸引子解释了稳定行为动作序列的时变。
Neuron. 2022 Jan 5;110(1):139-153.e9. doi: 10.1016/j.neuron.2021.10.011. Epub 2021 Oct 29.
Neuron. 2018 Jul 11;99(1):227-238.e4. doi: 10.1016/j.neuron.2018.05.038. Epub 2018 Jun 14.
4
Behavioral time scale synaptic plasticity underlies CA1 place fields.行为时间尺度的突触可塑性是CA1位置场的基础。
Science. 2017 Sep 8;357(6355):1033-1036. doi: 10.1126/science.aan3846.
5
Learning multiple variable-speed sequences in striatum via cortical tutoring.通过皮层辅导在纹状体中学习多个变速序列。
Elife. 2017 May 8;6:e26084. doi: 10.7554/eLife.26084.
6
Ring attractor dynamics in the central brain.中脑的环吸引子动力学。
Science. 2017 May 26;356(6340):849-853. doi: 10.1126/science.aal4835. Epub 2017 May 4.
7
The temporal paradox of Hebbian learning and homeostatic plasticity.赫布学习和动态平衡可塑性的时间悖论。
Curr Opin Neurobiol. 2017 Apr;43:166-176. doi: 10.1016/j.conb.2017.03.015. Epub 2017 Apr 18.
8
Memory replay in balanced recurrent networks.平衡循环网络中的记忆重放
PLoS Comput Biol. 2017 Jan 30;13(1):e1005359. doi: 10.1371/journal.pcbi.1005359. eCollection 2017 Jan.
9
Hebbian plasticity requires compensatory processes on multiple timescales.赫布可塑性需要在多个时间尺度上进行补偿过程。
Philos Trans R Soc Lond B Biol Sci. 2017 Mar 5;372(1715). doi: 10.1098/rstb.2016.0259.
10
The dialectic of Hebb and homeostasis.赫布理论与内稳态的辩证关系。
Philos Trans R Soc Lond B Biol Sci. 2017 Mar 5;372(1715). doi: 10.1098/rstb.2016.0258.