• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

行为时间尺度上的资格痕迹和可塑性:新海比尔三因素学习规则的实验支持。

Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules.

机构信息

School of Computer Science and School of Life Sciences, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.

出版信息

Front Neural Circuits. 2018 Jul 31;12:53. doi: 10.3389/fncir.2018.00053. eCollection 2018.

DOI:10.3389/fncir.2018.00053
PMID:30108488
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6079224/
Abstract

Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.

摘要

大多数基本行为,如移动手臂去抓取物体或走进下一个房间去探索博物馆,都发生在几秒钟的时间尺度上;相比之下,神经元动作电位发生在几毫秒的时间尺度上。因此,大脑的学习规则必须弥合这两个不同时间尺度之间的差距。现代突触可塑性理论假设,前突触和后突触神经元的共同激活在突触处设置一个标记,称为资格痕迹,只有在标记设置的同时存在另一个因素时,才会导致权重变化。这个第三个因素,信号奖励、惩罚、惊喜或新奇,可以通过神经调质的相位活动或特定神经元输入来实现,这些神经元输入用于标记特殊事件。虽然理论框架在过去几十年中得到了发展,但在过去几年中,仅在几秒钟的时间尺度上收集到了支持资格痕迹的实验证据。在这里,我们在三因素突触可塑性规则的背景下,回顾了四项关键实验,这些实验支持了突触资格痕迹与第三个因素相结合的作用,作为新赫比三因素学习规则的生物实现。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cb1b/6079224/062d5fa75415/fncir-12-00053-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cb1b/6079224/5a7b185279e7/fncir-12-00053-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cb1b/6079224/062d5fa75415/fncir-12-00053-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cb1b/6079224/5a7b185279e7/fncir-12-00053-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cb1b/6079224/062d5fa75415/fncir-12-00053-g0002.jpg

相似文献

1
Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules.行为时间尺度上的资格痕迹和可塑性:新海比尔三因素学习规则的实验支持。
Front Neural Circuits. 2018 Jul 31;12:53. doi: 10.3389/fncir.2018.00053. eCollection 2018.
2
Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules.神经调节的尖峰时间依赖性可塑性及三因素学习规则理论
Front Neural Circuits. 2016 Jan 19;9:85. doi: 10.3389/fncir.2015.00085. eCollection 2015.
3
General differential Hebbian learning: Capturing temporal relations between events in neural networks and the brain.一般微分Hebbian 学习:在神经网络和大脑中捕获事件之间的时间关系。
PLoS Comput Biol. 2018 Aug 28;14(8):e1006227. doi: 10.1371/journal.pcbi.1006227. eCollection 2018 Aug.
4
The Role of Multiple Neuromodulators in Reinforcement Learning That Is Based on Competition between Eligibility Traces.多种神经调质在基于资格迹竞争的强化学习中的作用。
Front Synaptic Neurosci. 2016 Dec 15;8:37. doi: 10.3389/fnsyn.2016.00037. eCollection 2016.
5
Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity.通过调节尖峰时间依赖性突触可塑性进行强化学习。
Neural Comput. 2007 Jun;19(6):1468-502. doi: 10.1162/neco.2007.19.6.1468.
6
Synaptic Plasticity Forms and Functions.突触可塑性的形式和功能。
Annu Rev Neurosci. 2020 Jul 8;43:95-117. doi: 10.1146/annurev-neuro-090919-022842. Epub 2020 Feb 19.
7
Mathematical properties of neuronal TD-rules and differential Hebbian learning: a comparison.神经元时间差分规则和微分赫布学习的数学性质:比较
Biol Cybern. 2008 Mar;98(3):259-72. doi: 10.1007/s00422-007-0209-6. Epub 2008 Jan 15.
8
A silent eligibility trace enables dopamine-dependent synaptic plasticity for reinforcement learning in the mouse striatum.沉默的资格痕迹使多巴胺依赖的突触可塑性能够在小鼠纹状体中进行强化学习。
Eur J Neurosci. 2019 Mar;49(5):726-736. doi: 10.1111/ejn.13921. Epub 2018 Apr 14.
9
Fast Learning with Weak Synaptic Plasticity.基于弱突触可塑性的快速学习
J Neurosci. 2015 Sep 30;35(39):13351-62. doi: 10.1523/JNEUROSCI.0607-15.2015.
10
Robustness of learning that is based on covariance-driven synaptic plasticity.基于协方差驱动突触可塑性的学习的稳健性。
PLoS Comput Biol. 2008 Mar 7;4(3):e1000007. doi: 10.1371/journal.pcbi.1000007.

引用本文的文献

1
Slow synaptic plasticity from the hippocampus underlies gradual mapping and fragmentation of novel spaces by grid cells.海马体的缓慢突触可塑性是网格细胞对新空间进行逐步映射和碎片化的基础。
bioRxiv. 2025 Jul 30:2025.07.30.667696. doi: 10.1101/2025.07.30.667696.
2
Global error signal guides local optimization in mismatch calculation.全局误差信号在失配计算中引导局部优化。
bioRxiv. 2025 Jul 10:2025.07.07.663505. doi: 10.1101/2025.07.07.663505.
3
Brain-like variational inference.类脑变分推理

本文引用的文献

1
A silent eligibility trace enables dopamine-dependent synaptic plasticity for reinforcement learning in the mouse striatum.沉默的资格痕迹使多巴胺依赖的突触可塑性能够在小鼠纹状体中进行强化学习。
Eur J Neurosci. 2019 Mar;49(5):726-736. doi: 10.1111/ejn.13921. Epub 2018 Apr 14.
2
Control of synaptic plasticity in deep cortical networks.深皮质网络中突触可塑性的控制。
Nat Rev Neurosci. 2018 Feb 16;19(3):166-180. doi: 10.1038/nrn.2018.6.
3
Multicontact Co-operativity in Spike-Timing-Dependent Structural Plasticity Stabilizes Networks.
ArXiv. 2025 May 16:arXiv:2410.19315v2.
4
Phase-Change Memory for In-Memory Computing.用于内存计算的相变存储器
Chem Rev. 2025 Jun 11;125(11):5163-5194. doi: 10.1021/acs.chemrev.4c00670. Epub 2025 May 22.
5
Evolutionary learning in neural networks by heterosynaptic plasticity.通过异突触可塑性实现神经网络中的进化学习。
iScience. 2025 Apr 3;28(5):112340. doi: 10.1016/j.isci.2025.112340. eCollection 2025 May 16.
6
A corticostriatal learning mechanism linking excess striatal dopamine and auditory hallucinations.一种将纹状体多巴胺过量与幻听相联系的皮质纹状体学习机制。
bioRxiv. 2025 Mar 18:2025.03.18.643990. doi: 10.1101/2025.03.18.643990.
7
A generalized mathematical framework for the calcium control hypothesis describes weight-dependent synaptic plasticity.钙控制假说的广义数学框架描述了依赖于权重的突触可塑性。
J Comput Neurosci. 2025 Mar 18. doi: 10.1007/s10827-025-00894-6.
8
Reward expectation and receipt differentially modulate the spiking of accumbens D1+ and D2+ neurons.奖励预期和奖励获得对伏隔核D1+和D2+神经元的放电有不同的调节作用。
Curr Biol. 2025 Mar 24;35(6):1285-1297.e3. doi: 10.1016/j.cub.2025.02.007. Epub 2025 Feb 27.
9
Noise Resilience of Successor and Predecessor Feature Algorithms in One- and Two-Dimensional Environments.一维和二维环境中后继与前驱特征算法的抗噪能力
Sensors (Basel). 2025 Feb 6;25(3):979. doi: 10.3390/s25030979.
10
Rapid learning with phase-change memory-based in-memory computing through learning-to-learn.通过学习学习实现基于相变存储器的内存计算的快速学习。
Nat Commun. 2025 Feb 1;16(1):1243. doi: 10.1038/s41467-025-56345-4.
多接触协同作用在依赖于尖峰时间的结构可塑性中稳定网络。
Cereb Cortex. 2018 Apr 1;28(4):1396-1415. doi: 10.1093/cercor/bhx339.
4
Towards deep learning with segregated dendrites.走向具有分离树突的深度学习。
Elife. 2017 Dec 5;6:e22901. doi: 10.7554/eLife.22901.
5
Balancing New against Old Information: The Role of Puzzlement Surprise in Learning.平衡新旧信息:困惑惊喜在学习中的作用。
Neural Comput. 2018 Jan;30(1):34-83. doi: 10.1162/neco_a_01025. Epub 2017 Oct 24.
6
Behavioral time scale synaptic plasticity underlies CA1 place fields.行为时间尺度的突触可塑性是CA1位置场的基础。
Science. 2017 Sep 8;357(6355):1033-1036. doi: 10.1126/science.aan3846.
7
Sequential neuromodulation of Hebbian plasticity offers mechanism for effective reward-based navigation.赫布可塑性的顺序神经调节为基于奖励的有效导航提供了机制。
Elife. 2017 Jul 10;6:e27756. doi: 10.7554/eLife.27756.
8
Glutamatergic synapses are structurally and biochemically complex because of multiple plasticity processes: long-term potentiation, long-term depression, short-term potentiation and scaling.由于多种可塑性过程,即长期增强、长期抑制、短期增强和缩放,谷氨酸能突触在结构和生物化学上都很复杂。
Philos Trans R Soc Lond B Biol Sci. 2017 Mar 5;372(1715). doi: 10.1098/rstb.2016.0260.
9
Opposite initialization to novel cues in dopamine signaling in ventral and posterior striatum in mice.小鼠腹侧和背侧纹状体中多巴胺信号对新线索的相反初始化。
Elife. 2017 Jan 5;6:e21886. doi: 10.7554/eLife.21886.
10
Human Inferences about Sequences: A Minimal Transition Probability Model.人类对序列的推理:一种最小转移概率模型。
PLoS Comput Biol. 2016 Dec 28;12(12):e1005260. doi: 10.1371/journal.pcbi.1005260. eCollection 2016 Dec.