• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

修剪递归神经网络复制了工作记忆和强化学习中的青少年变化。

Pruning recurrent neural networks replicates adolescent changes in working memory and reinforcement learning.

机构信息

Laboratory of Neuropsychology, National Institute of Mental Health, NIH, Bethesda, MD 20892-4415.

出版信息

Proc Natl Acad Sci U S A. 2022 May 31;119(22):e2121331119. doi: 10.1073/pnas.2121331119. Epub 2022 May 27.

DOI:10.1073/pnas.2121331119
PMID:35622896
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9295803/
Abstract

Adolescent development is characterized by an improvement in multiple cognitive processes. While performance on cognitive operations improves during this period, the ability to learn new skills quickly, for example, a new language, decreases. During this time, there is substantial pruning of excitatory synapses in cortex and specifically in prefrontal cortex. We have trained a series of recurrent neural networks to solve a working memory task and a reinforcement learning (RL) task. Performance on both of these tasks is known to improve during adolescence. After training, we pruned the networks by removing weak synapses. Pruning was done incrementally, and the networks were retrained during pruning. We found that pruned networks trained on the working memory task were more resistant to distraction. The pruned RL networks were able to produce more accurate value estimates and also make optimal choices more consistently. Both results are consistent with developmental improvements on these tasks. Pruned networks, however, learned some, but not all, new problems more slowly. Thus, improvements in task performance can come at the cost of flexibility. Our results show that overproduction and subsequent pruning of synapses is a computationally advantageous approach to building a competent brain.

摘要

青少年的发展特点是多种认知过程的改善。在此期间,认知操作的表现有所提高,例如,快速学习新技能的能力,例如,一种新的语言,会下降。在此期间,皮质和特别是前额皮质中的兴奋性突触大量修剪。我们已经训练了一系列递归神经网络来解决工作记忆任务和强化学习 (RL) 任务。已知这两个任务的表现都在青少年时期有所提高。训练后,我们通过去除弱突触来修剪网络。修剪是逐步进行的,并且在修剪过程中对网络进行重新训练。我们发现,经过工作记忆任务训练的修剪网络更能抵抗干扰。修剪后的 RL 网络能够更准确地估计价值,并且更一致地做出最佳选择。这两个结果都与这些任务的发展改善一致。然而,修剪后的网络学习一些但不是所有的新问题都更慢。因此,任务表现的提高可能是以灵活性为代价的。我们的结果表明,突触的过度产生和随后的修剪是构建一个有能力的大脑的计算上有利的方法。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/327ddc4f782d/pnas.2121331119fig07.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/e0a7f7af20be/pnas.2121331119fig01.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/5ff5aa27f13c/pnas.2121331119fig02.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/addfdf7fd14b/pnas.2121331119fig03.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/78e2af2bf441/pnas.2121331119fig04.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/cc1f7b21b1eb/pnas.2121331119fig05.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/8a55dc66e6bd/pnas.2121331119fig06.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/327ddc4f782d/pnas.2121331119fig07.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/e0a7f7af20be/pnas.2121331119fig01.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/5ff5aa27f13c/pnas.2121331119fig02.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/addfdf7fd14b/pnas.2121331119fig03.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/78e2af2bf441/pnas.2121331119fig04.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/cc1f7b21b1eb/pnas.2121331119fig05.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/8a55dc66e6bd/pnas.2121331119fig06.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/92d1/9295803/327ddc4f782d/pnas.2121331119fig07.jpg

相似文献

1
Pruning recurrent neural networks replicates adolescent changes in working memory and reinforcement learning.修剪递归神经网络复制了工作记忆和强化学习中的青少年变化。
Proc Natl Acad Sci U S A. 2022 May 31;119(22):e2121331119. doi: 10.1073/pnas.2121331119. Epub 2022 May 27.
2
Recurrent neural networks that learn multi-step visual routines with reinforcement learning.基于强化学习的循环神经网络,可用于学习多步骤视觉常规。
PLoS Comput Biol. 2024 Apr 29;20(4):e1012030. doi: 10.1371/journal.pcbi.1012030. eCollection 2024 Apr.
3
Developmental pruning of excitatory synaptic inputs to parvalbumin interneurons in monkey prefrontal cortex.猴前额叶皮质中小清蛋白中间神经元兴奋性突触输入的发育性修剪
Proc Natl Acad Sci U S A. 2017 Jan 24;114(4):E629-E637. doi: 10.1073/pnas.1610077114. Epub 2017 Jan 10.
4
Online Learning and Memory of Neural Trajectory Replays for Prefrontal Persistent and Dynamic Representations in the Irregular Asynchronous State.不规则异步状态下前额叶持续和动态表征的神经轨迹回放的在线学习与记忆
Front Neural Circuits. 2021 Jul 8;15:648538. doi: 10.3389/fncir.2021.648538. eCollection 2021.
5
Reinforcement Learning in Spiking Neural Networks with Stochastic and Deterministic Synapses.具有随机和确定性突触的尖峰神经网络中的强化学习。
Neural Comput. 2019 Dec;31(12):2368-2389. doi: 10.1162/neco_a_01238. Epub 2019 Oct 15.
6
The information theory of developmental pruning: Optimizing global network architectures using local synaptic rules.发育修剪的信息理论:使用局部突触规则优化全局网络结构。
PLoS Comput Biol. 2021 Oct 11;17(10):e1009458. doi: 10.1371/journal.pcbi.1009458. eCollection 2021 Oct.
7
A working memory model based on fast Hebbian learning.基于快速赫布学习的工作记忆模型。
Network. 2003 Nov;14(4):789-802.
8
Overcoming Long-Term Catastrophic Forgetting Through Adversarial Neural Pruning and Synaptic Consolidation.通过对抗性神经修剪和突触巩固来克服长期灾难性遗忘。
IEEE Trans Neural Netw Learn Syst. 2022 Sep;33(9):4243-4256. doi: 10.1109/TNNLS.2021.3056201. Epub 2022 Aug 31.
9
Flexible Working Memory Through Selective Gating and Attentional Tagging.通过选择性门控和注意力标记实现灵活的工作记忆。
Neural Comput. 2021 Jan;33(1):1-40. doi: 10.1162/neco_a_01339. Epub 2020 Oct 20.
10
Distentangling the systems contributing to changes in learning during adolescence.厘清导致青少年学习变化的系统。
Dev Cogn Neurosci. 2020 Feb;41:100732. doi: 10.1016/j.dcn.2019.100732. Epub 2019 Nov 14.

引用本文的文献

1
More than just a phase: adolescence as a window into how the brain generates behavior.不仅仅是一个阶段:青春期是洞察大脑如何产生行为的窗口。
Curr Dir Psychol Sci. 2025 Jun;34(3):149-156. doi: 10.1177/09637214251313733. Epub 2025 Feb 24.
2
Developmental decorrelation of local cortical activity through adolescence supports high-dimensional encoding and working memory.在青少年时期,局部皮质活动的发育去相关支持高维编码和工作记忆。
Dev Cogn Neurosci. 2025 Mar 4;73:101541. doi: 10.1016/j.dcn.2025.101541.
3
The connecting brain in context: How adolescent plasticity supports learning and development.

本文引用的文献

1
Self-tuition as an essential design feature of the brain.自学是大脑的一个基本设计特征。
Philos Trans R Soc Lond B Biol Sci. 2022 Feb 14;377(1844):20200530. doi: 10.1098/rstb.2020.0530. Epub 2021 Dec 27.
2
The information theory of developmental pruning: Optimizing global network architectures using local synaptic rules.发育修剪的信息理论:使用局部突触规则优化全局网络结构。
PLoS Comput Biol. 2021 Oct 11;17(10):e1009458. doi: 10.1371/journal.pcbi.1009458. eCollection 2021 Oct.
3
Mechanisms governing activity-dependent synaptic pruning in the developing mammalian CNS.
情境中的连接大脑:青少年可塑性如何支持学习与发展。
Dev Cogn Neurosci. 2025 Jan;71:101486. doi: 10.1016/j.dcn.2024.101486. Epub 2024 Nov 28.
4
Brain structure and activity predicting cognitive maturation in adolescence.大脑结构与活动可预测青少年的认知成熟度。
bioRxiv. 2024 Sep 2:2024.08.23.608315. doi: 10.1101/2024.08.23.608315.
5
Shaping dynamical neural computations using spatiotemporal constraints.利用时空约束塑造动态神经计算。
Biochem Biophys Res Commun. 2024 Oct 8;728:150302. doi: 10.1016/j.bbrc.2024.150302. Epub 2024 Jun 25.
6
Cognitive Control and Neural Activity during Human Development: Evidence for Synaptic Pruning.人类发育过程中的认知控制与神经活动:突触修剪的证据
J Neurosci. 2024 Jun 26;44(26):e0373242024. doi: 10.1523/JNEUROSCI.0373-24.2024.
7
Microbiome depletion prior to repeat mild TBI differentially alters social deficits and prefrontal cortex plasticity in adolescent and adult rats.在重复轻度创伤性脑损伤之前的微生物群耗竭会不同程度地改变青少年和成年大鼠的社交缺陷及前额叶皮质可塑性。
iScience. 2024 Mar 2;27(4):109395. doi: 10.1016/j.isci.2024.109395. eCollection 2024 Apr 19.
8
Navigating Pubertal Goldilocks: The Optimal Pace for Hierarchical Brain Organization.青春期的微妙平衡:层级式大脑组织结构的最佳节奏。
Adv Sci (Weinh). 2024 Jun;11(21):e2308364. doi: 10.1002/advs.202308364. Epub 2024 Mar 15.
9
Shaping dynamical neural computations using spatiotemporal constraints.利用时空约束塑造动态神经计算。
ArXiv. 2023 Nov 27:arXiv:2311.15572v1.
10
Dendritic Spines: Synaptogenesis and Synaptic Pruning for the Developmental Organization of Brain Circuits.树突棘:脑回路发育的突触发生和突触修剪。
Adv Neurobiol. 2023;34:143-221. doi: 10.1007/978-3-031-36159-3_4.
调控哺乳动物中枢神经系统发育过程中活性依赖型突触修剪的机制。
Nat Rev Neurosci. 2021 Nov;22(11):657-673. doi: 10.1038/s41583-021-00507-y. Epub 2021 Sep 20.
4
Early-life inflammation promotes depressive symptoms in adolescence via microglial engulfment of dendritic spines.早期生活中的炎症通过小胶质细胞吞噬树突棘促进青少年时期的抑郁症状。
Neuron. 2021 Aug 18;109(16):2573-2589.e9. doi: 10.1016/j.neuron.2021.06.012. Epub 2021 Jul 6.
5
Psilocybin induces rapid and persistent growth of dendritic spines in frontal cortex in vivo.裸盖菇素在体内诱导前额叶皮层树突棘的快速和持久生长。
Neuron. 2021 Aug 18;109(16):2535-2544.e4. doi: 10.1016/j.neuron.2021.06.008. Epub 2021 Jul 5.
6
Modeling changes in probabilistic reinforcement learning during adolescence.建模青少年时期概率强化学习的变化。
PLoS Comput Biol. 2021 Jul 1;17(7):e1008524. doi: 10.1371/journal.pcbi.1008524. eCollection 2021 Jul.
7
Spine dynamics in the brain, mental disorders and artificial neural networks.大脑、精神障碍和人工神经网络中的脊柱动力学。
Nat Rev Neurosci. 2021 Jul;22(7):407-422. doi: 10.1038/s41583-021-00467-3. Epub 2021 May 28.
8
Brain gene co-expression networks link complement signaling with convergent synaptic pathology in schizophrenia.脑基因共表达网络将补体信号与精神分裂症中的会聚性突触病变联系起来。
Nat Neurosci. 2021 Jun;24(6):799-809. doi: 10.1038/s41593-021-00847-z. Epub 2021 May 6.
9
A Dendrite-Focused Framework for Understanding the Actions of Ketamine and Psychedelics.一种专注于树突的框架,用于理解氯胺酮和迷幻剂的作用。
Trends Neurosci. 2021 Apr;44(4):260-275. doi: 10.1016/j.tins.2020.11.008. Epub 2020 Dec 21.
10
Correlates of Auditory Decision-Making in Prefrontal, Auditory, and Basal Lateral Amygdala Cortical Areas.前额叶、听觉和基底外侧杏仁皮质区听觉决策的相关性。
J Neurosci. 2021 Feb 10;41(6):1301-1316. doi: 10.1523/JNEUROSCI.2217-20.2020. Epub 2020 Dec 10.