• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

纹状体胆碱能中间神经元在强化学习中的功能作用:从计算角度的分析。

The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective.

机构信息

Department of Neurobiology and Anatomy, Drexel University College of Medicine, Philadelphia, PA, United States.

Neuroscience Institute, Georgia State University, Atlanta, GA, United States.

出版信息

Front Neural Circuits. 2019 Feb 21;13:10. doi: 10.3389/fncir.2019.00010. eCollection 2019.

DOI:10.3389/fncir.2019.00010
PMID:30846930
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6393383/
Abstract

In this study, we explore the functional role of striatal cholinergic interneurons, hereinafter referred to as tonically active neurons (TANs), via computational modeling; specifically, we investigate the mechanistic relationship between TAN activity and dopamine variations and how changes in this relationship affect reinforcement learning in the striatum. TANs pause their tonic firing activity after excitatory stimuli from thalamic and cortical neurons in response to a sensory event or reward information. During the pause striatal dopamine concentration excursions are observed. However, functional interactions between the TAN pause and striatal dopamine release are poorly understood. Here we propose a TAN activity-dopamine relationship model and demonstrate that the TAN pause is likely a time window to gate phasic dopamine release and dopamine variations reciprocally modulate the TAN pause duration. Furthermore, this model is integrated into our previously published model of reward-based motor adaptation to demonstrate how phasic dopamine release is gated by the TAN pause to deliver reward information for reinforcement learning in a timely manner. We also show how TAN-dopamine interactions are affected by striatal dopamine deficiency to produce poor performance of motor adaptation.

摘要

在这项研究中,我们通过计算建模探索纹状体胆碱能中间神经元(以下简称持续活动神经元(TAN))的功能作用;具体来说,我们研究了 TAN 活性与多巴胺变化之间的机制关系,以及这种关系的变化如何影响纹状体中的强化学习。TAN 会在来自丘脑和皮质神经元的兴奋性刺激后暂停其持续放电活动,以响应感觉事件或奖励信息。在暂停期间,观察到纹状体多巴胺浓度的波动。然而,TAN 暂停和纹状体多巴胺释放之间的功能相互作用尚不清楚。在这里,我们提出了一个 TAN 活动-多巴胺关系模型,并证明 TAN 暂停很可能是一个门控相位多巴胺释放的时间窗口,并且多巴胺变化相互调节 TAN 暂停持续时间。此外,该模型被整合到我们之前发布的基于奖励的运动适应模型中,以证明相位多巴胺释放如何通过 TAN 暂停及时传递奖励信息,用于强化学习。我们还展示了 TAN-多巴胺相互作用如何受到纹状体多巴胺缺乏的影响,从而导致运动适应表现不佳。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/39f018d97076/fncir-13-00010-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/fc7410169c86/fncir-13-00010-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/2d684cf50216/fncir-13-00010-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/a8c4a9cee10e/fncir-13-00010-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/b0bca19f4a0c/fncir-13-00010-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/31152c524b35/fncir-13-00010-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/a38c85e5c01b/fncir-13-00010-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/39f018d97076/fncir-13-00010-g0007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/fc7410169c86/fncir-13-00010-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/2d684cf50216/fncir-13-00010-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/a8c4a9cee10e/fncir-13-00010-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/b0bca19f4a0c/fncir-13-00010-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/31152c524b35/fncir-13-00010-g0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/a38c85e5c01b/fncir-13-00010-g0006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/02af/6393383/39f018d97076/fncir-13-00010-g0007.jpg

相似文献

1
The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective.纹状体胆碱能中间神经元在强化学习中的功能作用:从计算角度的分析。
Front Neural Circuits. 2019 Feb 21;13:10. doi: 10.3389/fncir.2019.00010. eCollection 2019.
2
Spontaneous firing and evoked pauses in the tonically active cholinergic interneurons of the striatum.纹状体中持续活动的胆碱能中间神经元的自发放电和诱发的停顿。
Neuroscience. 2011 Dec 15;198:27-43. doi: 10.1016/j.neuroscience.2011.08.067. Epub 2011 Sep 8.
3
A dopamine-acetylcholine cascade: simulating learned and lesion-induced behavior of striatal cholinergic interneurons.多巴胺 - 乙酰胆碱级联反应:模拟纹状体胆碱能中间神经元的习得性行为和损伤诱导行为。
J Neurophysiol. 2008 Oct;100(4):2409-21. doi: 10.1152/jn.90486.2008. Epub 2008 Aug 20.
4
A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning.一种调节纹状体群体不确定性并优化强化学习的胆碱能反馈回路。
Elife. 2015 Dec 25;4:e12029. doi: 10.7554/eLife.12029.
5
A spiking computational model for striatal cholinergic interneurons.一种用于纹状体胆碱能中间神经元的脉冲计算模型。
Brain Struct Funct. 2023 Mar;228(2):589-611. doi: 10.1007/s00429-022-02604-9. Epub 2023 Jan 18.
6
Reduction of an afterhyperpolarization current increases excitability in striatal cholinergic interneurons in rat parkinsonism.降低后超极化电流可增加帕金森病大鼠纹状体内胆堿能中间神经元的兴奋性。
J Neurosci. 2011 Apr 27;31(17):6553-64. doi: 10.1523/JNEUROSCI.6345-10.2011.
7
Dopamine induced switch in the subthreshold dynamics of the striatal cholinergic interneurons: a numerical study.多巴胺诱导纹状体胆碱能中间神经元阈下动力学的转变:一项数值研究。
J Theor Biol. 2009 Feb 21;256(4):547-60. doi: 10.1016/j.jtbi.2008.09.029. Epub 2008 Oct 11.
8
Differences between Dorsal and Ventral Striatum in the Sensitivity of Tonically Active Neurons to Rewarding Events.背侧纹状体与腹侧纹状体中紧张性活动神经元对奖赏事件敏感性的差异。
Front Syst Neurosci. 2017 Jul 24;11:52. doi: 10.3389/fnsys.2017.00052. eCollection 2017.
9
Pauses in Cholinergic Interneuron Activity Are Driven by Excitatory Input and Delayed Rectification, with Dopamine Modulation.胆碱能中间神经元活动的停顿由兴奋性输入和延迟整流驱动,并受多巴胺调制。
Neuron. 2018 Jun 6;98(5):918-925.e3. doi: 10.1016/j.neuron.2018.04.027. Epub 2018 May 10.
10
Phasic dopaminergic activity exerts fast control of cholinergic interneuron firing via sequential NMDA, D2, and D1 receptor activation.阶段性多巴胺活动通过顺序 NMDA、D2 和 D1 受体的激活,对胆碱能中间神经元的放电进行快速控制。
J Neurosci. 2014 Aug 27;34(35):11549-59. doi: 10.1523/JNEUROSCI.1175-14.2014.

引用本文的文献

1
Extrinsic and intrinsic control of striatal cholinergic interneuron activity.纹状体胆碱能中间神经元活动的外在和内在控制。
Front Mol Neurosci. 2025 Feb 13;18:1528419. doi: 10.3389/fnmol.2025.1528419. eCollection 2025.
2
A TAN-dopamine interaction mechanism based computational model of basal ganglia in action selection.一种基于棕褐色与多巴胺相互作用机制的基底神经节动作选择计算模型。
Cogn Neurodyn. 2024 Oct;18(5):2127-2144. doi: 10.1007/s11571-023-10046-0. Epub 2023 Dec 23.
3
A mismatch between striatal cholinergic pauses and dopaminergic reward prediction errors.

本文引用的文献

1
Heterogeneity and Diversity of Striatal GABAergic Interneurons: Update 2018.纹状体γ-氨基丁酸能中间神经元的异质性与多样性:2018年更新
Front Neuroanat. 2018 Nov 8;12:91. doi: 10.3389/fnana.2018.00091. eCollection 2018.
2
Pauses in Cholinergic Interneuron Activity Are Driven by Excitatory Input and Delayed Rectification, with Dopamine Modulation.胆碱能中间神经元活动的停顿由兴奋性输入和延迟整流驱动,并受多巴胺调制。
Neuron. 2018 Jun 6;98(5):918-925.e3. doi: 10.1016/j.neuron.2018.04.027. Epub 2018 May 10.
3
Pauses in Striatal Cholinergic Interneurons: What is Revealed by Their Common Themes and Variations?
纹状体胆碱能停顿与多巴胺能奖励预测误差不匹配。
Proc Natl Acad Sci U S A. 2024 Oct 8;121(41):e2410828121. doi: 10.1073/pnas.2410828121. Epub 2024 Oct 4.
4
Distinct spatially organized striatum-wide acetylcholine dynamics for the learning and extinction of Pavlovian associations.巴甫洛夫联想学习与消退过程中,纹状体内独特的空间组织乙酰胆碱动力学。
bioRxiv. 2025 Jan 21:2024.07.10.602947. doi: 10.1101/2024.07.10.602947.
5
Getting Excited About Learning.对学习充满热情。
Function (Oxf). 2021;2(6). doi: 10.1093/function/zqab059. Epub 2021 Nov 9.
6
A Multiscale, Systems-Level, Neuropharmacological Model of Cortico-Basal Ganglia System for Arm Reaching Under Normal, Parkinsonian, and Levodopa Medication Conditions.一种用于正常、帕金森病及左旋多巴药物治疗条件下手臂伸展的皮质-基底神经节系统的多尺度、系统水平神经药理学模型。
Front Comput Neurosci. 2022 Jan 3;15:756881. doi: 10.3389/fncom.2021.756881. eCollection 2021.
7
Cholinergic Receptor Modulation as a Target for Preventing Dementia in Parkinson's Disease.胆碱能受体调节作为预防帕金森病痴呆的靶点
Front Neurosci. 2021 Sep 20;15:665820. doi: 10.3389/fnins.2021.665820. eCollection 2021.
8
The critical balance between dopamine D2 receptor and RGS for the sensitive detection of a transient decay in dopamine signal.多巴胺 D2 受体与 RGS 之间的关键平衡,用于灵敏检测多巴胺信号的短暂衰减。
PLoS Comput Biol. 2021 Sep 30;17(9):e1009364. doi: 10.1371/journal.pcbi.1009364. eCollection 2021 Sep.
9
Neurotransmitters, Cell Types, and Circuit Mechanisms of Motor Skill Learning and Clinical Applications.运动技能学习的神经递质、细胞类型及神经回路机制与临床应用
Front Neurol. 2021 Feb 25;12:616820. doi: 10.3389/fneur.2021.616820. eCollection 2021.
10
Striatal Cholinergic Interneurons: How to Elucidate Their Function in Health and Disease.纹状体胆碱能中间神经元:如何阐明其在健康与疾病中的功能
Front Pharmacol. 2019 Dec 13;10:1488. doi: 10.3389/fphar.2019.01488. eCollection 2019.
纹状体胆碱能中间神经元的停顿:它们的共同主题和变异揭示了什么?
Front Syst Neurosci. 2017 Oct 30;11:80. doi: 10.3389/fnsys.2017.00080. eCollection 2017.
4
Distinctive Modulation of Dopamine Release in the Nucleus Accumbens Shell Mediated by Dopamine and Acetylcholine Receptors.多巴胺和乙酰胆碱受体介导的伏隔核壳部多巴胺释放的独特调节
J Neurosci. 2017 Nov 15;37(46):11166-11180. doi: 10.1523/JNEUROSCI.0596-17.2017. Epub 2017 Oct 13.
5
From the motor cortex to the movement and back again.从运动皮层到运动,再返回。
PLoS One. 2017 Jun 20;12(6):e0179288. doi: 10.1371/journal.pone.0179288. eCollection 2017.
6
Reward Based Motor Adaptation Mediated by Basal Ganglia.由基底神经节介导的基于奖励的运动适应
Front Comput Neurosci. 2017 Mar 31;11:19. doi: 10.3389/fncom.2017.00019. eCollection 2017.
7
Levodopa medication improves incidental sequence learning in Parkinson's disease.左旋多巴药物治疗可改善帕金森病患者的附带序列学习能力。
Neuropsychologia. 2016 Dec;93(Pt A):53-60. doi: 10.1016/j.neuropsychologia.2016.09.019. Epub 2016 Sep 26.
8
Cortical Control of Striatal Dopamine Transmission via Striatal Cholinergic Interneurons.通过纹状体胆碱能中间神经元对纹状体多巴胺传递的皮质控制
Cereb Cortex. 2016 Oct 1;26(11):4160-4169. doi: 10.1093/cercor/bhw252.
9
Striatal dopamine neurotransmission: regulation of release and uptake.纹状体多巴胺神经传递:释放与摄取的调节
Basal Ganglia. 2016 Aug;6(3):123-148. doi: 10.1016/j.baga.2016.02.001.
10
Reward functions of the basal ganglia.基底神经节的奖赏功能。
J Neural Transm (Vienna). 2016 Jul;123(7):679-693. doi: 10.1007/s00702-016-1510-0. Epub 2016 Feb 2.