Suppr超能文献

苍白球外侧部停顿的环路机制有助于适应性探索。

Circuit mechanisms of GPe pauses account for adaptive exploration.

作者信息

Lee Sang Wan, Song Minryung, Kang Shinwoo, Yang Minsu Abel, Choi Doo-Sup

机构信息

KAIST.

Korea Advanced Institute of Science and Technology.

出版信息

Res Sq. 2025 Aug 5:rs.3.rs-7117998. doi: 10.21203/rs.3.rs-7117998/v1.

Abstract

The external globus pallidus (GPe) has traditionally been viewed as a relay nucleus within the basal ganglia (BG), but accumulating evidence indicates a more dynamic role in reinforcement learning (RL). One key characteristic of GPe activity-transient pauses in high-frequency discharge (HFD) neurons-is preserved across species, yet its potential implications in RL remains unclear. Here, we developed a neurophysiologically grounded computational model to investigate the origin and role of GPe pauses in RL. Our model successfully replicated a range of empirical observations, including pause dynamics during learning and cue-related activity modulation. We demonstrated that the GPe-subthalamic nucleus (STN) circuit functions analogously to a denoising autoencoder, modulating baseline excitability in downstream BG circuits and that GPe pauses emerge as circuit-level consequences of strong, convergent inhibition from the GPe to STN. Simulations and in vivo recordings revealed that the activity of GPe-STN projecting neurons increases following sudden environmental changes, promoting adaptive exploration by disrupting action value contrast. Intriguingly, this same configuration impairs performance with extended training, suggesting that habitual behavior may benefit from weakened GPe-to-STN projections. These findings provide a unifying framework for understanding GPe pause dynamics and highlight circuit-level distinctions supporting the balance between flexibility and proficiency in RL.

摘要

传统上,外侧苍白球(GPe)被视为基底神经节(BG)内的一个中继核,但越来越多的证据表明它在强化学习(RL)中发挥着更具动态性的作用。GPe活动的一个关键特征——高频放电(HFD)神经元的瞬态停顿——在不同物种中都存在,但其在强化学习中的潜在影响仍不清楚。在这里,我们开发了一个基于神经生理学的计算模型,以研究GPe停顿在强化学习中的起源和作用。我们的模型成功地复制了一系列实证观察结果,包括学习过程中的停顿动态以及与线索相关的活动调制。我们证明,GPe-底丘脑核(STN)回路的功能类似于一个去噪自动编码器,调节下游BG回路的基线兴奋性,并且GPe停顿是GPe对STN的强烈、汇聚性抑制的回路水平后果。模拟和体内记录显示,在环境突然变化后,GPe-STN投射神经元的活动增加,通过破坏动作价值对比促进适应性探索。有趣的是,同样的配置在长期训练后会损害表现,这表明习惯性行为可能受益于减弱的GPe到STN的投射。这些发现为理解GPe停顿动态提供了一个统一的框架,并突出了支持强化学习中灵活性和熟练度平衡的回路水平差异。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a449/12340893/c355ff9e7fe6/nihpp-rs7117998v1-f0001.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验