• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

皮质基底神经节环路中信念状态和动作值的多种表征

Multiple representations of belief states and action values in corticobasal ganglia loops.

作者信息

Samejima Kazuyuki, Doya Kenji

机构信息

Tamagawa University Brain Science Institute, 6-1-1 Tamagawa-gakuen, Machida, Tokyo, Japan 195-8610.

出版信息

Ann N Y Acad Sci. 2007 May;1104:213-28. doi: 10.1196/annals.1390.024. Epub 2007 Apr 13.

DOI:10.1196/annals.1390.024
PMID:17435124
Abstract

Reward-related neural activities have been found in a variety of cortical and subcortical areas by neurophysiological and neuroimaging experiments. Here we present a unified view on how three subloops of the corticobasal ganglia network are involved in reward prediction and action selection using different types of information. The motor/premotor-posterior striatum loop is specialized for action-based value representation and movement selection. The orbitofrontal-ventral striatum loop is specialized for object-based value representation and target selection. The lateral prefrontal-anterior striatum loop is specialized for context-based value representation and context estimation. Furthermore, the medial prefrontal cortex (MPFC) coordinates these multiple value representations and actions at different levels of hierarchy by monitoring the error in predictions.

摘要

通过神经生理学和神经影像学实验,在各种皮质和皮质下区域发现了与奖励相关的神经活动。在此,我们提出一个统一的观点,即皮质基底神经节网络的三个子环路如何利用不同类型的信息参与奖励预测和动作选择。运动/运动前区-后纹状体环路专门用于基于动作的值表示和运动选择。眶额-腹侧纹状体环路专门用于基于对象的值表示和目标选择。外侧前额叶-前纹状体环路专门用于基于情境的值表示和情境估计。此外,内侧前额叶皮质(MPFC)通过监测预测误差,在不同层次水平上协调这些多种值表示和动作。

相似文献

1
Multiple representations of belief states and action values in corticobasal ganglia loops.皮质基底神经节环路中信念状态和动作值的多种表征
Ann N Y Acad Sci. 2007 May;1104:213-28. doi: 10.1196/annals.1390.024. Epub 2007 Apr 13.
2
Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix.纹状体对奖励和决策的贡献:理解重复处理矩阵中的区域差异
Ann N Y Acad Sci. 2007 May;1104:192-212. doi: 10.1196/annals.1390.016. Epub 2007 Apr 7.
3
Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior.基底神经节和眶额皮质在目标导向行为中的参与。
Prog Brain Res. 2000;126:193-215. doi: 10.1016/S0079-6123(00)26015-9.
4
Mechanisms of reinforcement learning and decision making in the primate dorsolateral prefrontal cortex.灵长类动物背外侧前额叶皮层中的强化学习与决策机制。
Ann N Y Acad Sci. 2007 May;1104:108-22. doi: 10.1196/annals.1390.007. Epub 2007 Mar 8.
5
[Neuronal linkage of the cerebral cortex and the striatum].[大脑皮层与纹状体的神经元联系]
Brain Nerve. 2012 Aug;64(8):871-9.
6
[Cortico-basal ganglia circuits--parallel closed loops and convergent/divergent connections].[皮质-基底神经节环路——平行闭环与汇聚/发散连接]
Brain Nerve. 2009 Apr;61(4):351-9.
7
Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning.用于整合多个皮质-纹状体环路的异层级强化学习模型:刺激-动作-奖励关联学习中的功能磁共振成像检查
Neural Netw. 2006 Oct;19(8):1242-54. doi: 10.1016/j.neunet.2006.06.007. Epub 2006 Sep 20.
8
Reward-dependent learning in neuronal networks for planning and decision making.用于规划和决策的神经网络中基于奖励的学习。
Prog Brain Res. 2000;126:217-29. doi: 10.1016/S0079-6123(00)26016-0.
9
Reward representations and reward-related learning in the human brain: insights from neuroimaging.人类大脑中的奖赏表征与奖赏相关学习:来自神经影像学的见解
Curr Opin Neurobiol. 2004 Dec;14(6):769-76. doi: 10.1016/j.conb.2004.10.016.
10
[Decision-making and learning by cortico-basal ganglia network].[皮质-基底神经节网络的决策与学习]
Brain Nerve. 2008 Jul;60(7):799-813.

引用本文的文献

1
Contributions of the Basal Ganglia to Visual Perceptual Decisions.基底神经节对视觉感知决策的贡献。
Annu Rev Vis Sci. 2023 Sep 15;9:385-407. doi: 10.1146/annurev-vision-111022-123804.
2
Causal role of the dorsolateral prefrontal cortex in modulating the balance between Pavlovian and instrumental systems in the punishment domain.背外侧前额叶皮层在调节惩罚领域中 Pavlovian 和工具系统之间平衡中的因果作用。
PLoS One. 2023 Jun 2;18(6):e0286632. doi: 10.1371/journal.pone.0286632. eCollection 2023.
3
New horizons in emotional well-being and brain aging: Potential lessons from cross-species research.
情绪健康和大脑老化的新视野:跨物种研究的潜在启示。
Int J Geriatr Psychiatry. 2023 Jun;38(6):e5936. doi: 10.1002/gps.5936.
4
Striatal mechanisms of turning behaviour following unilateral dopamine depletion in mice.纹状体机制在单侧多巴胺耗竭后对小鼠转向行为的影响。
Eur J Neurosci. 2022 Sep;56(5):4529-4545. doi: 10.1111/ejn.15764. Epub 2022 Jul 23.
5
A unidirectional but not uniform striatal landscape of dopamine signaling for motivational stimuli.动机性刺激的多巴胺信号呈现单向但非统一的纹状体景观。
Proc Natl Acad Sci U S A. 2022 May 24;119(21):e2117270119. doi: 10.1073/pnas.2117270119. Epub 2022 May 20.
6
Hierarchical Reinforcement Learning, Sequential Behavior, and the Dorsal Frontostriatal System.分层强化学习、序列行为与背侧额纹状体系统
J Cogn Neurosci. 2022 Jul 1;34(8):1307-1325. doi: 10.1162/jocn_a_01869.
7
The Role of Executive Function in Shaping Reinforcement Learning.执行功能在塑造强化学习中的作用。
Curr Opin Behav Sci. 2021 Apr;38:66-73. doi: 10.1016/j.cobeha.2020.10.003. Epub 2020 Nov 14.
8
Mixing memory and desire: How memory reactivation supports deliberative decision-making.混合记忆与欲望:记忆再激活如何支持审慎决策。
Wiley Interdiscip Rev Cogn Sci. 2022 Mar;13(2):e1581. doi: 10.1002/wcs.1581. Epub 2021 Oct 19.
9
Distinct temporal difference error signals in dopamine axons in three regions of the striatum in a decision-making task.在一个决策任务中,纹状体三个区域的多巴胺轴突中存在明显的时间差异错误信号。
Elife. 2020 Dec 21;9:e62390. doi: 10.7554/eLife.62390.
10
Towards an integrated account of the development of self-regulation from a neurocognitive perspective: A framework for current and future longitudinal multi-modal investigations.从神经认知角度探讨自我调节发展的综合观点:当前和未来纵向多模态研究的框架。
Dev Cogn Neurosci. 2020 Oct;45:100829. doi: 10.1016/j.dcn.2020.100829. Epub 2020 Jul 25.