• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

决策剖析:强化学习、决策制定及逆转过程中的纹状体 - 眶额皮质交互作用

Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal.

作者信息

Frank Michael J, Claus Eric D

机构信息

Department of Psychology.

出版信息

Psychol Rev. 2006 Apr;113(2):300-326. doi: 10.1037/0033-295X.113.2.300.

DOI:10.1037/0033-295X.113.2.300
PMID:16637763
Abstract

The authors explore the division of labor between the basal ganglia-dopamine (BG-DA) system and the orbitofrontal cortex (OFC) in decision making. They show that a primitive neural network model of the BG-DA system slowly learns to make decisions on the basis of the relative probability of rewards but is not as sensitive to (a) recency or (b) the value of specific rewards. An augmented model that explores BG-OFC interactions is more successful at estimating the true expected value of decisions and is faster at switching behavior when reinforcement contingencies change. In the augmented model, OFC areas exert top-down control on the BG and premotor areas by representing reinforcement magnitudes in working memory. The model successfully captures patterns of behavior resulting from OFC damage in decision making, reversal learning, and devaluation paradigms and makes additional predictions for the underlying source of these deficits.

摘要

作者探讨了基底神经节-多巴胺(BG-DA)系统与眶额皮质(OFC)在决策过程中的分工。他们表明,BG-DA系统的一个原始神经网络模型会基于奖励的相对概率慢慢学习做出决策,但对(a)近期性或(b)特定奖励的价值不太敏感。一个探索BG-OFC相互作用的增强模型在估计决策的真实预期价值方面更成功,并且在强化意外情况改变时切换行为的速度更快。在增强模型中,OFC区域通过在工作记忆中表征强化幅度,对BG和运动前区施加自上而下的控制。该模型成功捕捉了在决策、逆向学习和贬值范式中OFC损伤所导致的行为模式,并对这些缺陷的潜在根源做出了额外预测。

相似文献

1
Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal.决策剖析:强化学习、决策制定及逆转过程中的纹状体 - 眶额皮质交互作用
Psychol Rev. 2006 Apr;113(2):300-326. doi: 10.1037/0033-295X.113.2.300.
2
A neural network model for the orbitofrontal cortex and task space acquisition during reinforcement learning.一个用于强化学习期间眶额皮质和任务空间获取的神经网络模型。
PLoS Comput Biol. 2018 Jan 4;14(1):e1005925. doi: 10.1371/journal.pcbi.1005925. eCollection 2018 Jan.
3
The role of orbitofrontal cortex in decision making: a component process account.眶额皮质在决策中的作用:一个成分加工模型
Ann N Y Acad Sci. 2007 Dec;1121:421-30. doi: 10.1196/annals.1401.023. Epub 2007 Sep 10.
4
The orbitofrontal cortex as part of a hierarchical neural system mediating choice between two good options.眶额皮层作为一个分层神经系统的一部分,在两种好的选择之间进行调节。
J Neurosci. 2013 Oct 2;33(40):15989-98. doi: 10.1523/JNEUROSCI.0026-13.2013.
5
Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder.强迫症患者在反转学习任务中眶额-纹状体活动降低。
Arch Gen Psychiatry. 2006 Nov;63(11):1225-36. doi: 10.1001/archpsyc.63.11.1225.
6
Orbitofrontal contributions to value-based decision making: evidence from humans with frontal lobe damage.眶额皮质对基于价值的决策的贡献:来自额叶损伤患者的证据。
Ann N Y Acad Sci. 2011 Dec;1239:51-8. doi: 10.1111/j.1749-6632.2011.06229.x.
7
Reconciling the roles of orbitofrontal cortex in reversal learning and the encoding of outcome expectancies.协调眶额皮质在逆向学习和结果预期编码中的作用。
Ann N Y Acad Sci. 2007 Dec;1121:320-35. doi: 10.1196/annals.1401.001. Epub 2007 Aug 14.
8
Neural representation of behavioral outcomes in the orbitofrontal cortex.眶额皮质中行为结果的神经表征。
Curr Opin Neurobiol. 2009 Feb;19(1):84-91. doi: 10.1016/j.conb.2009.03.010. Epub 2009 May 6.
9
Orbitofrontal Cortex Signals Expected Outcomes with Predictive Codes When Stable Contingencies Promote the Integration of Reward History.当稳定的意外事件促进奖励历史的整合时,眶额皮质通过预测编码发出预期结果的信号。
J Neurosci. 2017 Feb 22;37(8):2010-2021. doi: 10.1523/JNEUROSCI.2951-16.2016. Epub 2017 Jan 23.
10
Interneurons are necessary for coordinated activity during reversal learning in orbitofrontal cortex.中间神经元对于眶额皮质逆向学习过程中的协调活动是必需的。
Biol Psychiatry. 2015 Mar 1;77(5):454-64. doi: 10.1016/j.biopsych.2014.07.023. Epub 2014 Aug 1.

引用本文的文献

1
How working memory and reinforcement learning interact when avoiding punishment and pursuing reward concurrently.当同时避免惩罚和追求奖励时,工作记忆与强化学习是如何相互作用的。
J Exp Psychol Gen. 2025 Sep 1. doi: 10.1037/xge0001817.
2
Do Human Reinforcement Learning Models Account for Key Experimental Choice Patterns in the Iowa Gambling Task?人类强化学习模型是否考虑了爱荷华赌博任务中的关键实验选择模式?
Comput Brain Behav. 2025;8(2):286-320. doi: 10.1007/s42113-024-00228-2. Epub 2024 Nov 7.
3
Adaptive chunking improves effective working memory capacity in a prefrontal cortex and basal ganglia circuit.
适应性组块化可提高前额叶皮层和基底神经节回路中的有效工作记忆容量。
Elife. 2025 Feb 28;13:RP97894. doi: 10.7554/eLife.97894.
4
Probabalistic reinforcement learning impairments predict negative symptom severity and risk for conversion in youth at clinical high-risk for psychosis.概率强化学习障碍可预测临床高危青少年精神病患者的阴性症状严重程度及转化风险。
Psychol Med. 2025 Feb 6;55:e28. doi: 10.1017/S0033291724003416.
5
Adaptive chunking improves effective working memory capacity in a prefrontal cortex and basal ganglia circuit.适应性组块化可提高前额叶皮质和基底神经节回路中的有效工作记忆容量。
bioRxiv. 2024 Nov 21:2024.03.24.586455. doi: 10.1101/2024.03.24.586455.
6
Neuronal diversity in the caudate nucleus: A comparative study between camel and human brains.尾状核中的神经元多样性:骆驼与人类大脑的比较研究。
Anat Rec (Hoboken). 2025 May;308(5):1410-1424. doi: 10.1002/ar.25555. Epub 2024 Aug 8.
7
The challenge of learning adaptive mental behavior.学习自适应心理行为的挑战。
J Psychopathol Clin Sci. 2024 Jul;133(5):413-426. doi: 10.1037/abn0000924. Epub 2024 May 30.
8
The dynamic interplay between in-context and in-weight learning in humans and neural networks.人类与神经网络中情境学习和权重学习之间的动态相互作用。
ArXiv. 2025 Apr 25:arXiv:2402.08674v4.
9
A computational network dynamical modeling for abnormal oscillation and deep brain stimulation control of obsessive-compulsive disorder.一种用于强迫症异常振荡和深部脑刺激控制的计算网络动力学建模。
Cogn Neurodyn. 2023 Oct;17(5):1167-1184. doi: 10.1007/s11571-022-09858-3. Epub 2022 Aug 24.
10
BrainCog: A spiking neural network based, brain-inspired cognitive intelligence engine for brain-inspired AI and brain simulation.BrainCog:一种基于脉冲神经网络的、受大脑启发的认知智能引擎,用于受大脑启发的人工智能和大脑模拟。
Patterns (N Y). 2023 Jul 6;4(8):100789. doi: 10.1016/j.patter.2023.100789. eCollection 2023 Aug 11.