眶额皮质和背外侧前额皮质对实际和假设结果的分布式编码。
Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex.
机构信息
Department of Neurobiology, Yale University, New Haven, CT 06510, USA.
出版信息
Neuron. 2011 May 26;70(4):731-41. doi: 10.1016/j.neuron.2011.03.026.
Abstract
Knowledge about hypothetical outcomes from unchosen actions is beneficial only when such outcomes can be correctly attributed to specific actions. Here we show that during a simulated rock-paper-scissors game, rhesus monkeys can adjust their choice behaviors according to both actual and hypothetical outcomes from their chosen and unchosen actions, respectively. In addition, neurons in both dorsolateral prefrontal cortex and orbitofrontal cortex encoded the signals related to actual and hypothetical outcomes immediately after they were revealed to the animal. Moreover, compared to the neurons in the orbitofrontal cortex, those in the dorsolateral prefrontal cortex were more likely to change their activity according to the hypothetical outcomes from specific actions. Conjunctive and parallel coding of multiple actions and their outcomes in the prefrontal cortex might enhance the efficiency of reinforcement learning and also contribute to their context-dependent memory.
摘要
只有当未选择的行动的假设结果可以正确归因于特定的行动时，关于这些结果的知识才是有益的。在这里，我们展示了在模拟石头剪刀布游戏中，恒河猴可以根据他们选择和未选择的行动的实际和假设结果分别调整他们的选择行为。此外，在动物被告知结果后，背外侧前额叶皮层和眶额皮层中的神经元分别对与实际和假设结果相关的信号进行了编码。此外，与眶额皮层中的神经元相比，背外侧前额叶皮层中的神经元更有可能根据特定行动的假设结果改变它们的活动。前额叶皮层中对多个行动及其结果的联合和并行编码可能会提高强化学习的效率，并有助于它们的上下文记忆。
相似文献
1
Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex.眶额皮质和背外侧前额皮质对实际和假设结果的分布式编码。
Neuron. 2011 May 26;70(4):731-41. doi: 10.1016/j.neuron.2011.03.026.
2
Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex.与背外侧前额叶皮质中选择和结果相关的动态信号。
Cereb Cortex. 2007 Sep;17 Suppl 1:i110-7. doi: 10.1093/cercor/bhm064. Epub 2007 Jun 4.
3
Dynamic routing of task-relevant signals for decision making in dorsolateral prefrontal cortex.背外侧前额叶皮层中用于决策的任务相关信号的动态路由。
Nat Neurosci. 2015 Feb;18(2):295-301. doi: 10.1038/nn.3918. Epub 2015 Jan 12.
4
The Role of Orbitofrontal-Amygdala Interactions in Updating Action-Outcome Valuations in Macaques.眶额皮质与杏仁核相互作用在更新猕猴动作-结果价值评估中的作用
J Neurosci. 2017 Mar 1;37(9):2463-2470. doi: 10.1523/JNEUROSCI.1839-16.2017. Epub 2017 Feb 1.
5
Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task.灵长类动物在执行奖励偏好任务期间背外侧和眶额叶前额叶皮层的神经元活动。
Eur J Neurosci. 2003 Oct;18(7):2069-81. doi: 10.1046/j.1460-9568.2003.02922.x.
6
Influence of monkey dorsolateral prefrontal and posterior parietal activity on behavioral choice during attention tasks.猴子背外侧前额叶和顶叶后部活动对注意力任务中行为选择的影响。
Eur J Neurosci. 2014 Sep;40(6):2910-21. doi: 10.1111/ejn.12662. Epub 2014 Jun 25.
7
Orbital prefrontal cortex is required for object-in-place scene memory but not performance of a strategy implementation task.眶额前皮质是物体在特定位置的场景记忆所必需的，但不是策略实施任务表现所必需的。
J Neurosci. 2007 Oct 17;27(42):11327-33. doi: 10.1523/JNEUROSCI.3369-07.2007.
8
Neural responses in macaque prefrontal cortex are linked to strategic exploration.猕猴前额皮质的神经反应与策略性探索有关。
PLoS Biol. 2023 Jan 30;21(1):e3001985. doi: 10.1371/journal.pbio.3001985. eCollection 2023 Jan.
9
The prefrontal cortex and hybrid learning during iterative competitive games.前额皮质与迭代竞争游戏中的混合学习。
Ann N Y Acad Sci. 2011 Dec;1239:100-8. doi: 10.1111/j.1749-6632.2011.06223.x.
10
Monkey orbitofrontal cortex encodes response choices near feedback time.猴子眶额皮质在反馈时间附近编码反应选择。
J Neurosci. 2009 Feb 25;29(8):2569-74. doi: 10.1523/JNEUROSCI.5777-08.2009.
引用本文的文献
1
Dynamic reconfiguration of brain coactivation states associated with active and lecture-based learning of university physics.与大学物理的主动学习和基于讲座的学习相关的大脑共激活状态的动态重构。
NPJ Sci Learn. 2025 Aug 16;10(1):55. doi: 10.1038/s41539-025-00348-9.
2
Twin differences in the Minnesota Trust Game relate to neural mechanisms of suspiciousness.明尼苏达信任博弈中的双胞胎差异与怀疑的神经机制有关。
Cogn Affect Behav Neurosci. 2025 Jul 10. doi: 10.3758/s13415-025-01324-x.
3
Distinct fNIRS Inter-Brain Coupling Patterns for Cooperation versus Competition in a Tennis Game.网球比赛中合作与竞争的不同功能性近红外光谱脑间耦合模式
Soc Cogn Affect Neurosci. 2025 Jan 18;20(1). doi: 10.1093/scan/nsaf060.
4
Dynamic reconfiguration of brain coactivation states associated with active and lecture-based learning of university physics.与大学物理的主动学习和基于讲座的学习相关的大脑共激活状态的动态重构。
bioRxiv. 2025 Feb 25:2025.02.22.639361. doi: 10.1101/2025.02.22.639361.
5
Neurocomputational mechanisms involved in adaptation to fluctuating intentions of others.涉及适应他人波动意图的神经计算机制。
Nat Commun. 2024 Apr 12;15(1):3189. doi: 10.1038/s41467-024-47491-2.
6
Neurons in the monkey frontopolar cortex encode learning stage and goal during a fast learning task.猴子额极前皮质的神经元在快速学习任务中对学习阶段和目标进行编码。
PLoS Biol. 2024 Feb 16;22(2):e3002500. doi: 10.1371/journal.pbio.3002500. eCollection 2024 Feb.
7
Mapping causal links between prefrontal cortical regions and intra-individual behavioral variability.映射前额皮质区域与个体内行为变异性之间的因果关系。
Nat Commun. 2024 Jan 2;15(1):140. doi: 10.1038/s41467-023-44341-5.
8
Value Representations of Spite Sensitivity in Psychosis on the Minnesota Trust Game.精神病患者在明尼苏达信任游戏中表现出的恶意敏感性的价值表现。
Biol Psychiatry Cogn Neurosci Neuroimaging. 2024 Apr;9(4):429-436. doi: 10.1016/j.bpsc.2023.11.010. Epub 2023 Dec 12.
9
Distinct roles of the orbitofrontal cortex, ventral striatum, and dopamine neurons in counterfactual thinking of decision outcomes.前额叶皮层、腹侧纹状体和多巴胺神经元在决策结果反事实思维中的不同作用。
Sci Adv. 2023 Aug 9;9(32):eadh2831. doi: 10.1126/sciadv.adh2831.
10
Competitive and cooperative games for probing the neural basis of social decision-making in animals.用于探测动物社会决策神经基础的竞争与合作游戏。
Neurosci Biobehav Rev. 2023 Jun;149:105158. doi: 10.1016/j.neubiorev.2023.105158. Epub 2023 Apr 4.
本文引用的文献
1
Model-based influences on humans' choices and striatal prediction errors.基于模型的影响对人类选择和纹状体预测误差的影响。
Neuron. 2011 Mar 24;69(6):1204-15. doi: 10.1016/j.neuron.2011.02.027.
2
Beyond reversal: a critical role for human orbitofrontal cortex in flexible learning from probabilistic feedback.超越反转：人类眶额皮层在从概率反馈中灵活学习中的关键作用。
J Neurosci. 2010 Dec 15;30(50):16868-75. doi: 10.1523/JNEUROSCI.1958-10.2010.
3
States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning.状态与奖励：基于模型和无模型强化学习的分离神经预测误差信号。
Neuron. 2010 May 27;66(4):585-95. doi: 10.1016/j.neuron.2010.04.016.
4
Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making.啮齿动物眶额皮质和内侧前额皮质在决策中的不同作用。
Neuron. 2010 May 13;66(3):449-60. doi: 10.1016/j.neuron.2010.03.033.
5
Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning.猕猴大脑中的可分离学习系统及眶额皮质在条件学习中的作用。
Neuron. 2010 Mar 25;65(6):927-39. doi: 10.1016/j.neuron.2010.02.027.
6
Neurons in anterior cingulate cortex multiplex information about reward and action.前扣带皮层中的神经元整合了关于奖励和动作的信息。
J Neurosci. 2010 Mar 3;30(9):3339-46. doi: 10.1523/JNEUROSCI.4874-09.2010.
7
Role of striatum in updating values of chosen actions.纹状体在更新所选动作价值中的作用。
J Neurosci. 2009 Nov 25;29(47):14701-12. doi: 10.1523/JNEUROSCI.2728-09.2009.
8
Source monitoring 15 years later: what have we learned from fMRI about the neural mechanisms of source memory?15年后的来源监测：我们从功能磁共振成像中学到了关于来源记忆神经机制的哪些知识？
Psychol Bull. 2009 Jul;135(4):638-77. doi: 10.1037/a0015849.
9
The computation of social behavior.社会行为的计算
Science. 2009 May 29;324(5931):1160-4. doi: 10.1126/science.1169694.
10
Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables.通过额叶中的单个神经元评估选择：跨多个决策变量编码的结果值。
Eur J Neurosci. 2009 May;29(10):2061-73. doi: 10.1111/j.1460-9568.2009.06743.x. Epub 2009 May 11.
Zotero 插件