• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

动作值的鲁棒和分布式神经表示。

Robust and distributed neural representation of action values.

机构信息

Center for Synaptic Brain Dysfunctions, Institute for Basic Science, Daejeon, Republic of Korea.

Department of Biological Sciences, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea.

出版信息

Elife. 2021 Apr 20;10:e53045. doi: 10.7554/eLife.53045.

DOI:10.7554/eLife.53045
PMID:33876728
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC8104958/
Abstract

Studies in rats, monkeys, and humans have found action-value signals in multiple regions of the brain. These findings suggest that action-value signals encoded in these brain structures bias choices toward higher expected rewards. However, previous estimates of action-value signals might have been inflated by serial correlations in neural activity and also by activity related to other decision variables. Here, we applied several statistical tests based on permutation and surrogate data to analyze neural activity recorded from the striatum, frontal cortex, and hippocampus. The results show that previously identified action-value signals in these brain areas cannot be entirely accounted for by concurrent serial correlations in neural activity and action value. We also found that neural activity related to action value is intermixed with signals related to other decision variables. Our findings provide strong evidence for broadly distributed neural signals related to action value throughout the brain.

摘要

在大鼠、猴子和人类中的研究发现,大脑的多个区域存在动作价值信号。这些发现表明,这些大脑结构中编码的动作价值信号会使选择偏向于更高的预期奖励。然而,之前对动作价值信号的估计可能受到神经活动中的序列相关性以及与其他决策变量相关的活动的影响而被夸大。在这里,我们应用了几种基于置换和替代数据的统计检验来分析从纹状体、额叶皮层和海马体记录的神经活动。结果表明,之前在这些大脑区域中确定的动作价值信号不能完全用神经活动和动作价值的并发序列相关性来解释。我们还发现,与动作值相关的神经活动与其他决策变量相关的信号混合在一起。我们的研究结果为大脑中与动作值相关的广泛分布的神经信号提供了有力的证据。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/11b9/8104958/aa407a69146d/elife-53045-fig4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/11b9/8104958/95e7ce0af089/elife-53045-fig1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/11b9/8104958/23beff2f0ed9/elife-53045-fig2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/11b9/8104958/f14ec23a5e7e/elife-53045-fig3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/11b9/8104958/aa407a69146d/elife-53045-fig4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/11b9/8104958/95e7ce0af089/elife-53045-fig1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/11b9/8104958/23beff2f0ed9/elife-53045-fig2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/11b9/8104958/f14ec23a5e7e/elife-53045-fig3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/11b9/8104958/aa407a69146d/elife-53045-fig4.jpg

相似文献

1
Robust and distributed neural representation of action values.动作值的鲁棒和分布式神经表示。
Elife. 2021 Apr 20;10:e53045. doi: 10.7554/eLife.53045.
2
Beta Oscillations in Monkey Striatum Encode Reward Prediction Error Signals.猴子纹状体中的β振荡编码奖励预测误差信号。
J Neurosci. 2023 May 3;43(18):3339-3352. doi: 10.1523/JNEUROSCI.0952-22.2023. Epub 2023 Apr 4.
3
Action selection and action value in frontal-striatal circuits.前额叶-纹状体回路中的动作选择和动作价值。
Neuron. 2012 Jun 7;74(5):947-60. doi: 10.1016/j.neuron.2012.03.037.
4
Neural Signals Related to Outcome Evaluation Are Stronger in CA1 than CA3.与结果评估相关的神经信号在 CA1 中比在 CA3 中更强。
Front Neural Circuits. 2017 Jun 7;11:40. doi: 10.3389/fncir.2017.00040. eCollection 2017.
5
Signals in human striatum are appropriate for policy update rather than value prediction.人类纹状体中的信号适合用于策略更新,而不是价值预测。
J Neurosci. 2011 Apr 6;31(14):5504-11. doi: 10.1523/JNEUROSCI.6316-10.2011.
6
Neuronal basis for evaluating selected action in the primate striatum.灵长类纹状体中评估选定动作的神经元基础。
Eur J Neurosci. 2011 Aug;34(3):489-506. doi: 10.1111/j.1460-9568.2011.07771.x. Epub 2011 Jul 22.
7
Neuronal Reward and Decision Signals: From Theories to Data.神经元奖励与决策信号:从理论到数据
Physiol Rev. 2015 Jul;95(3):853-951. doi: 10.1152/physrev.00023.2014.
8
Role of rodent secondary motor cortex in value-based action selection.啮齿动物次级运动皮层在基于价值的动作选择中的作用。
Nat Neurosci. 2011 Aug 14;14(9):1202-8. doi: 10.1038/nn.2881.
9
Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning.用于整合多个皮质-纹状体环路的异层级强化学习模型:刺激-动作-奖励关联学习中的功能磁共振成像检查
Neural Netw. 2006 Oct;19(8):1242-54. doi: 10.1016/j.neunet.2006.06.007. Epub 2006 Sep 20.
10
Distributed Encoding of Reinforcement in Rat Cortico-Striatal-Limbic Networks.大鼠皮质纹状体边缘网络中强化的分布式编码。
Neuroscience. 2019 Aug 10;413:169-182. doi: 10.1016/j.neuroscience.2019.06.019. Epub 2019 Jun 21.

引用本文的文献

1
Selective engagement of prefrontal VIP neurons in reversal learning.前额叶血管活性肠肽能神经元在逆向学习中的选择性参与。
Sci Adv. 2025 Jul 25;11(30):eadt4945. doi: 10.1126/sciadv.adt4945. Epub 2025 Jul 23.
2
Whether or not to act is determined by distinct signals from motor thalamus and orbitofrontal cortex to secondary motor cortex.是否采取行动由来自运动丘脑和眶额皮质至次级运动皮质的不同信号决定。
Nat Commun. 2025 Apr 4;16(1):3106. doi: 10.1038/s41467-025-58272-w.
3
Chronic ethanol exposure produces sex-dependent impairments in value computations in the striatum.

本文引用的文献

1
Frontal cortex neuron types categorically encode single decision variables.前额皮质神经元类型明确地对单一决策变量进行编码。
Nature. 2019 Dec;576(7787):446-451. doi: 10.1038/s41586-019-1816-9. Epub 2019 Dec 4.
2
Stable Representations of Decision Variables for Flexible Behavior.决策变量的稳定表示法,以实现灵活的行为。
Neuron. 2019 Sep 4;103(5):922-933.e7. doi: 10.1016/j.neuron.2019.06.001. Epub 2019 Jul 4.
3
Striatal action-value neurons reconsidered.重新思考纹状体动作价值神经元。
长期乙醇暴露会在纹状体的价值计算中产生性别依赖性损伤。
Sci Adv. 2025 Apr 4;11(14):eadt0200. doi: 10.1126/sciadv.adt0200. Epub 2025 Apr 2.
4
Reward expectation and receipt differentially modulate the spiking of accumbens D1+ and D2+ neurons.奖励预期和奖励获得对伏隔核D1+和D2+神经元的放电有不同的调节作用。
Curr Biol. 2025 Mar 24;35(6):1285-1297.e3. doi: 10.1016/j.cub.2025.02.007. Epub 2025 Feb 27.
5
Striatal arbitration between choice strategies guides few-shot adaptation.选择策略之间的纹状体仲裁引导少样本适应。
Nat Commun. 2025 Feb 20;16(1):1811. doi: 10.1038/s41467-025-57049-5.
6
An opponent striatal circuit for distributional reinforcement learning.用于分布式强化学习的对侧纹状体回路。
Nature. 2025 Mar;639(8055):717-726. doi: 10.1038/s41586-024-08488-5. Epub 2025 Feb 19.
7
Distributed Intracranial Activity Underlying Human Decision-making Behavior.人类决策行为背后的分布式颅内活动。
J Neurosci. 2025 Apr 9;45(15):e0572242024. doi: 10.1523/JNEUROSCI.0572-24.2024.
8
Memory consolidation from a reinforcement learning perspective.从强化学习角度看记忆巩固。
Front Comput Neurosci. 2025 Jan 8;18:1538741. doi: 10.3389/fncom.2024.1538741. eCollection 2024.
9
Reward Bases: A simple mechanism for adaptive acquisition of multiple reward types.奖励基础:一种用于适应性获取多种奖励类型的简单机制。
PLoS Comput Biol. 2024 Nov 19;20(11):e1012580. doi: 10.1371/journal.pcbi.1012580. eCollection 2024 Nov.
10
Chronic Ethanol Exposure Produces Persistent Impairment in Cognitive Flexibility and Decision Signals in the Striatum.长期乙醇暴露会导致纹状体认知灵活性和决策信号持续受损。
bioRxiv. 2025 Feb 25:2024.03.10.584332. doi: 10.1101/2024.03.10.584332.
Elife. 2018 May 31;7:e34248. doi: 10.7554/eLife.34248.
4
Neural Signals Related to Outcome Evaluation Are Stronger in CA1 than CA3.与结果评估相关的神经信号在 CA1 中比在 CA3 中更强。
Front Neural Circuits. 2017 Jun 7;11:40. doi: 10.3389/fncir.2017.00040. eCollection 2017.
5
Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis.强化学习模型及其神经关联:一项激活可能性估计元分析。
Cogn Affect Behav Neurosci. 2015 Jun;15(2):435-59. doi: 10.3758/s13415-015-0338-7.
6
A category-free neural population supports evolving demands during decision-making.无类别神经群体在决策过程中支持不断变化的需求。
Nat Neurosci. 2014 Dec;17(12):1784-1792. doi: 10.1038/nn.3865. Epub 2014 Nov 10.
7
The importance of mixed selectivity in complex cognitive tasks.复杂认知任务中混合选择性的重要性。
Nature. 2013 May 30;497(7451):585-90. doi: 10.1038/nature12160. Epub 2013 May 19.
8
Signals for previous goal choice persist in the dorsomedial, but not dorsolateral striatum of rats.大鼠的背内侧纹状体中存在先前目标选择的信号,但背外侧纹状体中没有。
J Neurosci. 2013 Jan 2;33(1):52-63. doi: 10.1523/JNEUROSCI.2422-12.2013.
9
Hippocampal neural correlates for values of experienced events.体验事件价值的海马体神经关联。
J Neurosci. 2012 Oct 24;32(43):15053-65. doi: 10.1523/JNEUROSCI.2806-12.2012.
10
Prefrontal and striatal activity related to values of objects and locations.与物体和位置价值相关的前额叶和纹状体活动。
Front Neurosci. 2012 Jul 17;6:108. doi: 10.3389/fnins.2012.00108. eCollection 2012.