• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

虚拟奖励对大鼠选择行为的影响。

Effects of fictive reward on rat's choice behavior.

作者信息

Kim Ko-Un, Huh Namjung, Jang Yunsil, Lee Daeyeol, Jung Min Whan

机构信息

1] Center for Synaptic Brain Dysfunctions, Institute for Basic Science, Korea Advanced Institute of Science and Technology, Daejeon 305-701, Korea [2] Neuroscience Laboratory, Institute for Medical Sciences, Ajou University School of Medicine, Suwon 443-721, Korea [3] Neuroscience Graduate Program, Ajou University School of Medicine, Suwon 443-721, Korea.

1] Center for Synaptic Brain Dysfunctions, Institute for Basic Science, Korea Advanced Institute of Science and Technology, Daejeon 305-701, Korea [2] Neuroscience Laboratory, Institute for Medical Sciences, Ajou University School of Medicine, Suwon 443-721, Korea.

出版信息

Sci Rep. 2015 Jan 27;5:8040. doi: 10.1038/srep08040.

DOI:10.1038/srep08040
PMID:25623929
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC4894400/
Abstract

Choices of humans and non-human primates are influenced by both actually experienced and fictive outcomes. To test whether this is also the case in rodents, we examined rat's choice behavior in a binary choice task in which variable magnitudes of actual and fictive rewards were delivered. We found that the animal's choice was significantly influenced by the magnitudes of both actual and fictive rewards in the previous trial. A model-based analysis revealed, however, that the effect of fictive reward was more transient and influenced mostly the choice in the next trial, whereas the effect of actual reward was more sustained, consistent with incremental learning of action values. Our results suggest that the capacity to modify future choices based on fictive outcomes might be shared by many different animal species, but fictive outcomes are less effective than actual outcomes in the incremental value learning system.

摘要

人类和非人类灵长类动物的选择受到实际经历和虚拟结果的影响。为了测试啮齿动物是否也是如此,我们在一个二元选择任务中检查了大鼠的选择行为,在该任务中会给予不同大小的实际奖励和虚拟奖励。我们发现,动物的选择在前一次试验中受到实际奖励和虚拟奖励大小的显著影响。然而,基于模型的分析表明,虚拟奖励的影响更短暂,主要影响下一次试验中的选择,而实际奖励的影响更持久,这与动作值的增量学习一致。我们的结果表明,基于虚拟结果修改未来选择的能力可能为许多不同动物物种所共有,但在增量价值学习系统中,虚拟结果不如实际结果有效。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/6db2a9f8e325/srep08040-f6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/d48c317a12fa/srep08040-f1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/bfea6f4f3d4f/srep08040-f2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/4e04311b2ea3/srep08040-f3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/c98e82cbc151/srep08040-f4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/a5c0df9ce413/srep08040-f5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/6db2a9f8e325/srep08040-f6.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/d48c317a12fa/srep08040-f1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/bfea6f4f3d4f/srep08040-f2.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/4e04311b2ea3/srep08040-f3.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/c98e82cbc151/srep08040-f4.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/a5c0df9ce413/srep08040-f5.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fec2/4894400/6db2a9f8e325/srep08040-f6.jpg

相似文献

1
Effects of fictive reward on rat's choice behavior.虚拟奖励对大鼠选择行为的影响。
Sci Rep. 2015 Jan 27;5:8040. doi: 10.1038/srep08040.
2
Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game.在混合策略博弈过程中背侧前扣带回皮质奖励信号的时间滤波
J Neurosci. 2007 Aug 1;27(31):8366-77. doi: 10.1523/JNEUROSCI.2369-07.2007.
3
Effects of d-amphetamine on risk choice in rats depend on the manner in which the expected reward value is varied.安非他命对大鼠风险选择的影响取决于预期奖赏值变化的方式。
Pharmacol Biochem Behav. 2018 Aug;171:20-29. doi: 10.1016/j.pbb.2018.05.008. Epub 2018 May 18.
4
Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats.伏隔核核心损伤对大鼠在小的确定性奖励和大的不确定性奖励之间选择的影响。
BMC Neurosci. 2005 May 28;6:37. doi: 10.1186/1471-2202-6-37.
5
Dynamic signals related to choices and outcomes in the dorsolateral prefrontal cortex.与背外侧前额叶皮质中选择和结果相关的动态信号。
Cereb Cortex. 2007 Sep;17 Suppl 1:i110-7. doi: 10.1093/cercor/bhm064. Epub 2007 Jun 4.
6
Self-choice enhances value in reward-seeking in primates.自我选择增强了灵长类动物在寻求奖励中的价值。
Neurosci Res. 2014 Mar;80:45-54. doi: 10.1016/j.neures.2014.01.004. Epub 2014 Jan 22.
7
Encoding of action history in the rat ventral striatum.大鼠腹侧纹状体中动作历史的编码。
J Neurophysiol. 2007 Dec;98(6):3548-56. doi: 10.1152/jn.00310.2007. Epub 2007 Oct 17.
8
Prosocial Choice in Rats Depends on Food-Seeking Behavior Displayed by Recipients.大鼠的亲社会选择取决于接受者表现出的觅食行为。
Curr Biol. 2015 Jun 29;25(13):1736-45. doi: 10.1016/j.cub.2015.05.018. Epub 2015 Jun 4.
9
Mechanisms of reinforcement learning and decision making in the primate dorsolateral prefrontal cortex.灵长类动物背外侧前额叶皮层中的强化学习与决策机制。
Ann N Y Acad Sci. 2007 May;1104:108-22. doi: 10.1196/annals.1390.007. Epub 2007 Mar 8.
10
The dorsomedial striatum mediates flexible choice behavior in spatial tasks.背内侧纹状体介导空间任务中的灵活选择行为。
Behav Brain Res. 2011 Jul 7;220(2):288-93. doi: 10.1016/j.bbr.2011.02.008. Epub 2011 Feb 21.

引用本文的文献

1
Distinct roles of the orbitofrontal cortex, ventral striatum, and dopamine neurons in counterfactual thinking of decision outcomes.前额叶皮层、腹侧纹状体和多巴胺神经元在决策结果反事实思维中的不同作用。
Sci Adv. 2023 Aug 9;9(32):eadh2831. doi: 10.1126/sciadv.adh2831.
2
An open-source behavior controller for associative learning and memory (B-CALM).一个用于联想学习和记忆的开源行为控制器(B-CALM)。
Behav Res Methods. 2024 Apr;56(4):2695-2710. doi: 10.3758/s13428-023-02182-6. Epub 2023 Jul 18.
3
Reinforcement learning models of risky choice and the promotion of risk-taking by losses disguised as wins in rats.

本文引用的文献

1
A Comparison Model of Reinforcement-Learning and Win-Stay-Lose-Shift Decision-Making Processes: A Tribute to W.K. Estes.强化学习与赢则留输则变决策过程的比较模型:向W.K. 埃斯蒂斯致敬。
J Math Psychol. 2014 Apr 1;59:41-49. doi: 10.1016/j.jmp.2013.10.001.
2
Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task.大鼠在神经经济学任务中决策时的后悔行为和神经生理学相关性。
Nat Neurosci. 2014 Jul;17(7):995-1002. doi: 10.1038/nn.3740. Epub 2014 Jun 8.
3
Neural computations underlying arbitration between model-based and model-free learning.
大鼠风险选择的强化学习模型以及伪装成胜利的损失对冒险行为的促进作用。
J Exp Psychol Anim Learn Cogn. 2017 Jul;43(3):262-279. doi: 10.1037/xan0000141.
4
Neuronal activity in dorsomedial and dorsolateral striatum under the requirement for temporal credit assignment.在时间信用分配需求下背内侧和背外侧纹状体中的神经元活动。
Sci Rep. 2016 Jun 1;6:27056. doi: 10.1038/srep27056.
基于模型和无模型学习之间仲裁的神经计算。
Neuron. 2014 Feb 5;81(3):687-99. doi: 10.1016/j.neuron.2013.11.028.
4
Real and fictive outcomes are processed differently but converge on a common adaptive mechanism.真实和虚构的结果被不同地处理,但会收敛到一个共同的适应机制上。
Neuron. 2013 Sep 18;79(6):1243-55. doi: 10.1016/j.neuron.2013.07.006.
5
Computational heterogeneity in the human mesencephalic dopamine system.人类中脑多巴胺系统的计算异质性。
Cogn Affect Behav Neurosci. 2013 Dec;13(4):747-56. doi: 10.3758/s13415-013-0191-5.
6
The road not taken: neural correlates of decision making in orbitofrontal cortex.未选择的路:眶额皮质决策的神经关联
Front Neurosci. 2012 Sep 11;6:131. doi: 10.3389/fnins.2012.00131. eCollection 2012.
7
Neural control of dopamine neurotransmission: implications for reinforcement learning.神经控制多巴胺递质传递:对强化学习的启示。
Eur J Neurosci. 2012 Apr;35(7):1115-23. doi: 10.1111/j.1460-9568.2012.08055.x.
8
Neural basis of reinforcement learning and decision making.强化学习和决策的神经基础。
Annu Rev Neurosci. 2012;35:287-308. doi: 10.1146/annurev-neuro-062111-150512. Epub 2012 Mar 29.
9
Counterfactual choice and learning in a neural network centered on human lateral frontopolar cortex.以人类外侧额极皮层为中心的神经网络中的反事实选择与学习。
PLoS Biol. 2011 Jun;9(6):e1001093. doi: 10.1371/journal.pbio.1001093. Epub 2011 Jun 28.
10
Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex.眶额皮质和背外侧前额皮质对实际和假设结果的分布式编码。
Neuron. 2011 May 26;70(4):731-41. doi: 10.1016/j.neuron.2011.03.026.