• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

为什么环境对决策很重要?基于选择的学习的局部水库模型。

Why is the environment important for decision making? Local reservoir model for choice-based learning.

机构信息

Network System Research Institute, National Institute of Information and Communications Technology, Koganei, Tokyo, Japan.

Department of System Design Engineering, Keio University, Yokohama, Kanagawa, Japan.

出版信息

PLoS One. 2018 Oct 4;13(10):e0205161. doi: 10.1371/journal.pone.0205161. eCollection 2018.

DOI:10.1371/journal.pone.0205161
PMID:30286186
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6171907/
Abstract

Decision making based on behavioral and neural observations of living systems has been extensively studied in brain science, psychology, neuroeconomics, and other disciplines. Decision-making mechanisms have also been experimentally implemented in physical processes, such as single photons and chaotic lasers. The findings of these experiments suggest that there is a certain common basis in describing decision making, regardless of its physical realizations. In this study, we propose a local reservoir model to account for choice-based learning (CBL). CBL describes decision consistency as a phenomenon where making a certain decision increases the possibility of making that same decision again later. This phenomenon has been intensively investigated in neuroscience, psychology, and other related fields. Our proposed model is inspired by the viewpoint that a decision is affected by its local environment, which is referred to as a local reservoir. If the size of the local reservoir is large enough, consecutive decision making will not be affected by previous decisions, thus showing lower degrees of decision consistency in CBL. In contrast, if the size of the local reservoir decreases, a biased distribution occurs within it, which leads to higher degrees of decision consistency in CBL. In this study, an analytical approach for characterizing local reservoirs is presented, as well as several numerical demonstrations. Furthermore, a physical architecture for CBL based on single photons is discussed, and the effects of local reservoirs are numerically demonstrated. Decision consistency in human decision-making tasks and in recruiting empirical data is evaluated based on the local reservoir. This foundation based on a local reservoir offers further insights into the understanding and design of decision making.

摘要

基于对生物系统的行为和神经观察的决策制定,已经在脑科学、心理学、神经经济学和其他学科中得到了广泛研究。决策机制也已经在物理过程中得到了实验实现,例如单光子和混沌激光。这些实验的结果表明,无论其物理实现如何,在描述决策方面都存在一定的共同基础。在本研究中,我们提出了一个局部储层模型来解释基于选择的学习(CBL)。CBL 将决策一致性描述为一种现象,即做出某个决策会增加以后再次做出相同决策的可能性。这种现象在神经科学、心理学和其他相关领域得到了深入研究。我们提出的模型受到了这样一种观点的启发,即决策受到其局部环境的影响,我们称之为局部储层。如果局部储层的大小足够大,连续的决策制定将不会受到先前决策的影响,因此在 CBL 中表现出较低的决策一致性程度。相反,如果局部储层的大小减小,其中会出现偏置分布,从而导致 CBL 中更高的决策一致性程度。在本研究中,提出了一种用于描述局部储层的分析方法,并进行了一些数值演示。此外,还讨论了基于单光子的 CBL 的物理架构,并进行了数值演示。根据局部储层评估了人类决策任务和招聘实证数据中的决策一致性。基于局部储层的这种基础为理解和设计决策提供了进一步的见解。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/c9e3b74a608a/pone.0205161.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/cb1fd54ce4ff/pone.0205161.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/a029a0b7f69d/pone.0205161.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/c420d10b22eb/pone.0205161.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/6d536670e693/pone.0205161.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/968daa815604/pone.0205161.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/c9e3b74a608a/pone.0205161.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/cb1fd54ce4ff/pone.0205161.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/a029a0b7f69d/pone.0205161.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/c420d10b22eb/pone.0205161.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/6d536670e693/pone.0205161.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/968daa815604/pone.0205161.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0cdc/6171907/c9e3b74a608a/pone.0205161.g006.jpg

相似文献

1
Why is the environment important for decision making? Local reservoir model for choice-based learning.为什么环境对决策很重要?基于选择的学习的局部水库模型。
PLoS One. 2018 Oct 4;13(10):e0205161. doi: 10.1371/journal.pone.0205161. eCollection 2018.
2
Post-response βγ power predicts the degree of choice-based learning in internally guided decision-making.反应后βγ 功率可预测内部引导决策中基于选择的学习程度。
Sci Rep. 2016 Aug 31;6:32477. doi: 10.1038/srep32477.
3
Statistical mechanics of reward-modulated learning in decision-making networks.决策网络中受奖励调节的学习的统计力学。
Neural Comput. 2012 May;24(5):1230-70. doi: 10.1162/NECO_a_00264. Epub 2012 Feb 1.
4
The drift diffusion model as the choice rule in reinforcement learning.强化学习中的选择规则——漂移扩散模型。
Psychon Bull Rev. 2017 Aug;24(4):1234-1251. doi: 10.3758/s13423-016-1199-y.
5
[Neural mechanisms of decision making].[决策的神经机制]
Brain Nerve. 2008 Sep;60(9):1017-27.
6
Computational modeling of choice-induced preference change: A Reinforcement-Learning-based approach.基于强化学习的选择诱导偏好变化的计算建模。
PLoS One. 2021 Jan 7;16(1):e0244434. doi: 10.1371/journal.pone.0244434. eCollection 2021.
7
[Mathematical models of decision making and learning].[决策与学习的数学模型]
Brain Nerve. 2008 Jul;60(7):791-8.
8
Reinforcement learning and decision making in monkeys during a competitive game.猴子在竞争性游戏中的强化学习与决策
Brain Res Cogn Brain Res. 2004 Dec;22(1):45-58. doi: 10.1016/j.cogbrainres.2004.07.007.
9
Multiple systems in decision making.决策中的多个系统。
Ann N Y Acad Sci. 2008 Apr;1128:53-62. doi: 10.1196/annals.1399.007.
10
Sure enough: efficient Bayesian learning and choice.果然:高效的贝叶斯学习与选择。
Anim Cogn. 2017 Sep;20(5):867-880. doi: 10.1007/s10071-017-1107-5. Epub 2017 Jul 1.

本文引用的文献

1
Ultrafast photonic reinforcement learning based on laser chaos.基于激光混沌的超快光子强化学习。
Sci Rep. 2017 Aug 18;7(1):8772. doi: 10.1038/s41598-017-08585-8.
2
How do the brain's time and space mediate consciousness and its different dimensions? Temporo-spatial theory of consciousness (TTC).大脑的时间和空间如何介导意识及其不同维度?意识的时空理论(TTC)。
Neurosci Biobehav Rev. 2017 Sep;80:630-645. doi: 10.1016/j.neubiorev.2017.07.013. Epub 2017 Jul 28.
3
Relation between choice-induced preference change and depression.
选择诱导的偏好改变与抑郁之间的关系。
PLoS One. 2017 Jun 29;12(6):e0180041. doi: 10.1371/journal.pone.0180041. eCollection 2017.
4
Learning, Reward, and Decision Making.学习、奖励与决策制定。
Annu Rev Psychol. 2017 Jan 3;68:73-100. doi: 10.1146/annurev-psych-010416-044216. Epub 2016 Sep 28.
5
Post-response βγ power predicts the degree of choice-based learning in internally guided decision-making.反应后βγ 功率可预测内部引导决策中基于选择的学习程度。
Sci Rep. 2016 Aug 31;6:32477. doi: 10.1038/srep32477.
6
Contrasting variability patterns in the default mode and sensorimotor networks balance in bipolar depression and mania.双相抑郁和躁狂中默认模式网络与感觉运动网络平衡的对比性变异性模式
Proc Natl Acad Sci U S A. 2016 Apr 26;113(17):4824-9. doi: 10.1073/pnas.1517558113. Epub 2016 Apr 11.
7
Single-photon decision maker.单光子决策器
Sci Rep. 2015 Aug 17;5:13253. doi: 10.1038/srep13253.
8
Autonomous mechanism of internal choice estimate underlies decision inertia.自主的内部选择估计机制是决策惯性的基础。
Neuron. 2014 Jan 8;81(1):195-206. doi: 10.1016/j.neuron.2013.10.018. Epub 2013 Dec 12.
9
I choose, therefore I like: preference for faces induced by arbitrary choice.我选择,所以我喜欢:任意选择引起的面孔偏好。
PLoS One. 2013 Aug 16;8(8):e72071. doi: 10.1371/journal.pone.0072071. eCollection 2013.
10
A single pair of interneurons commands the Drosophila feeding motor program.一对中间神经元即可指挥果蝇的摄食运动程序。
Nature. 2013 Jul 4;499(7456):83-7. doi: 10.1038/nature12208. Epub 2013 Jun 9.