Suppr超能文献

基于模型的树搜索中的证据整合。

Evidence integration in model-based tree search.

作者信息

Solway Alec, Botvinick Matthew M

机构信息

Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544;

Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08544; Department of Psychology, Princeton University, Princeton, NJ 08544; Google DeepMind, London EC4A 3TW, United Kingdom.

出版信息

Proc Natl Acad Sci U S A. 2015 Sep 15;112(37):11708-13. doi: 10.1073/pnas.1505483112. Epub 2015 Aug 31.

Abstract

Research on the dynamics of reward-based, goal-directed decision making has largely focused on simple choice, where participants decide among a set of unitary, mutually exclusive options. Recent work suggests that the deliberation process underlying simple choice can be understood in terms of evidence integration: Noisy evidence in favor of each option accrues over time, until the evidence in favor of one option is significantly greater than the rest. However, real-life decisions often involve not one, but several steps of action, requiring a consideration of cumulative rewards and a sensitivity to recursive decision structure. We present results from two experiments that leveraged techniques previously applied to simple choice to shed light on the deliberation process underlying multistep choice. We interpret the results from these experiments in terms of a new computational model, which extends the evidence accumulation perspective to multiple steps of action.

摘要

基于奖励的目标导向决策动态研究主要集中在简单选择上,即参与者在一组单一、相互排斥的选项中进行决策。最近的研究表明,简单选择背后的审议过程可以通过证据整合来理解:支持每个选项的嘈杂证据会随着时间积累,直到支持一个选项的证据明显大于其他选项。然而,现实生活中的决策通常涉及不止一个行动步骤,需要考虑累积奖励并对递归决策结构保持敏感。我们展示了两项实验的结果,这些实验利用了先前应用于简单选择的技术,以阐明多步选择背后的审议过程。我们根据一个新的计算模型来解释这些实验的结果,该模型将证据积累的观点扩展到多个行动步骤。

相似文献

1
Evidence integration in model-based tree search.基于模型的树搜索中的证据整合。
Proc Natl Acad Sci U S A. 2015 Sep 15;112(37):11708-13. doi: 10.1073/pnas.1505483112. Epub 2015 Aug 31.
7
Benchmarking for Bayesian Reinforcement Learning.贝叶斯强化学习的基准测试
PLoS One. 2016 Jun 15;11(6):e0157088. doi: 10.1371/journal.pone.0157088. eCollection 2016.
10
Learning the opportunity cost of time in a patch-foraging task.在斑块觅食任务中了解时间的机会成本。
Cogn Affect Behav Neurosci. 2015 Dec;15(4):837-53. doi: 10.3758/s13415-015-0350-y.

引用本文的文献

2
A low-dimensional approximation of optimal confidence.最优置信的低维逼近。
PLoS Comput Biol. 2024 Jul 24;20(7):e1012273. doi: 10.1371/journal.pcbi.1012273. eCollection 2024 Jul.
3
Transitions in cognitive evolution.认知进化的转变。
Proc Biol Sci. 2023 Jul 12;290(2002):20230671. doi: 10.1098/rspb.2023.0671. Epub 2023 Jul 5.
5
Neural Mechanisms That Make Perceptual Decisions Flexible.使知觉决策灵活的神经机制。
Annu Rev Physiol. 2023 Feb 10;85:191-215. doi: 10.1146/annurev-physiol-031722-024731. Epub 2022 Nov 7.
6
A weighted constraint satisfaction approach to human goal-directed decision making.一种加权约束满足方法用于人类目标导向决策。
PLoS Comput Biol. 2022 Jun 16;18(6):e1009553. doi: 10.1371/journal.pcbi.1009553. eCollection 2022 Jun.
7
Conflict and competition between model-based and model-free control.基于模型和无模型控制之间的冲突和竞争。
PLoS Comput Biol. 2022 May 5;18(5):e1010047. doi: 10.1371/journal.pcbi.1010047. eCollection 2022 May.
8
Rational use of cognitive resources in human planning.人类规划中的认知资源的合理利用。
Nat Hum Behav. 2022 Aug;6(8):1112-1125. doi: 10.1038/s41562-022-01332-8. Epub 2022 Apr 28.
9
Decision prioritization and causal reasoning in decision hierarchies.决策层次中的决策优先级排序和因果推理。
PLoS Comput Biol. 2021 Dec 31;17(12):e1009688. doi: 10.1371/journal.pcbi.1009688. eCollection 2021 Dec.
10
Advances in modeling learning and decision-making in neuroscience.神经科学中学习和决策建模的进展。
Neuropsychopharmacology. 2022 Jan;47(1):104-118. doi: 10.1038/s41386-021-01126-y. Epub 2021 Aug 27.

本文引用的文献

1
Interplay of approximate planning strategies.近似规划策略的相互作用。
Proc Natl Acad Sci U S A. 2015 Mar 10;112(10):3098-103. doi: 10.1073/pnas.1414219112. Epub 2015 Feb 9.
2
Optimal behavioral hierarchy.最佳行为层次结构。
PLoS Comput Biol. 2014 Aug 14;10(8):e1003779. doi: 10.1371/journal.pcbi.1003779. eCollection 2014 Aug.
5
Working-memory capacity protects model-based learning from stress.工作记忆容量能保护基于模型的学习免受压力影响。
Proc Natl Acad Sci U S A. 2013 Dec 24;110(52):20941-6. doi: 10.1073/pnas.1312011110. Epub 2013 Dec 9.
7
Goals and habits in the brain.大脑中的目标和习惯。
Neuron. 2013 Oct 16;80(2):312-25. doi: 10.1016/j.neuron.2013.09.007.

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验