• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

联想学习的统一概率观

A Unifying Probabilistic View of Associative Learning.

作者信息

Gershman Samuel J

机构信息

Department of Psychology and Center for Brain Science, Harvard University, Cambridge, Massachusetts, United States of America.

出版信息

PLoS Comput Biol. 2015 Nov 4;11(11):e1004567. doi: 10.1371/journal.pcbi.1004567. eCollection 2015 Nov.

DOI:10.1371/journal.pcbi.1004567
PMID:26535896
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC4633133/
Abstract

Two important ideas about associative learning have emerged in recent decades: (1) Animals are Bayesian learners, tracking their uncertainty about associations; and (2) animals acquire long-term reward predictions through reinforcement learning. Both of these ideas are normative, in the sense that they are derived from rational design principles. They are also descriptive, capturing a wide range of empirical phenomena that troubled earlier theories. This article describes a unifying framework encompassing Bayesian and reinforcement learning theories of associative learning. Each perspective captures a different aspect of associative learning, and their synthesis offers insight into phenomena that neither perspective can explain on its own.

摘要

近几十年来,关于联想学习出现了两个重要观点:(1)动物是贝叶斯学习者,会追踪它们对联想的不确定性;(2)动物通过强化学习获得长期奖励预测。从它们源自合理设计原则的意义上来说,这两个观点都是规范性的。它们也是描述性的,涵盖了困扰早期理论的广泛实证现象。本文描述了一个统一框架,该框架包含联想学习的贝叶斯理论和强化学习理论。每个视角都捕捉到了联想学习的一个不同方面,它们的综合为两种视角各自都无法单独解释的现象提供了见解。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/518bd1315637/pcbi.1004567.g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/df63a4a4deab/pcbi.1004567.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/5a47ca763734/pcbi.1004567.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/ce392055ec3a/pcbi.1004567.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/02f32e8747d3/pcbi.1004567.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/44c67bd89bc5/pcbi.1004567.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/5cd574b2dbc6/pcbi.1004567.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/b8bc80939278/pcbi.1004567.g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/518bd1315637/pcbi.1004567.g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/df63a4a4deab/pcbi.1004567.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/5a47ca763734/pcbi.1004567.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/ce392055ec3a/pcbi.1004567.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/02f32e8747d3/pcbi.1004567.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/44c67bd89bc5/pcbi.1004567.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/5cd574b2dbc6/pcbi.1004567.g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/b8bc80939278/pcbi.1004567.g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/c0a8/4633133/518bd1315637/pcbi.1004567.g008.jpg

相似文献

1
A Unifying Probabilistic View of Associative Learning.联想学习的统一概率观
PLoS Comput Biol. 2015 Nov 4;11(11):e1004567. doi: 10.1371/journal.pcbi.1004567. eCollection 2015 Nov.
2
Rational inattention and tonic dopamine.理性忽视与基础多巴胺。
PLoS Comput Biol. 2021 Mar 24;17(3):e1008659. doi: 10.1371/journal.pcbi.1008659. eCollection 2021 Mar.
3
Bayesian methods for addressing long-standing problems in associative learning: The case of PREE.用于解决联想学习中长期存在问题的贝叶斯方法:预测性强化预期(PREE)的案例
Q J Exp Psychol (Hove). 2018 Sep;71(9):1844-1859. doi: 10.1080/17470218.2017.1358292. Epub 2018 Jan 1.
4
With or without you: predictive coding and Bayesian inference in the brain.有你或没有你:大脑中的预测编码和贝叶斯推理。
Curr Opin Neurobiol. 2017 Oct;46:219-227. doi: 10.1016/j.conb.2017.08.010. Epub 2017 Sep 21.
5
Methods of comparing associative models and an application to retrospective revaluation.比较联想模型的方法及其在回顾性重评估中的应用。
Behav Processes. 2017 Nov;144:20-32. doi: 10.1016/j.beproc.2017.08.004. Epub 2017 Aug 19.
6
Probabilistic associative learning suffices for learning the temporal structure of multiple sequences.概率联想学习足以学习多个序列的时间结构。
PLoS One. 2019 Aug 1;14(8):e0220161. doi: 10.1371/journal.pone.0220161. eCollection 2019.
7
Explaining compound generalization in associative and causal learning through rational principles of dimensional generalization.通过维度泛化的理性原则解释联想学习和因果学习中的复合泛化。
Psychol Rev. 2014 Jul;121(3):526-58. doi: 10.1037/a0037018.
8
Dopamine, prediction error and associative learning: a model-based account.多巴胺、预测误差与联想学习:基于模型的解释
Network. 2006 Mar;17(1):61-84. doi: 10.1080/09548980500361624.
9
The "proactive" model of learning: Integrative framework for model-free and model-based reinforcement learning utilizing the associative learning-based proactive brain concept.学习的“主动”模型:利用基于联想学习的主动大脑概念的无模型和基于模型的强化学习综合框架。
Behav Neurosci. 2016 Feb;130(1):6-18. doi: 10.1037/bne0000116.
10
Neural Computations Underlying Causal Structure Learning.因果结构学习的神经计算。
J Neurosci. 2018 Aug 8;38(32):7143-7157. doi: 10.1523/JNEUROSCI.3336-17.2018. Epub 2018 Jun 29.

引用本文的文献

1
Data-driven equation discovery reveals nonlinear reinforcement learning in humans.数据驱动的方程发现揭示了人类的非线性强化学习。
Proc Natl Acad Sci U S A. 2025 Aug 5;122(31):e2413441122. doi: 10.1073/pnas.2413441122. Epub 2025 Jul 31.
2
Interference Underlies Attenuation upon Relearning in Sensorimotor Adaptation.干扰是感觉运动适应再学习时衰减的基础。
eNeuro. 2025 Jun 26;12(6). doi: 10.1523/ENEURO.0132-25.2025. Print 2025 Jun.
3
A neurally constrained computational model of context-dependent fear extinction recall and relapse.

本文引用的文献

1
Universal Approximation Using Radial-Basis-Function Networks.使用径向基函数网络的通用逼近
Neural Comput. 1991 Summer;3(2):246-257. doi: 10.1162/neco.1991.3.2.246.
2
Explaining compound generalization in associative and causal learning through rational principles of dimensional generalization.通过维度泛化的理性原则解释联想学习和因果学习中的复合泛化。
Psychol Rev. 2014 Jul;121(3):526-58. doi: 10.1037/a0037018.
3
The penumbra of learning: a statistical theory of synaptic tagging and capture.学习的半影:突触标记和捕获的统计理论。
一种与情境相关的恐惧消退回忆和复发的神经约束计算模型。
Commun Biol. 2025 Apr 26;8(1):668. doi: 10.1038/s42003-025-08107-7.
4
Schemas, reinforcement learning and the medial prefrontal cortex.图式、强化学习与内侧前额叶皮质
Nat Rev Neurosci. 2025 Mar;26(3):141-157. doi: 10.1038/s41583-024-00893-z. Epub 2025 Jan 7.
5
Predictive learning shapes the representational geometry of the human brain.预测性学习塑造了人类大脑的表象几何结构。
Nat Commun. 2024 Nov 8;15(1):9670. doi: 10.1038/s41467-024-54032-4.
6
Animal affect, welfare and the Bayesian brain.动物情感、福利与贝叶斯大脑。
Anim Welf. 2024 Oct 8;33:e39. doi: 10.1017/awf.2024.44. eCollection 2024.
7
Both probability and rate of reinforcement can affect the acquisition and maintenance of conditioned responses.强化的概率和速率均可影响条件反应的获得和维持。
J Exp Psychol Anim Learn Cogn. 2024 Oct;50(4):254-266. doi: 10.1037/xan0000386.
8
Habituation as optimal filtering.习惯化作为最佳过滤
iScience. 2024 Jul 16;27(8):110523. doi: 10.1016/j.isci.2024.110523. eCollection 2024 Aug 16.
9
Forward and backward blocking in statistical learning.统计学习中的前向和后向阻断。
PLoS One. 2024 Aug 5;19(8):e0306797. doi: 10.1371/journal.pone.0306797. eCollection 2024.
10
Surprise-minimization as a solution to the structural credit assignment problem.将惊喜最小化作为解决结构性信用分配问题的一种方法。
PLoS Comput Biol. 2024 May 28;20(5):e1012175. doi: 10.1371/journal.pcbi.1012175. eCollection 2024 May.
Network. 2014;25(3):97-115. doi: 10.3109/0954898X.2013.862749. Epub 2014 Mar 28.
4
Time representation in reinforcement learning models of the basal ganglia.基底神经节强化学习模型中的时间表示。
Front Comput Neurosci. 2014 Jan 9;7:194. doi: 10.3389/fncom.2013.00194. eCollection 2014.
5
Probabilistic brains: knowns and unknowns.概率大脑:已知与未知。
Nat Neurosci. 2013 Sep;16(9):1170-8. doi: 10.1038/nn.3495. Epub 2013 Aug 18.
6
Evaluating the TD model of classical conditioning.评估经典条件作用的TD模型。
Learn Behav. 2012 Sep;40(3):305-19. doi: 10.3758/s13420-012-0082-6.
7
Exploring a latent cause theory of classical conditioning.探索经典条件作用的潜在原因理论。
Learn Behav. 2012 Sep;40(3):255-68. doi: 10.3758/s13420-012-0080-8.
8
Knowing how much you don't know: a neural organization of uncertainty estimates. 知道自己的无知程度:不确定性估计的神经组织。
Nat Rev Neurosci. 2012 Jul 11;13(8):572-86. doi: 10.1038/nrn3289.
9
A computational framework for the study of confidence in humans and animals.用于研究人类和动物信心的计算框架。
Philos Trans R Soc Lond B Biol Sci. 2012 May 19;367(1594):1322-37. doi: 10.1098/rstb.2012.0037.
10
How can a Bayesian approach inform neuroscience?贝叶斯方法如何为神经科学提供信息?
Eur J Neurosci. 2012 Apr;35(7):1169-79. doi: 10.1111/j.1460-9568.2012.08010.x.