Suppr超能文献

血清素神经元通过不确定性来调节学习率。

Serotonin neurons modulate learning rate through uncertainty.

机构信息

The Solomon H. Snyder Department of Neuroscience, Brain Science Institute, Kavli Neuroscience Discovery Institute, The Johns Hopkins University School of Medicine, 725 N. Wolfe Street, Baltimore, MD 21205, USA.

The Solomon H. Snyder Department of Neuroscience, Brain Science Institute, Kavli Neuroscience Discovery Institute, The Johns Hopkins University School of Medicine, 725 N. Wolfe Street, Baltimore, MD 21205, USA.

出版信息

Curr Biol. 2022 Feb 7;32(3):586-599.e7. doi: 10.1016/j.cub.2021.12.006. Epub 2021 Dec 21.

Abstract

Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes. Under these conditions, theories propose that uncertainty can be used to modulate learning rates ("meta-learning"). We show that mice behaving in a dynamic foraging task exhibit choice behavior that varied as a function of two forms of uncertainty estimated from a meta-learning model. The activity of dorsal raphe serotonin neurons tracked both types of uncertainty in the foraging task as well as in a dynamic Pavlovian task. Reversible inhibition of serotonin neurons in the foraging task reproduced changes in learning predicted by a simulated lesion of meta-learning in the model. We thus provide a quantitative link between serotonin neuron activity, learning, and decision making.

摘要

调节学习速度对于灵活行为至关重要。在稳定的环境中,对行为后果的学习应该较慢,但当环境发生变化时,学习速度应该加快。在行为与结果之间存在噪声关系的环境中,识别稳定性和检测变化是困难的。在这些条件下,理论提出不确定性可以用来调节学习率(“元学习”)。我们表明,在动态觅食任务中表现行为的老鼠表现出的选择行为随着从元学习模型估计的两种不确定性形式而变化。中缝背核 5-羟色胺神经元的活动在觅食任务中以及在动态巴甫洛夫任务中都跟踪了这两种类型的不确定性。在觅食任务中可逆抑制 5-羟色胺神经元,再现了模型中元学习模拟损伤预测的学习变化。因此,我们提供了 5-羟色胺神经元活动、学习和决策之间的定量联系。

相似文献

1
Serotonin neurons modulate learning rate through uncertainty.血清素神经元通过不确定性来调节学习率。
Curr Biol. 2022 Feb 7;32(3):586-599.e7. doi: 10.1016/j.cub.2021.12.006. Epub 2021 Dec 21.
6
Reward Contributions to Serotonergic Functions.奖赏对血清素能功能的贡献。
Annu Rev Neurosci. 2020 Jul 8;43:141-162. doi: 10.1146/annurev-neuro-093019-112252.
7
Learning and Stress Shape the Reward Response Patterns of Serotonin Neurons.学习与压力塑造血清素神经元的奖赏反应模式。
J Neurosci. 2017 Sep 13;37(37):8863-8875. doi: 10.1523/JNEUROSCI.1181-17.2017. Epub 2017 Aug 8.

引用本文的文献

本文引用的文献

1
Stan: A Probabilistic Programming Language.斯坦:一种概率编程语言。
J Stat Softw. 2017;76. doi: 10.18637/jss.v076.i01. Epub 2017 Jan 11.
5
How Outcome Uncertainty Mediates Attention, Learning, and Decision-Making.结果不确定性如何影响注意力、学习和决策。
Trends Neurosci. 2020 Oct;43(10):795-809. doi: 10.1016/j.tins.2020.06.009. Epub 2020 Jul 28.
9
A distributional code for value in dopamine-based reinforcement learning.多巴胺基强化学习中的价值分布代码。
Nature. 2020 Jan;577(7792):671-675. doi: 10.1038/s41586-019-1924-6. Epub 2020 Jan 15.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验