• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

通过自然奖赏对多巴胺神经元的瞬时激活进行光遗传学模拟足以进行操作性强化。

Optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement.

机构信息

Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon, South Korea.

出版信息

PLoS One. 2012;7(4):e33612. doi: 10.1371/journal.pone.0033612. Epub 2012 Apr 10.

DOI:10.1371/journal.pone.0033612
PMID:22506004
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC3323614/
Abstract

Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than expected, a response which has been described as a "reward prediction error" (RPE). Although RPE drives reinforcement learning (RL) in computational models, it has not been possible to directly test whether the transient dopamine signal actually drives RL. Here we have performed optical stimulation of genetically targeted ventral tegmental area (VTA) dopamine neurons expressing Channelrhodopsin-2 (ChR2) in mice. We mimicked the transient activation of dopamine neurons that occurs in response to natural reward by applying a light pulse of 200 ms in VTA. When a single light pulse followed each self-initiated nose poke, it was sufficient in itself to cause operant reinforcement. Furthermore, when optical stimulation was delivered in separate sessions according to a predetermined pattern, it increased locomotion and contralateral rotations, behaviors that are known to result from activation of dopamine neurons. All three of the optically induced operant and locomotor behaviors were tightly correlated with the number of VTA dopamine neurons that expressed ChR2, providing additional evidence that the behavioral responses were caused by activation of dopamine neurons. These results provide strong evidence that the transient activation of dopamine neurons provides a functional reward signal that drives learning, in support of RL theories of dopamine function.

摘要

已知在前脑区域激活多巴胺受体数分钟或更长时间足以增强对刺激和动作的正强化。然而,在自然奖励事件之后,多巴胺神经元的放电率仅增加约 200 毫秒,这种反应被描述为“奖励预测误差”(RPE)。尽管 RPE 在计算模型中驱动强化学习(RL),但尚未能够直接测试瞬时多巴胺信号实际上是否驱动 RL。在这里,我们在表达 Channelrhodopsin-2(ChR2)的基因靶向腹侧被盖区(VTA)多巴胺神经元的小鼠中进行了光刺激。我们通过在 VTA 中施加 200ms 的光脉冲来模拟自然奖励所引起的多巴胺神经元的瞬时激活。当单个光脉冲在每个自我启动的鼻触之后立即出现时,它本身足以引起操作性强化。此外,当根据预定模式在单独的会话中进行光学刺激时,它会增加运动和对侧旋转,这两种行为已知是由多巴胺神经元的激活引起的。三种光诱导的操作性和运动行为都与表达 ChR2 的 VTA 多巴胺神经元的数量密切相关,这提供了额外的证据表明行为反应是由多巴胺神经元的激活引起的。这些结果提供了有力的证据,表明多巴胺神经元的瞬时激活提供了一种功能性的奖励信号,驱动学习,支持多巴胺功能的 RL 理论。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/5ee6bf85c5af/pone.0033612.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/94893de6e915/pone.0033612.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/356af8be8ce1/pone.0033612.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/972ff586e5b9/pone.0033612.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/344c6b13533f/pone.0033612.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/5ee6bf85c5af/pone.0033612.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/94893de6e915/pone.0033612.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/356af8be8ce1/pone.0033612.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/972ff586e5b9/pone.0033612.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/344c6b13533f/pone.0033612.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/fab8/3323614/5ee6bf85c5af/pone.0033612.g005.jpg

相似文献

1
Optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement.通过自然奖赏对多巴胺神经元的瞬时激活进行光遗传学模拟足以进行操作性强化。
PLoS One. 2012;7(4):e33612. doi: 10.1371/journal.pone.0033612. Epub 2012 Apr 10.
2
Role of dopamine projections from ventral tegmental area to nucleus accumbens and medial prefrontal cortex in reinforcement behaviors assessed using optogenetic manipulation.使用光遗传学操作评估腹侧被盖区至伏隔核和内侧前额叶皮质的多巴胺投射在强化行为中的作用。
Metab Brain Dis. 2017 Oct;32(5):1491-1502. doi: 10.1007/s11011-017-0023-3. Epub 2017 May 19.
3
Optogenetic interrogation of dopaminergic modulation of the multiple phases of reward-seeking behavior.光遗传学检测多巴胺能调制对寻求奖赏行为多个阶段的影响。
J Neurosci. 2011 Jul 27;31(30):10829-35. doi: 10.1523/JNEUROSCI.2246-11.2011.
4
Re-examining the role of ventral tegmental area dopaminergic neurons in motor activity and reinforcement by chemogenetic and optogenetic manipulation in mice.重新审视腹侧被盖区多巴胺能神经元在运动活动和强化中的作用,通过化学遗传学和光遗传学在小鼠中的操作。
Metab Brain Dis. 2019 Oct;34(5):1421-1430. doi: 10.1007/s11011-019-00442-z. Epub 2019 Jul 16.
5
From Prediction to Action: Dissociable Roles of Ventral Tegmental Area and Substantia Nigra Dopamine Neurons in Instrumental Reinforcement.从预测到行动:腹侧被盖区和黑质多巴胺神经元在工具性强化中的分离作用。
J Neurosci. 2023 May 24;43(21):3895-3908. doi: 10.1523/JNEUROSCI.0028-23.2023. Epub 2023 Apr 25.
6
Rewarding Effects of Optical Stimulation of Ventral Tegmental Area Glutamatergic Neurons.腹侧被盖区谷氨酸能神经元光刺激的奖赏效应
J Neurosci. 2015 Dec 2;35(48):15948-54. doi: 10.1523/JNEUROSCI.3428-15.2015.
7
Activation of Pedunculopontine Glutamate Neurons Is Reinforcing.脚桥谷氨酸能神经元的激活具有强化作用。
J Neurosci. 2017 Jan 4;37(1):38-46. doi: 10.1523/JNEUROSCI.3082-16.2016.
8
A dopaminergic reward prediction error signal shapes maternal behavior in mice.多巴胺能奖赏预测误差信号塑造了小鼠的母性行为。
Neuron. 2023 Feb 15;111(4):557-570.e7. doi: 10.1016/j.neuron.2022.11.019. Epub 2022 Dec 20.
9
Context-Dependent Multiplexing by Individual VTA Dopamine Neurons.个体 VTA 多巴胺神经元的上下文相关多路复用。
J Neurosci. 2020 Sep 23;40(39):7489-7509. doi: 10.1523/JNEUROSCI.0502-20.2020. Epub 2020 Aug 28.
10
The NeuroD6 Subtype of VTA Neurons Contributes to Psychostimulant Sensitization and Behavioral Reinforcement.腹侧被盖区的神经调节蛋白 6 亚型神经元有助于精神兴奋剂敏化和行为强化。
eNeuro. 2019 Jun 12;6(3). doi: 10.1523/ENEURO.0066-19.2019. Print 2019 May/Jun.

引用本文的文献

1
A brain-wide map of neural activity during complex behaviour.复杂行为期间全脑范围的神经活动图谱。
Nature. 2025 Sep;645(8079):177-191. doi: 10.1038/s41586-025-09235-0. Epub 2025 Sep 3.
2
Basolateral amygdala dopamine transmits a nonassociative emotional salience signal.基底外侧杏仁核多巴胺传递非联想性情绪显著性信号。
bioRxiv. 2025 May 16:2025.05.15.654323. doi: 10.1101/2025.05.15.654323.
3
Optogenetic Control of Dopamine Receptor 2 Reveals a Novel Aspect of Dopaminergic Neurotransmission in Motor Function.多巴胺受体2的光遗传学控制揭示了运动功能中多巴胺能神经传递的一个新方面。

本文引用的文献

1
Leptin regulates the reward value of nutrient.瘦素调节营养的奖赏价值。
Nat Neurosci. 2011 Nov 13;14(12):1562-8. doi: 10.1038/nn.2977.
2
Optogenetic interrogation of dopaminergic modulation of the multiple phases of reward-seeking behavior.光遗传学检测多巴胺能调制对寻求奖赏行为多个阶段的影响。
J Neurosci. 2011 Jul 27;31(30):10829-35. doi: 10.1523/JNEUROSCI.2246-11.2011.
3
Drug-driven AMPA receptor redistribution mimicked by selective dopamine neuron stimulation.选择性多巴胺能神经元刺激模拟药物驱动的 AMPA 受体重分布。
J Neurosci. 2025 Jan 1;45(1):e1473242024. doi: 10.1523/JNEUROSCI.1473-24.2024.
4
Pre-existing visual responses in a projection-defined dopamine population explain individual learning trajectories.预先存在的视觉反应在投影定义的多巴胺群体中解释个体学习轨迹。
Curr Biol. 2024 Nov 18;34(22):5349-5358.e6. doi: 10.1016/j.cub.2024.09.045. Epub 2024 Oct 16.
5
Temporal regularities shape perceptual decisions and striatal dopamine signals.时间规律塑造知觉决策和纹状体多巴胺信号。
Nat Commun. 2024 Aug 17;15(1):7093. doi: 10.1038/s41467-024-51393-8.
6
Cognitive representations of intracranial self-stimulation of midbrain dopamine neurons depend on stimulation frequency.中脑多巴胺神经元的颅内自我刺激的认知表现取决于刺激频率。
Nat Neurosci. 2024 Jul;27(7):1253-1259. doi: 10.1038/s41593-024-01643-1. Epub 2024 May 13.
7
Collaborative robots can augment human cognition in regret-sensitive tasks.协作机器人可以在对遗憾敏感的任务中增强人类认知。
PNAS Nexus. 2024 Jan 17;3(2):pgae016. doi: 10.1093/pnasnexus/pgae016. eCollection 2024 Feb.
8
A dopamine mechanism for reward maximization.多巴胺奖赏最大化机制。
Proc Natl Acad Sci U S A. 2024 May 14;121(20):e2316658121. doi: 10.1073/pnas.2316658121. Epub 2024 May 8.
9
Using rodent data to elucidate dopaminergic mechanisms of ADHD: Implications for human personality.利用啮齿动物数据阐明注意力缺陷多动障碍的多巴胺能机制:对人类个性的影响。
Personal Neurosci. 2024 Jan 31;7:e2. doi: 10.1017/pen.2023.12. eCollection 2024.
10
Sensory Cues Potentiate VTA Dopamine Mediated Reinforcement.感觉线索增强 VTA 多巴胺介导的强化。
eNeuro. 2024 Feb 15;11(2). doi: 10.1523/ENEURO.0421-23.2024. Print 2024 Feb.
PLoS One. 2010 Dec 31;5(12):e15870. doi: 10.1371/journal.pone.0015870.
4
Temporally extended dopamine responses to perceptually demanding reward-predictive stimuli.对感知要求高的奖励预测刺激的多巴胺反应具有时间延展性。
J Neurosci. 2010 Aug 11;30(32):10692-702. doi: 10.1523/JNEUROSCI.4828-09.2010.
5
Dopaminergic terminals in the nucleus accumbens but not the dorsal striatum corelease glutamate.伏隔核中的多巴胺能末梢而非背侧纹状体核心区共同释放谷氨酸。
J Neurosci. 2010 Jun 16;30(24):8229-33. doi: 10.1523/JNEUROSCI.1754-10.2010.
6
Glutamatergic signaling by mesolimbic dopamine neurons in the nucleus accumbens.中脑边缘多巴胺神经元在伏隔核中的谷氨酸能信号传递。
J Neurosci. 2010 May 19;30(20):7105-10. doi: 10.1523/JNEUROSCI.0265-10.2010.
7
Two types of dopamine neuron distinctly convey positive and negative motivational signals.两种类型的多巴胺神经元分别传递积极和消极的动机信号。
Nature. 2009 Jun 11;459(7248):837-41. doi: 10.1038/nature08028. Epub 2009 May 17.
8
Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning.多巴胺能神经元的相位性放电足以进行行为条件反射。
Science. 2009 May 22;324(5930):1080-4. doi: 10.1126/science.1168878. Epub 2009 Apr 23.
9
Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior.多巴胺神经元对N-甲基-D-天冬氨酸受体(NMDAR)依赖性爆发式放电的破坏为阶段性多巴胺依赖性行为提供了选择性评估。
Proc Natl Acad Sci U S A. 2009 May 5;106(18):7281-8. doi: 10.1073/pnas.0813415106. Epub 2009 Apr 2.
10
Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli.有害刺激对腹侧腹侧被盖区多巴胺神经元的阶段性兴奋作用。
Proc Natl Acad Sci U S A. 2009 Mar 24;106(12):4894-9. doi: 10.1073/pnas.0811507106. Epub 2009 Mar 4.