多巴胺调节觅食过程中的动态决策。
Dopamine Modulates Dynamic Decision-Making during Foraging.
机构信息
Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX39DU, United Kingdom
New Zealand Brain Research Institute, Christchurch 8011, New Zealand.
出版信息
J Neurosci. 2020 Jul 1;40(27):5273-5282. doi: 10.1523/JNEUROSCI.2586-19.2020. Epub 2020 May 26.
The mesolimbic dopaminergic system exerts a crucial influence on incentive processing. However, the contribution of dopamine in dynamic, ecological situations where reward rates vary, and decisions evolve over time, remains unclear. In such circumstances, current (foreground) reward accrual needs to be compared continuously with potential rewards that could be obtained by traveling elsewhere (background reward rate), to determine the opportunity cost of staying versus leaving. We hypothesized that dopamine specifically modulates the influence of background, but not foreground, reward information when making a dynamic comparison of these variables for optimal behavior. On a novel foraging task based on an ecological account of animal behavior (marginal value theorem), human participants of either sex decided when to leave locations in situations where foreground rewards depleted at different rates, either in rich or poor environments with high or low background reward rates. In line with theoretical accounts, people's decisions to move from current locations were independently modulated by changes in both foreground and background reward rates. Pharmacological manipulation of dopamine D2 receptor activity using the agonist cabergoline significantly affected decisions to move on, specifically modulating the effect of background reward rates. In particular, when on cabergoline, people left patches in poor environments much earlier. These results demonstrate a role of dopamine in signaling the opportunity cost of rewards, not value per se. Using this ecologically derived framework, we uncover a specific mechanism by which D2 dopamine receptor activity modulates decision-making when foreground and background reward rates are dynamically compared. Many decisions, across economic, political, and social spheres, involve choices to "leave". Such decisions depend on a continuous comparison of a current location's value, with that of other locations you could move on to. However, how the brain makes such decisions is poorly understood. Here, we developed a computerized task, based around theories of how animals make decisions to move on when foraging for food. Healthy human participants had to decide when to leave collecting financial rewards in a location, and travel to collect rewards elsewhere. Using a pharmacological manipulation, we show that the activity of dopamine in the brain modulates decisions to move on, with people valuing other locations differently depending on their dopaminergic state.
中脑边缘多巴胺系统对激励加工有至关重要的影响。然而,在奖励率变化且决策随时间演变的动态、生态环境中,多巴胺的作用仍不清楚。在这种情况下,需要不断将当前(前景)奖励积累与通过前往其他地方获得的潜在奖励(背景奖励率)进行比较,以确定停留与离开的机会成本。我们假设,多巴胺专门调节背景奖励信息的影响,而不是前景奖励信息,以在这两种变量之间进行动态比较,从而实现最佳行为。在一项基于动物行为生态理论(边际价值定理)的新型觅食任务中,男性和女性的人类参与者在前景奖励以不同速度耗尽的情况下,决定何时离开当前位置,实验环境要么是奖励丰富的环境,要么是奖励贫瘠的环境,背景奖励率要么高,要么低。与理论假设一致,人们从当前位置移动的决定受到前景和背景奖励率变化的独立调节。使用激动剂卡麦角林对多巴胺 D2 受体活性进行药物操作,显著影响了人们继续移动的决定,具体调节了背景奖励率的影响。具体而言,服用卡麦角林时,人们会更早地离开贫瘠环境中的斑块。这些结果表明,多巴胺在信号传递奖励的机会成本方面发挥作用,而不是奖励本身的价值。使用这种源自生态学的框架,我们揭示了 D2 多巴胺受体活性在动态比较前景和背景奖励率时调节决策的特定机制。在经济、政治和社会领域的许多决策都涉及到“离开”的选择。这些决策取决于对当前位置价值与您可以继续前往的其他位置价值的持续比较。然而,大脑如何做出这样的决策仍知之甚少。在这里,我们开发了一种基于动物在觅食时决定继续前进的理论的计算机化任务。健康的人类参与者必须决定何时离开一个位置来收集金融奖励,然后前往其他地方收集奖励。通过药物操作,我们表明大脑中的多巴胺活动调节了继续前进的决定,人们根据自己的多巴胺状态对其他位置的价值有不同的看法。