Institute for Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Motivation, Brain and Behavior Lab, Paris Brain Institute (ICM), Pitié-Salpêtrière Hospital, Paris, France.
Nat Commun. 2023 Sep 4;14(1):5369. doi: 10.1038/s41467-023-41130-y.
Dopamine fundamentally contributes to reinforcement learning, but recent accounts also suggest a contribution to specific action selection mechanisms and the regulation of response vigour. Here, we examine dopaminergic mechanisms underlying human reinforcement learning and action selection via a combined pharmacological neuroimaging approach in male human volunteers (n = 31, within-subjects; Placebo, 150 mg of the dopamine precursor L-dopa, 2 mg of the D2 receptor antagonist Haloperidol). We found little credible evidence for previously reported beneficial effects of L-dopa vs. Haloperidol on learning from gains and altered neural prediction error signals, which may be partly due to differences experimental design and/or drug dosages. Reinforcement learning drift diffusion models account for learning-related changes in accuracy and response times, and reveal consistent decision threshold reductions under both drugs, in line with the idea that lower dosages of D2 receptor antagonists increase striatal DA release via an autoreceptor-mediated feedback mechanism. These results are in line with the idea that dopamine regulates decision thresholds during reinforcement learning, and may help to bridge action selection and response vigor accounts of dopamine.
多巴胺从根本上有助于强化学习,但最近的研究表明,它也有助于特定的动作选择机制和反应力度的调节。在这里,我们通过对男性人类志愿者(n=31,被试内)的联合药理学神经影像学方法,研究了多巴胺能机制在人类强化学习和动作选择中的作用,实验使用了多巴胺前体 L-多巴(150mg)和 D2 受体拮抗剂氟哌啶醇(2mg)。我们几乎没有可信的证据表明 L-多巴与氟哌啶醇在从收益中学习以及改变神经预测误差信号方面具有先前报道的有益作用,这可能部分是由于实验设计和/或药物剂量的差异。强化学习漂移扩散模型解释了准确性和反应时间相关的学习变化,并揭示了两种药物下一致的决策阈值降低,这与低剂量 D2 受体拮抗剂通过自受体介导的反馈机制增加纹状体 DA 释放的观点一致。这些结果与多巴胺在强化学习期间调节决策阈值的观点一致,并可能有助于弥合动作选择和多巴胺反应力度的解释。