Department of Neuroscience, Brown University, Providence, RI 02912, USA; Carney Institute for Brain Science, Brown University, Providence, RI 02912, USA.
Department of Cognitive Linguistics & Psychological Sciences, Brown University, Providence, RI 02912, USA; Carney Institute for Brain Science, Brown University, Providence, RI 02912, USA.
Cell. 2021 May 13;184(10):2733-2749.e16. doi: 10.1016/j.cell.2021.03.046. Epub 2021 Apr 15.
Significant evidence supports the view that dopamine shapes learning by encoding reward prediction errors. However, it is unknown whether striatal targets receive tailored dopamine dynamics based on regional functional specialization. Here, we report wave-like spatiotemporal activity patterns in dopamine axons and release across the dorsal striatum. These waves switch between activational motifs and organize dopamine transients into localized clusters within functionally related striatal subregions. Notably, wave trajectories were tailored to task demands, propagating from dorsomedial to dorsolateral striatum when rewards are contingent on animal behavior and in the opponent direction when rewards are independent of behavioral responses. We propose a computational architecture in which striatal dopamine waves are sculpted by inference about agency and provide a mechanism to direct credit assignment to specialized striatal subregions. Supporting model predictions, dorsomedial dopamine activity during reward-pursuit signaled the extent of instrumental control and interacted with reward waves to predict future behavioral adjustments.
大量证据支持这样一种观点,即多巴胺通过编码奖励预测误差来塑造学习。然而,尚不清楚纹状体的靶点是否会根据区域功能专业化接收定制的多巴胺动力学。在这里,我们报告了多巴胺轴突和释放的波状时空活动模式跨越背侧纹状体。这些波在激活模式之间切换,并将多巴胺瞬变组织成功能相关的纹状体亚区中的局部簇。值得注意的是,波轨迹适应任务需求,当奖励取决于动物行为时,从背侧中侧向背外侧纹状体传播,而当奖励与行为反应无关时,传播方向相反。我们提出了一种计算架构,其中纹状体多巴胺波是通过对代理权的推断来塑造的,并提供了一种将信用分配给专门的纹状体亚区的机制。支持模型预测,在追求奖励期间,背侧多巴胺活动表明了工具控制的程度,并与奖励波相互作用,以预测未来的行为调整。