Beylergil Sinem Balta, Beck Anne, Deserno Lorenz, Lorenz Robert C, Rapp Michael A, Schlagenhauf Florian, Heinz Andreas, Obermayer Klaus
Department of Software Engineering and Theoretical Computer Science, Technische Universität Berlin, 10587 Berlin, Germany; Bernstein Center for Computational Neuroscience Berlin, 10115 Berlin, Germany.
Department of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, 10117 Berlin, Germany.
Neuroimage Clin. 2017 Apr 17;15:80-94. doi: 10.1016/j.nicl.2017.04.010. eCollection 2017.
Substance-dependent individuals often lack the ability to adjust decisions flexibly in response to the changes in reward contingencies. Prediction errors (PEs) are thought to mediate flexible decision-making by updating the reward values associated with available actions. In this study, we explored whether the neurobiological correlates of PEs are altered in alcohol dependence. Behavioral, and functional magnetic resonance imaging (fMRI) data were simultaneously acquired from 34 abstinent alcohol-dependent patients (ADP) and 26 healthy controls (HC) during a probabilistic reward-guided decision-making task with dynamically changing reinforcement contingencies. A hierarchical Bayesian inference method was used to fit and compare learning models with different assumptions about the amount of task-related information subjects may have inferred during the experiment. Here, we observed that the best-fitting model was a modified Rescorla-Wagner type model, the "double-update" model, which assumes that subjects infer the knowledge that reward contingencies are anti-correlated, and integrate both actual and hypothetical outcomes into their decisions. Moreover, comparison of the best-fitting model's parameters showed that ADP were less sensitive to punishments compared to HC. Hence, decisions of ADP after punishments were loosely coupled with the expected reward values assigned to them. A correlation analysis between the model-generated PEs and the fMRI data revealed a reduced association between these PEs and the BOLD activity in the dorsolateral prefrontal cortex (DLPFC) of ADP. A hemispheric asymmetry was observed in the DLPFC when positive and negative PE signals were analyzed separately. The right DLPFC activity in ADP showed a reduced correlation with positive PEs. On the other hand, ADP, particularly the patients with high dependence severity, recruited the left DLPFC to a lesser extent than HC for processing negative PE signals. These results suggest that the DLPFC, which has been linked to adaptive control of action selection, may play an important role in cognitive inflexibility observed in alcohol dependence when reinforcement contingencies change. Particularly, the left DLPFC may contribute to this impaired behavioral adaptation, possibly by impeding the extinction of the actions that no longer lead to a reward.
物质依赖个体往往缺乏根据奖励意外情况的变化灵活调整决策的能力。预测误差(PEs)被认为通过更新与可用行动相关的奖励值来介导灵活的决策制定。在本研究中,我们探讨了酒精依赖患者中PEs的神经生物学相关性是否发生改变。在一项具有动态变化强化意外情况的概率奖励引导决策任务中,同时从34名戒酒的酒精依赖患者(ADP)和26名健康对照者(HC)获取了行为和功能磁共振成像(fMRI)数据。使用分层贝叶斯推理方法来拟合和比较关于受试者在实验期间可能推断出的任务相关信息量的不同假设的学习模型。在此,我们观察到最佳拟合模型是一种修改后的雷斯克拉 - 瓦格纳类型模型,即“双重更新”模型,该模型假设受试者推断奖励意外情况呈反相关的知识,并将实际和假设结果都纳入其决策中。此外,对最佳拟合模型参数的比较表明,与HC相比,ADP对惩罚的敏感性较低。因此,ADP在受到惩罚后的决策与分配给它们的预期奖励值的耦合较为松散。对模型生成的PEs与fMRI数据之间的相关性分析表明,这些PEs与ADP背外侧前额叶皮层(DLPFC)中的血氧水平依赖(BOLD)活动之间的关联减弱。当分别分析正性和负性PE信号时,在DLPFC中观察到半球不对称性。ADP右侧DLPFC活动与正性PEs的相关性降低。另一方面,ADP,特别是依赖严重程度高的患者,在处理负性PE信号时,与HC相比,较少募集左侧DLPFC。这些结果表明,与行动选择的适应性控制相关的DLPFC,在强化意外情况变化时酒精依赖中观察到的认知灵活性受损中可能起重要作用。特别是,左侧DLPFC可能通过阻碍不再导致奖励的行动的消退,导致这种行为适应受损。