School of Psychological Sciences, University of Melbourne, Melbourne, Victoria, Australia.
Department of Neuroscience, University of Minnesota, Minneapolis, MN, 55455, USA.
Neurosci Biobehav Rev. 2021 Jun;125:466-477. doi: 10.1016/j.neubiorev.2021.02.039. Epub 2021 Feb 28.
Adapting to the changing environment is a key component of optimal decision-making. Internal-models that accurately represent and selectively update from behaviorally relevant/salient stimuli may facilitate adaptive behaviors. Anterior cingulate cortex (ACC) and dopaminergic systems may produce these adaptive internal-models through selective updates from behaviorally relevant stimuli. Dysfunction of ACC and dopaminergic systems could therefore produce misaligned internal-models where updates are disproportionate to the salience of the cues. An aspect of addictive-like behaviors is reduced adaptation and, ACC and dopaminergic systems typically exhibit dysfunction in drug-dependents. We argue that ACC and dopaminergic dysfunction in dependents may produce misaligned internal-models such that drug-related stimuli are misattributed with a higher salience compared to non-drug related stimuli. Hence, drug-related rewarding stimuli generate over-weighted updates to the internal-model, while negative feedback and non-drug related rewarding stimuli generate down-weighted updates. This misaligned internal-model may therefore incorrectly reinforce maladaptive drug-related behaviors. We use the proposed framework to discuss ways behavior may be made more adaptive and how the framework may be supported or falsified experimentally.
适应不断变化的环境是做出最佳决策的关键组成部分。能够准确表示并选择性地从行为相关/显著刺激中更新的内部模型可能有助于适应性行为。前扣带皮层（ACC）和多巴胺能系统可能通过从行为相关刺激中进行选择性更新来产生这些适应性内部模型。因此，ACC 和多巴胺能系统的功能障碍可能会导致内部模型的不匹配，其中更新与线索的显着性不成比例。成瘾样行为的一个方面是适应性降低，而 ACC 和多巴胺能系统在药物依赖者中通常表现出功能障碍。我们认为，依赖者的 ACC 和多巴胺能功能障碍可能会产生不匹配的内部模型，使得与药物相关的刺激被错误归因于比非药物相关刺激更高的显着性。因此，与药物相关的奖励刺激会对内部模型进行过度加权更新，而负面反馈和非药物相关的奖励刺激会进行加权下调。因此，这种不匹配的内部模型可能会错误地强化适应不良的与药物相关的行为。我们使用提出的框架来讨论如何使行为更具适应性，以及该框架如何在实验中得到支持或反驳。
