Dalton Gemma L, Wang Nena Y, Phillips Anthony G, Floresco Stan B
Department of Psychology and Brain Research Center, University of British Columbia, Vancouver, British Columbia V6T 1Z4, Canada.
Department of Psychology and Brain Research Center, University of British Columbia, Vancouver, British Columbia V6T 1Z4, Canada
J Neurosci. 2016 Feb 10;36(6):1996-2006. doi: 10.1523/JNEUROSCI.3366-15.2016.
Different subregions of the prefrontal cortex (PFC) contribute to the ability to respond flexibly to changes in reward contingencies, with the medial versus orbitofrontal cortex (OFC) subregions contributing differentially to processes such as set-shifting and reversal learning. To date, the manner in which these regions may facilitate reversal learning in situations involving reward uncertainty remains relatively unexplored. We investigated the involvement of five distinct regions of the rat OFC (lateral and medial) and medial PFC (prelimbic, infralimbic, and anterior cingulate) on probabilistic reversal learning wherein "correct" versus "incorrect" responses were rewarded on 80% and 20% of trials, respectively. Contingencies were reversed repeatedly within a session. In well trained rats, inactivation of the medial or lateral OFC induced dissociable impairments in performance (indexed by fewer reversals completed) when outcomes were probabilistic, but not when they were assured. Medial OFC inactivation impaired probabilistic learning during the first discrimination, increased perseverative responding and reduced sensitivity to positive and negative feedback, suggestive of a deficit in incorporating information about previous action outcomes to guide subsequent behavior. Lateral OFC inactivation preferentially impaired performance during reversal phases. In contrast, prelimbic inactivation caused an apparent improvement in performance by increasing the number of reversals completed. This was associated with enhanced sensitivity to recently rewarded actions and reduced sensitivity to negative feedback. Infralimbic inactivation had no effect, whereas the anterior cingulate appeared to play a permissive role in this form of reversal learning. These results clarify the dissociable contributions of different regions of the frontal lobes to probabilistic learning.
The ability to adjust behavior in response to changes involving uncertain or probabilistic reward contingencies is an essential survival skill that is impaired in a variety of psychiatric disorders. It is well established that different forms of cognitive flexibility are mediated by anatomically distinct regions of the frontal lobes when reinforcement contingencies are assured, however, less is known about the contribution of these regions to probabilistic reinforcement learning. Here we show that different regions of the orbitofrontal and medial prefrontal cortex make distinct contributions to probabilistic reversal learning. These findings provide novel information about the complex interplay between frontal lobe regions in mediating these processes and accordingly provide insight into possible pathophysiology that underlies impairments in cognitive flexibility observed in mental illnesses.
前额叶皮层(PFC)的不同亚区域有助于灵活应对奖励意外情况的变化,其中内侧前额叶皮层与眶额皮层(OFC)亚区域对诸如定势转换和逆向学习等过程的贡献有所不同。迄今为止,在涉及奖励不确定性的情况下,这些区域促进逆向学习的方式仍相对未被探索。我们研究了大鼠OFC的五个不同区域(外侧和内侧)以及内侧PFC(前边缘区、下边缘区和前扣带回)在概率性逆向学习中的参与情况,其中在80%和20%的试验中分别对“正确”和“错误”反应给予奖励。在一个实验环节中,意外情况反复反转。在训练有素的大鼠中,当结果具有概率性时,内侧或外侧OFC失活会导致表现出现可分离的损伤(以完成的反转次数减少为指标),但当结果确定时则不会。内侧OFC失活会损害首次辨别期间的概率性学习,增加持续性反应,并降低对正性和负性反馈的敏感性,这表明在整合关于先前行动结果的信息以指导后续行为方面存在缺陷。外侧OFC失活在反转阶段优先损害表现。相比之下,前边缘区失活通过增加完成的反转次数导致表现明显改善。这与对近期获得奖励的行动的敏感性增强以及对负性反馈的敏感性降低有关。下边缘区失活没有影响,而前扣带回似乎在这种形式的逆向学习中起允许作用。这些结果阐明了额叶不同区域对概率性学习的可分离贡献。
根据涉及不确定或概率性奖励意外情况的变化来调整行为的能力是一项基本的生存技能,在多种精神疾病中会受损。当强化意外情况确定时,不同形式的认知灵活性由额叶在解剖学上不同的区域介导,这一点已得到充分证实,然而,关于这些区域对概率性强化学习的贡献知之甚少。在这里,我们表明眶额皮层和内侧前额叶皮层的不同区域对概率性逆向学习有不同贡献。这些发现提供了关于额叶区域在介导这些过程中复杂相互作用的新信息,因此为精神疾病中观察到的认知灵活性受损背后可能的病理生理学提供了见解。