Department of Psychological Science, The University of Vermont, 2 Colchester Avenue, Burlington, VT 05405, USA.
Krikstone Laboratory for the Behavioral Sciences, Department of Psychology, Saint Michael's College, One Winooski Park, Box 193, Colchester, VT 05439, USA.
Behav Brain Res. 2022 Feb 10;418:113636. doi: 10.1016/j.bbr.2021.113636. Epub 2021 Oct 20.
Early in instrumental learning, behavior is goal-directed and sensitive to changes in the value of the instrumental outcome. With sufficient repetition, responding becomes insensitive to changes in outcome value, or habitual. We have previously found that females transition into habit over a distinct range of training from 120 to 160 reinforced responses. This low level of instrumental training is markedly less than what has been shown to support habitual responding in male rats. To begin to investigate the early development of habit in females, we conducted a series of experiments in which we pretreated female rats with methamphetamine (METH) with the aim of sensitizing central dopamine, a major modulator of striatal function, prior to instrumental nose-poke training at the beginning and at the endpoint of the transition range in females. Following training, we tested for sensitivity to reinforcer devaluation (RD), which was conducted by repeatedly pairing reinforcers previously earned during training with lithium chloride (LiCl)-induced illness. As a counterpoint, a series of similar experiments was conducted separately in male rats. Additionally, in order to ascertain the validity of using nose-poke as an instrumental response, we compared sensitivity to devaluation between the Pavlovian approach towards the food magazine and the nose-poke response. In females, Vehicle groups responded in a habitual manner at both training levels (120 and 160 reinforced responses), whereas METH groups remained sensitive to devaluation. This suggests that increasing central dopamine delays habit formation in female rats. In male rats, Vehicle groups demonstrated goal-directed responding following training with 120 and 320 reinforced responses, and marginally goal-directed responding,with 160. METH-pretreated males were sensitive to devaluation at the 120 and 160 training levels, however, following more extended training to 320 reinforced responses, METH-pretreated males responded in a habitual manner, indicating that increasing central dopamine can advance habit formation in male rats. Overall, these results suggest that METH pretreatment maintains goal-directed responding in female rats when they are typically transitioning to habitual control of instrumental behavior and can advance habit formation in male rats given sufficient instrumental training. In addition, we found differential RD sensitivity of the nose-poke response used during instrumental training compared to Pavlovian approach towards the food magazine, confirming that there is a distinction between these two behaviors and that nose-poking is a valid instrumental response.
在工具性学习的早期,行为是有目标导向的,并且对工具性结果的价值变化敏感。随着重复的增加,反应对结果价值的变化变得不敏感,即习惯化。我们之前发现,雌性动物在经过 120 到 160 次强化反应的训练后,会从明显的训练范围过渡到习惯化。这种低水平的工具性训练明显少于支持雄性大鼠习惯化反应的训练水平。为了开始研究雌性动物习惯化的早期发展,我们进行了一系列实验,在雌性动物开始和结束过渡范围的工具性鼻触训练之前,用 methamphetamine(METH)预处理雌性大鼠,旨在敏化中央多巴胺,中央多巴胺是纹状体功能的主要调节剂。在训练后,我们通过反复将训练期间获得的强化物与锂盐(LiCl)引起的疾病配对,来测试对强化物贬值(RD)的敏感性。作为对比,我们在雄性大鼠中单独进行了一系列类似的实验。此外,为了确定使用鼻触作为工具性反应的有效性,我们比较了食物槽的 Pavlovian 方法和鼻触反应的贬值敏感性。在雌性大鼠中,Vehicle 组在 120 和 160 个强化反应的训练水平上均以习惯化的方式反应,而 METH 组对贬值仍敏感。这表明增加中央多巴胺会延迟雌性大鼠的习惯形成。在雄性大鼠中,Vehicle 组在 120 和 320 个强化反应的训练后表现出有目标导向的反应,而在 160 个强化反应的训练后表现出轻微的有目标导向的反应。METH 预处理的雄性大鼠在 120 和 160 个训练水平上对贬值敏感,但在经过更长时间的 320 个强化反应的训练后,METH 预处理的雄性大鼠以习惯化的方式反应,表明增加中央多巴胺可以促进雄性大鼠的习惯形成。总的来说,这些结果表明,在雌性大鼠通常过渡到习惯控制工具性行为时,METH 预处理可以维持有目标导向的反应,并且在给予足够的工具性训练时,METH 预处理可以促进雄性大鼠的习惯形成。此外,我们发现,在工具性训练期间使用的鼻触反应与食物槽的 Pavlovian 方法对 RD 的敏感性存在差异,这证实了这两种行为之间存在区别,并且鼻触是一种有效的工具性反应。