Eaton Ryan W, Libey Tyler, Fetz Eberhard E
Department of Physiology and Biophysics, University of Washington, Seattle, Washington.
Department of Bioengineering, University of Washington, Seattle, Washington; and.
J Neurophysiol. 2017 Mar 1;117(3):1112-1125. doi: 10.1152/jn.00423.2016. Epub 2016 Dec 28.
Operant conditioning of neural activity has typically been performed under controlled behavioral conditions using food reinforcement. This has limited the duration and behavioral context for neural conditioning. To reward cell activity in unconstrained primates, we sought sites in nucleus accumbens (NAc) whose stimulation reinforced operant responding. In three monkeys, NAc stimulation sustained performance of a manual target-tracking task, with response rates that increased monotonically with increasing NAc stimulation. We recorded activity of single motor cortex neurons and documented their modulation with wrist force. We conditioned increased firing rates with the monkey seated in the training booth and during free behavior in the cage using an autonomous head-fixed recording and stimulating system. Spikes occurring above baseline rates triggered single or multiple electrical pulses to the reinforcement site. Such rate-contingent, unit-triggered stimulation was made available for periods of 1-3 min separated by 3-10 min time-out periods. Feedback was presented as event-triggered clicks both in-cage and in-booth, and visual cues were provided in many in-booth sessions. In-booth conditioning produced increases in single neuron firing probability with intracranial reinforcement in 48 of 58 cells. Reinforced cell activity could rise more than five times that of non-reinforced activity. In-cage conditioning produced significant increases in 21 of 33 sessions. In-cage rate changes peaked later and lasted longer than in-booth changes, but were often comparatively smaller, between 13 and 18% above non-reinforced activity. Thus intracranial stimulation reinforced volitional increases in cortical firing rates during both free behavior and a controlled environment, although changes in the latter were more robust. Closed-loop brain-computer interfaces (BCI) were used to operantly condition increases in muscle and neural activity in monkeys by delivering activity-dependent stimuli to an intracranial reinforcement site (nucleus accumbens). We conditioned increased firing rates with the monkeys seated in a training booth and also, for the first time, during free behavior in a cage using an autonomous head-fixed BCI.
神经活动的操作性条件反射通常是在使用食物强化的受控行为条件下进行的。这限制了神经条件反射的持续时间和行为背景。为了奖励无约束灵长类动物的细胞活动,我们在伏隔核(NAc)中寻找刺激会强化操作性反应的位点。在三只猴子中,NAc刺激维持了手动目标跟踪任务的表现,反应率随NAc刺激增加而单调增加。我们记录了单个运动皮层神经元的活动,并记录了它们随腕力的调制情况。我们使用自主头戴式记录和刺激系统,在猴子坐在训练 booth 中以及在笼子里自由活动时,对增加的放电率进行条件反射。高于基线率出现的尖峰触发向强化位点发送单个或多个电脉冲。这种速率依赖、单位触发的刺激在1 - 3分钟的时间段内可用,间隔3 - 10分钟的超时时间段。反馈以笼内和 booth 内事件触发的咔嗒声呈现,并且在许多 booth 内实验中提供视觉线索。在 booth 内进行条件反射时,58个细胞中有48个细胞的单个神经元放电概率随着颅内强化而增加。强化后的细胞活动可以比未强化的活动增加超过五倍。在笼内进行条件反射时,33次实验中有21次出现显著增加。笼内速率变化达到峰值的时间比 booth 内变化晚,持续时间更长,但通常相对较小,比未强化活动高13%至18%。因此,颅内刺激在自由行为和受控环境中都强化了皮层放电率的自愿增加,尽管后者的变化更强烈。闭环脑机接口(BCI)被用于通过向颅内强化位点(伏隔核)传递与活动相关的刺激来操作性地调节猴子肌肉和神经活动的增加。我们使用自主头戴式BCI,在猴子坐在训练 booth 中时,以及首次在笼子里自由活动时,对增加的放电率进行条件反射。