Kirsch Janina A, Vlachos Ioannis, Hausmann Markus, Rose Jonas, Yim Man Yi, Aertsen Ad, Güntürkün Onur
Department of Biopsychology, Institute of Cognitive Neuroscience, Faculty of Psychology, Ruhr-University Bochum, 44780 Bochum, Germany.
Behav Brain Res. 2009 Mar 2;198(1):214-23. doi: 10.1016/j.bbr.2008.11.010. Epub 2008 Nov 12.
Forebrain association areas interweave perceived stimuli with acquired representations of own actions and their outcome. Often, relevant stimuli come in a bewildering variety of shapes and sizes and we slowly have to learn to group them into meaningful categories. Therefore, the aim of the present study was twofold: First, to reveal how single units in the pigeon's nidopallium caudolaterale (NCL), a functional analogue of the mammalian prefrontal cortex (PFC), encode stimuli that differ in visual features but not in behavioral relevance. The second aim was to understand how these categorical representations are established during learning. Recordings were made from NCL neurons while pigeons performed a go-nogo categorization paradigm. Responses during presentation of the two S+ stimuli and non-responding during presentation of the two S- stimuli were followed by reward. We recorded from two pigeons at different learning stages. In the beginning of the learning process, neurons were active during and shortly before reward, but only in go trials. These data suggest that during the early phase of learning avian 'prefrontal' neurons code for rewards associated with the same behavioral demand, while ignoring feature differences of stimuli within one category. When learning progressed, (1) category selectivity became stronger, (2) responses selective for nogo stimuli appeared, and (3) reward-related responses disappeared in favor of category-selective responses during the stimulus phase. This backward shift in time resembles response patterns assumed by the temporal difference (TD) model of reinforcement learning, but goes beyond it, since it reflects the neuronal correlate of functional categories.
前脑联合区域将感知到的刺激与自身动作及其结果的习得表征交织在一起。通常,相关刺激呈现出令人眼花缭乱的各种形状和大小,我们必须慢慢学会将它们归类为有意义的类别。因此,本研究的目的有两个:第一,揭示鸽子尾外侧巢皮质(NCL)(哺乳动物前额叶皮质(PFC)的功能类似物)中的单个神经元如何编码视觉特征不同但行为相关性相同的刺激。第二个目的是了解这些分类表征在学习过程中是如何建立的。在鸽子执行“去/不去”分类范式时,对NCL神经元进行记录。在呈现两个S+刺激时做出反应,在呈现两个S-刺激时不做出反应,随后给予奖励。我们在不同学习阶段对两只鸽子进行了记录。在学习过程开始时,神经元在奖励期间及奖励前不久活跃,但仅在“去”试验中如此。这些数据表明,在学习的早期阶段,鸟类“前额叶”神经元编码与相同行为需求相关的奖励,同时忽略同一类别内刺激的特征差异。随着学习的进展,(1)类别选择性变得更强,(2)出现了对“不去”刺激有选择性的反应,并且(3)在刺激阶段,与奖励相关的反应消失,转而支持类别选择性反应。这种时间上的向后转移类似于强化学习的时间差(TD)模型假设的反应模式,但又超越了它,因为它反映了功能类别的神经元相关性。