Swiss Federal Institute of Technology (ETH) Zurich, Zurich, Switzerland.
Stanford University, Palo Alto, California.
Psychophysiology. 2018 Jan;55(1). doi: 10.1111/psyp.12911. Epub 2017 Jul 4.
Reinforcement learning refers to the acquisition of approach or avoidance action tendencies through repeated reward/nonreward feedback. Although much research on reinforcement learning has focused on the striatum, the prefrontal cortex likely modulates this process. Given prior research demonstrating a consistent pattern of lateralized frontal cortical activity in affective responses and approach/avoidance tendencies in the EEG literature, we aimed to elucidate the role of frontal EEG asymmetry in reinforcement learning. Thirty-two participants completed a probabilistic selection task in which they learned to select some targets and avoid others though correct/incorrect feedback. EEG indices of frontal cortical asymmetry were computed from alpha power recorded at baseline and during task completion. We also examined the feedback-related negativity ERP component to assess feedback processing associated with activity in the dorsal anterior cingulate cortex. Results revealed that greater right-lateralized frontal cortical activity during learning was associated with better avoidance learning, but neither left- nor right-sided asymmetry reliably related to approach learning. Results also suggested that left frontal activity may relate to reinforcement feedback processing, as indicated by the feedback-related negativity (FRN). These findings offer preliminary evidence regarding the role of frontal cortical activity in reinforcement learning while integrating classic and contemporary research on lateralized frontal cortical functions.
强化学习是指通过反复的奖励/非奖励反馈来获得趋近或回避行为倾向。尽管许多强化学习的研究都集中在纹状体上,但前额叶皮层可能调节了这个过程。鉴于先前的研究表明,在 EEG 文献中,情绪反应和趋近/回避倾向的额皮质活动存在一致的侧化模式,我们旨在阐明额 EEG 不对称在强化学习中的作用。32 名参与者完成了一项概率选择任务,通过正确/错误的反馈来学习选择一些目标并避免其他目标。从基线和任务完成期间记录的 alpha 功率计算额皮质不对称的 EEG 指数。我们还检查了反馈相关负波(feedback-related negativity,FRN)ERP 成分,以评估与背侧前扣带皮层活动相关的反馈处理。结果表明,学习过程中右侧额皮质活动增加与更好的回避学习相关,但左侧和右侧不对称均与趋近学习无关。结果还表明,左侧额皮质活动可能与强化反馈处理有关,这可以通过反馈相关负波(feedback-related negativity,FRN)来表示。这些发现提供了关于额皮质活动在强化学习中的作用的初步证据,同时整合了关于侧化额皮质功能的经典和当代研究。