Gueguen Margot, Cutler Jo, Drew Daniel, Apps Matthew A J, Jeyaretna Deva Sanjeeva, Husain Masud, Manohar Sanjay G, Lockwood Patricia L
Centre for Human Brain Health, School of Psychology, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK.
Institute for Mental Health, School of Psychology, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK.
Brain. 2025 Feb 11. doi: 10.1093/brain/awaf056.
Reinforcement learning is a fundamental process for how humans and other animals attain rewards for themselves. However, to act prosocially, we must also learn how our choices reward others. The ventromedial prefrontal cortex has been independently linked to reinforcement learning and prosocial behaviour, yet its causal impact on prosocial reinforcement learning and the roles of its multiple subregions remain unknown. Here, a large group of adults with rare focal ventromedial prefrontal cortex damage (n=28), and two carefully age- and gender-matched control groups (lesions elsewhere, n=21; healthy controls, n=124) completed a reinforcement learning task where they learnt to win rewards for another person (prosocial), for themselves (self), or in a control condition where participants saw points but they were not translated into rewards for either individual (no one, control condition) on separate trials. A novel computational model which incorporated separate learning rates for positive and negative prediction errors best explained behaviour in all groups. Importantly, compared to both control groups, patients with ventromedial prefrontal cortex damage were less accurate and had lower learning rates from positive prediction errors when rewarding another person relative to when no one benefitted, and higher learning rates for negative prediction errors when learning for others relative to self. Unlike controls, ventromedial prefrontal cortex lesion patients also showed a reduced self-benefitting advantage. They were equally accurate and learnt at a similar rate from positive prediction errors for self and neither individual. Strikingly, voxel-based lesion-symptom mapping revealed that damage to subgenual anterior cingulate cortex and anterior cingulate cortex gyrus specifically disrupted prosocial reinforcement learning. These findings highlight the importance of ventromedial prefrontal cortex integrity for multiple aspects of reinforcement learning, with damage to subgenual anterior cingulate cortex and anterior cingulate cortex gyrus critical for learning to reward others.
强化学习是人类和其他动物为自己获取奖励的基本过程。然而,要做出亲社会行为,我们还必须了解我们的选择如何使他人获得奖励。腹内侧前额叶皮层已被独立地与强化学习和亲社会行为联系起来,但其对亲社会强化学习的因果影响及其多个亚区域的作用仍不清楚。在这里,一大组患有罕见局灶性腹内侧前额叶皮层损伤的成年人(n = 28),以及两个年龄和性别仔细匹配的对照组(其他部位损伤,n = 21;健康对照组,n = 124)完成了一项强化学习任务,在该任务中,他们学会为他人(亲社会)、为自己(自我)赢得奖励,或者在一种对照条件下,参与者看到分数,但这些分数不会转化为任何一方的奖励(无人受益,对照条件),在不同的试验中进行。一个结合了正、负预测误差的单独学习率的新颖计算模型最能解释所有组的行为。重要的是,与两个对照组相比,腹内侧前额叶皮层损伤的患者在奖励他人时相对于无人受益时,准确性较低,从正预测误差中学习的速率较低,而在为他人学习时相对于为自己学习时,从负预测误差中学习的速率较高。与对照组不同,腹内侧前额叶皮层损伤的患者也表现出自我受益优势的降低。他们在为自己和无人受益时从正预测误差中学习的准确性相同,学习速率也相似。引人注目的是,基于体素的损伤-症状映射显示,膝下前扣带回皮层和前扣带回皮层回的损伤特别破坏了亲社会强化学习。这些发现突出了腹内侧前额叶皮层完整性对强化学习多个方面的重要性,膝下前扣带回皮层和前扣带回皮层回的损伤对于学习奖励他人至关重要。