Computational Psychiatry Research, Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatric Hospital, University of Zurich, Lenggstrasse 31, Zurich 8032, Switzerland; Neuroscience Centre Zurich, University of Zurich, Winterthurerstrasse 190, Zürich 8057, Switzerland.
Computational Psychiatry Research, Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatric Hospital, University of Zurich, Lenggstrasse 31, Zurich 8032, Switzerland; Neuroscience Centre Zurich, University of Zurich, Winterthurerstrasse 190, Zürich 8057, Switzerland; Institute of Computer Science, University of Bern, Neubrückstrasse 10, Bern 3012, Switzerland.
Neuroimage. 2022 Nov;263:119579. doi: 10.1016/j.neuroimage.2022.119579. Epub 2022 Aug 20.
Survival in biological environments requires learning associations between predictive sensory cues and threatening outcomes. Such aversive learning may be implemented through reinforcement learning algorithms that are driven by the signed difference between expected and encountered outcomes, termed prediction errors (PEs). While PE-based learning is well established for reward learning, the role of putative PE signals in aversive learning is less clear. Here, we used functional magnetic resonance imaging in humans (21 healthy men and women) to investigate the neural representation of PEs during maintenance of learned aversive associations. Four visual cues, each with a different probability (0, 33, 66, 100%) of being followed by an aversive outcome (electric shock), were repeatedly presented to participants. We found that neural activity at omission (US-) but not occurrence of the aversive outcome (US+) encoded PEs in the medial prefrontal cortex. More expected omission of aversive outcome was associated with lower neural activity. No neural signals fulfilled axiomatic criteria, which specify necessary and sufficient components of PE signals, for signed PE representation in a whole-brain search or in a-priori regions of interest. Our results might suggest that, different from reward learning, aversive learning does not involve signed PE signals that are represented within the same brain region for all conditions.
在生物环境中生存需要学习预测性感觉线索与威胁性结果之间的关联。这种厌恶学习可能通过强化学习算法来实现,这些算法由预期和遇到的结果之间的符号差异驱动,称为预测误差 (PE)。虽然基于 PE 的学习在奖励学习中得到了很好的证明,但在厌恶学习中潜在的 PE 信号的作用并不明确。在这里,我们使用功能性磁共振成像 (fMRI) 在人类(21 名健康男性和女性)中研究了在习得的厌恶关联保持过程中,PE 的神经表示。四个视觉提示,每个提示的出现概率(0、33、66、100%)都不同,都伴随着厌恶的结果(电击)。我们发现,在中前额叶皮层中,神经活动在厌恶结果的省略(US-)而不是出现(US+)时编码了 PE。更期望的厌恶结果的省略与更低的神经活动相关。在全脑搜索或先验感兴趣区中,没有神经信号满足指定 PE 信号的必要和充分组成部分的公理标准,用于表示符号 PE。我们的结果可能表明,与奖励学习不同,厌恶学习不涉及在所有条件下都在同一脑区表示的符号 PE 信号。