Suppr超能文献

偶发性焦虑对强化学习的难以捉摸的影响。

The elusive effects of incidental anxiety on reinforcement-learning.

作者信息

Ting Chih-Chung, Palminteri Stefano, Lebreton Maël, Engelmann Jan B

机构信息

Center for Research in Experimental Economics and political Decision Making (CREED), Amsterdam School of Economics (ASE), Universiteit van Amsterdam.

Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM.

出版信息

J Exp Psychol Learn Mem Cogn. 2022 May;48(5):619-642. doi: 10.1037/xlm0001033. Epub 2021 Sep 13.

Abstract

Anxiety is a common affective state, characterized by the subjectively unpleasant feelings of dread over an anticipated event. Anxiety is suspected to have important negative consequences on cognition, decision-making, and learning. Yet, despite a recent surge in studies investigating the specific effects of anxiety on reinforcement-learning, no coherent picture has emerged. Here, we investigated the effects of incidental anxiety on instrumental reinforcement-learning, while addressing several issues and defaults identified in a focused literature review. We used a rich experimental design, featuring both a learning and a transfer phase, and a manipulation of outcomes valence (gains vs losses). In two variants (N = 2 × 50) of this experimental paradigm, incidental anxiety was induced with an established threat-of-shock paradigm. Model-free results show that incidental anxiety effects seem limited to a small, but specific increase in postlearning performance measured by a transfer task. A comprehensive modeling effort revealed that, irrespective of the effects of anxiety, individuals give more weight to positive than negative outcomes, and tend to experience the omission of a loss as a gain (and vice versa). However, in line with results from our targeted literature survey, isolating specific computational effects of anxiety on learning per se proved to be challenging. Overall, our results suggest that learning mechanisms are more complex than traditionally presumed, and raise important concerns about the robustness of the effects of anxiety previously identified in simple reinforcement-learning studies. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

摘要

焦虑是一种常见的情感状态,其特征是对预期事件产生主观上不愉快的恐惧情绪。人们怀疑焦虑会对认知、决策和学习产生重要的负面影响。然而,尽管最近对焦虑对强化学习的具体影响的研究激增,但尚未形成一个连贯的图景。在这里,我们研究了偶发性焦虑对工具性强化学习的影响,同时解决了在一篇重点文献综述中确定的几个问题和缺陷。我们采用了丰富的实验设计,包括学习阶段和迁移阶段,以及对结果效价(收益与损失)的操纵。在这个实验范式的两个变体(N = 2 × 50)中,通过既定的电击威胁范式诱发偶发性焦虑。无模型结果表明,偶发性焦虑的影响似乎仅限于通过迁移任务测量的学习后表现的小幅但特定的提高。一项全面的建模研究表明,无论焦虑的影响如何,个体对积极结果的重视程度高于消极结果,并且倾向于将避免损失视为一种收益(反之亦然)。然而,与我们有针对性的文献调查结果一致,分离焦虑对学习本身的特定计算影响被证明具有挑战性。总体而言,我们的结果表明学习机制比传统假设的更为复杂,并引发了对先前在简单强化学习研究中确定的焦虑影响的稳健性的重要担忧。(PsycInfo数据库记录(c)2022美国心理学会,保留所有权利)

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验