Suppr超能文献

奖励和惩罚在引导行为方面起着截然不同的作用。

Reward and punishment act as distinct factors in guiding behavior.

作者信息

Kubanek Jan, Snyder Lawrence H, Abrams Richard A

机构信息

Department of Anatomy and Neurobiology, Washington University School of Medicine, St. Louis, MO 63110, USA.

Department of Anatomy and Neurobiology, Washington University School of Medicine, St. Louis, MO 63110, USA.

出版信息

Cognition. 2015 Jun;139:154-67. doi: 10.1016/j.cognition.2015.03.005. Epub 2015 Mar 28.

Abstract

Behavior rests on the experience of reinforcement and punishment. It has been unclear whether reinforcement and punishment act as oppositely valenced components of a single behavioral factor, or whether these two kinds of outcomes play fundamentally distinct behavioral roles. To this end, we varied the magnitude of a reward or a penalty experienced following a choice using monetary tokens. The outcome of each trial was independent of the outcome of the previous trial, which enabled us to isolate and study the effect on behavior of each outcome magnitude in single trials. We found that a reward led to a repetition of the previous choice, whereas a penalty led to an avoidance of the previous choice. Surprisingly, the effects of the reward magnitude and the penalty magnitude revealed a pronounced asymmetry. The choice repetition effect of a reward scaled with the magnitude of the reward. In a marked contrast, the avoidance effect of a penalty was flat, not influenced by the magnitude of the penalty. These effects were mechanistically described using a reinforcement learning model after the model was updated to account for the penalty-based asymmetry. The asymmetry in the effects of the reward magnitude and the punishment magnitude was so striking that it is difficult to conceive that one factor is just a weighted or transformed form of the other factor. Instead, the data suggest that rewards and penalties are fundamentally distinct factors in governing behavior.

摘要

行为取决于强化和惩罚的体验。目前尚不清楚强化和惩罚是作为单一行为因素的具有相反效价的组成部分,还是这两种结果在行为中发挥着根本不同的作用。为此,我们使用货币代币改变了选择后所体验到的奖励或惩罚的大小。每次试验的结果都独立于前一次试验的结果,这使我们能够在单次试验中分离并研究每个结果大小对行为的影响。我们发现奖励会导致重复前一次的选择,而惩罚会导致避免前一次的选择。令人惊讶的是,奖励大小和惩罚大小的影响显示出明显的不对称性。奖励的选择重复效应随奖励大小而变化。与之形成鲜明对比的是,惩罚的回避效应是平缓的,不受惩罚大小的影响。在对强化学习模型进行更新以解释基于惩罚的不对称性之后,使用该模型从机制上描述了这些效应。奖励大小和惩罚大小的效应中的不对称性非常显著,以至于很难想象一个因素只是另一个因素的加权或变换形式。相反,数据表明奖励和惩罚在行为控制中是根本不同的因素。

相似文献

1
Reward and punishment act as distinct factors in guiding behavior.
Cognition. 2015 Jun;139:154-67. doi: 10.1016/j.cognition.2015.03.005. Epub 2015 Mar 28.
2
The effects of response-cost punishment on instructional control during a choice task.
J Exp Anal Behav. 2013 May;99(3):346-61. doi: 10.1002/jeab.20. Epub 2013 Feb 13.
3
Decision-making in ADHD: sensitive to frequency but blind to the magnitude of penalty?
J Child Psychol Psychiatry. 2008 Jul;49(7):712-22. doi: 10.1111/j.1469-7610.2008.01910.x. Epub 2008 Jul 1.
4
Reward and avoidance learning in the context of aversive environments and possible implications for depressive symptoms.
Psychopharmacology (Berl). 2019 Aug;236(8):2437-2449. doi: 10.1007/s00213-019-05299-9. Epub 2019 Jun 28.
5
Impaired decision making in oppositional defiant disorder related to altered psychophysiological responses to reinforcement.
Biol Psychiatry. 2010 Aug 15;68(4):337-44. doi: 10.1016/j.biopsych.2009.12.037. Epub 2010 Mar 31.
6
Effects of reward and punishment on learning from errors in smokers.
Drug Alcohol Depend. 2018 Jul 1;188:32-38. doi: 10.1016/j.drugalcdep.2018.03.028. Epub 2018 Apr 30.
7
Event-related components of the punishment and reward sensitivity.
Clin Neurophysiol. 2010 Jan;121(1):60-76. doi: 10.1016/j.clinph.2009.10.004. Epub 2009 Nov 8.
8
Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning.
Soc Cogn Affect Neurosci. 2015 Sep;10(9):1219-27. doi: 10.1093/scan/nsv007. Epub 2015 Feb 12.
9
How we learn to make decisions: rapid propagation of reinforcement learning prediction errors in humans.
J Cogn Neurosci. 2014 Mar;26(3):635-44. doi: 10.1162/jocn_a_00509. Epub 2013 Oct 29.

引用本文的文献

1
Sensorimotor faculties bias choice behavior.
Front Psychol. 2025 Mar 28;16:1432996. doi: 10.3389/fpsyg.2025.1432996. eCollection 2025.
2
Differential discounting of past and future gains and losses in individuals in recovery from substance use disorder.
Exp Clin Psychopharmacol. 2025 Jun;33(3):291-299. doi: 10.1037/pha0000769. Epub 2025 Mar 3.
3
When is a causal illusion an illusion? Separating discriminability and bias in human contingency judgements.
Q J Exp Psychol (Hove). 2024 Nov 19;78(9):17470218241293418. doi: 10.1177/17470218241293418.
4
Don't Give-Up: Why some intervention schemes encourage suboptimal behavior.
Psychon Bull Rev. 2025 Feb;32(1):363-372. doi: 10.3758/s13423-024-02537-w. Epub 2024 Jul 23.
5
Decision-making style explains the withdrawal behavior of shy individuals: evidence from Chinese college students.
Front Psychol. 2023 Dec 22;14:1292096. doi: 10.3389/fpsyg.2023.1292096. eCollection 2023.
8
Primary rewards and aversive outcomes have comparable effects on attentional bias.
Behav Neurosci. 2023 Apr;137(2):89-94. doi: 10.1037/bne0000543. Epub 2022 Dec 15.
9
Serotonin modulates asymmetric learning from reward and punishment in healthy human volunteers.
Commun Biol. 2022 Aug 12;5(1):812. doi: 10.1038/s42003-022-03690-5.
10
Assessing behavioural profiles following neutral, positive and negative feedback.
PLoS One. 2022 Jul 5;17(7):e0270475. doi: 10.1371/journal.pone.0270475. eCollection 2022.

本文引用的文献

1
Two dimensions of value: dopamine neurons represent reward but not aversiveness.
Science. 2013 Aug 2;341(6145):546-9. doi: 10.1126/science.1238699.
2
A low-frequency oscillatory neural signal in humans encodes a developing decision variable.
Neuroimage. 2013 Dec;83:795-808. doi: 10.1016/j.neuroimage.2013.06.085. Epub 2013 Jul 18.
4
Losses as modulators of attention: review and analysis of the unique effects of losses over gains.
Psychol Bull. 2013 Mar;139(2):497-518. doi: 10.1037/a0029383. Epub 2012 Jul 23.
5
Comparison of decision learning models using the generalization criterion method.
Cogn Sci. 2008 Dec;32(8):1376-402. doi: 10.1080/03640210802352992.
6
Token reinforcement: a review and analysis.
J Exp Anal Behav. 2009 Mar;91(2):257-86. doi: 10.1901/jeab.2009.91-257.
7
Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game.
J Neurosci. 2009 Jun 3;29(22):7278-89. doi: 10.1523/JNEUROSCI.1479-09.2009.
8
Asymmetry of reinforcement and punishment in human choice.
J Exp Anal Behav. 2008 Mar;89(2):157-67. doi: 10.1901/jeab.2008.89-157.
9
Behavioral dopamine signals.
Trends Neurosci. 2007 May;30(5):203-10. doi: 10.1016/j.tins.2007.03.007. Epub 2007 Apr 2.
10
Choice, changeover, and travel: A quantitative model.
J Exp Anal Behav. 1991 Jan;55(1):47-61. doi: 10.1901/jeab.1991.55-47.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验