Suppr超能文献

奖励强化会产生持久的目标导向行为促进作用。

Reward Reinforcement Creates Enduring Facilitation of Goal-directed Behavior.

机构信息

University of California, Riverside.

New York University.

出版信息

J Cogn Neurosci. 2024 Dec 1;36(12):2847-2862. doi: 10.1162/jocn_a_02150.

Abstract

Stimulus-response habits benefit behavior by automatizing the selection of rewarding actions. However, this automaticity can come at the cost of reduced flexibility to adapt behavior when circumstances change. The goal-directed system is thought to counteract the habit system by providing the flexibility to pursue context-appropriate behaviors. The dichotomy between habitual action selection and flexible goal-directed behavior has recently been challenged by findings showing that rewards bias both action and goal selection. Here, we test whether reward reinforcement can give rise to habitual goal selection much as it gives rise to habitual action selection. We designed a rewarded, context-based perceptual discrimination task in which performance on one rule was reinforced. Using drift-diffusion models and psychometric analyses, we found that reward facilitates the initiation and execution of rules. Strikingly, we found that these biases persisted in a test phase in which rewards were no longer available. Although this facilitation is consistent with the habitual goal selection hypothesis, we did not find evidence that reward reinforcement reduced cognitive flexibility to implement alternative rules. Together, the findings suggest that reward creates a lasting impact on the selection and execution of goals but may not lead to the inflexibility characteristic of habits. Our findings demonstrate the role of the reward learning system in influencing how the goal-directed system selects and implements goals.

摘要

刺激-反应习惯通过自动化奖励动作的选择来使行为受益。然而,这种自动性可能会降低行为适应环境变化的灵活性。目标导向系统被认为可以通过提供追求情境适当行为的灵活性来对抗习惯系统。习惯行为选择和灵活的目标导向行为之间的二分法最近受到挑战,因为研究结果表明奖励会偏向于行动和目标选择。在这里,我们测试奖励强化是否可以像引起习惯性动作选择那样引起习惯性目标选择。我们设计了一个基于奖励的、基于上下文的感知辨别任务,其中一个规则的表现得到了强化。使用漂移扩散模型和心理测量分析,我们发现奖励促进了规则的启动和执行。引人注目的是,我们发现这些偏差在没有奖励的测试阶段仍然存在。尽管这种促进与习惯性目标选择假说一致,但我们没有发现证据表明奖励强化会降低执行替代规则的认知灵活性。总的来说,这些发现表明奖励会对目标的选择和执行产生持久的影响,但可能不会导致习惯的特征——缺乏灵活性。我们的研究结果表明,奖励学习系统在影响目标导向系统选择和实施目标方面起着重要作用。

相似文献

3
Habits, action sequences and reinforcement learning.习惯、动作序列和强化学习。
Eur J Neurosci. 2012 Apr;35(7):1036-51. doi: 10.1111/j.1460-9568.2012.08050.x.
4
Some factors that restore goal-direction to a habitual behavior.一些使习惯性行为恢复目标导向的因素。
Neurobiol Learn Mem. 2020 Mar;169:107161. doi: 10.1016/j.nlm.2020.107161. Epub 2020 Jan 9.
5
Delayed rewards facilitate habit formation.延迟奖励有助于习惯养成。
J Exp Psychol Anim Learn Cogn. 2019 Oct;45(4):413-421. doi: 10.1037/xan0000221. Epub 2019 Aug 1.
8
Measuring habit formation through goal-directed response switching.通过目标导向的反应转换来衡量习惯形成。
J Exp Psychol Gen. 2020 Aug;149(8):1449-1459. doi: 10.1037/xge0000722. Epub 2019 Nov 21.

本文引用的文献

1
The Role of Executive Function in Shaping Reinforcement Learning.执行功能在塑造强化学习中的作用。
Curr Opin Behav Sci. 2021 Apr;38:66-73. doi: 10.1016/j.cobeha.2020.10.003. Epub 2020 Nov 14.
2
Can Approaching Anxiety Like a Habit Lead to Novel Treatments?将焦虑视为一种习惯来应对能否带来新的治疗方法?
Am J Lifestyle Med. 2021 Apr 27;15(5):489-494. doi: 10.1177/15598276211008144. eCollection 2021 Sep-Oct.
5
Context-sensitive valuation and learning.情境敏感估值与学习
Curr Opin Behav Sci. 2021 Oct;41:122-127. doi: 10.1016/j.cobeha.2021.05.001. Epub 2021 Jun 9.
9
Habit, choice, and addiction.习惯、选择和成瘾。
Neuropsychopharmacology. 2021 Mar;46(4):689-698. doi: 10.1038/s41386-020-00899-y. Epub 2020 Nov 9.
10

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验