• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

与非饮酒者相比,饮酒者在与奖励相关的决策策略之间的仲裁受损:一项计算建模研究。

Impaired arbitration between reward-related decision-making strategies in Alcohol Users compared to Alcohol Non-Users: a computational modeling study.

作者信息

Ramakrishnan Srinivasan A, Shaik Riaz B, Kanagamani Tamizharasan, Neppala Gopi, Chen Jeffrey, Fiore Vincenzo G, Hammond Christopher J, Srinivasan Shankar, Ivanov Iliyan, Chakravarthy V Srinivasa, Kool Wouter, Parvaz Muhammad A

机构信息

Department of Health Informatics, Rutgers - School of Health Professions, Piscataway, NJ USA.

Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY USA.

出版信息

NPP Digit Psychiatry Neurosci. 2025;3(1):1. doi: 10.1038/s44277-024-00023-8. Epub 2025 Jan 3.

DOI:10.1038/s44277-024-00023-8
PMID:39759090
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11698690/
Abstract

Reinforcement learning studies propose that decision-making is guided by a tradeoff between computationally cheaper model-free (habitual) control and costly model-based (goal-directed) control. Greater model-based control is typically used under highly rewarding conditions to minimize risk and maximize gain. Although prior studies have shown impairments in sensitivity to reward value in individuals with frequent alcohol use, it is unclear how these individuals arbitrate between model-free and model-based control based on the magnitude of reward incentives. In this study, 81 individuals (47 frequent Alcohol Users and 34 Alcohol Non-Users) performed a modified 2-step learning task where stakes were sometimes high, and other times they were low. Maximum fitting of a dual-system reinforcement-learning model was used to assess the degree of model-based control, and a utility model was used to assess risk sensitivity for the low- and high-stakes trials separately. As expected, Alcohol Non-Users showed significantly higher model-based control in higher compared to lower reward conditions, whereas no such difference between the two conditions was observed for the Alcohol Users. Additionally, both groups were significantly less risk-averse in higher compared to lower reward conditions. However, Alcohol Users were significantly less risk-averse compared to Alcohol Non-Users in the higher reward condition. Lastly, greater model-based control was associated with a less risk-sensitive approach in Alcohol Users. Taken together, these results suggest that frequent Alcohol Users may have impaired metacontrol, making them less flexible to varying monetary rewards and more prone to risky decision-making, especially when the stakes are high.

摘要

强化学习研究表明,决策是由计算成本较低的无模型(习惯性)控制和成本较高的基于模型(目标导向)控制之间的权衡所引导的。在高回报条件下,通常会更多地使用基于模型的控制,以将风险降至最低并使收益最大化。尽管先前的研究表明,频繁饮酒的个体对奖励价值的敏感性存在损害,但尚不清楚这些个体如何根据奖励激励的大小在无模型控制和基于模型的控制之间进行权衡。在这项研究中,81名个体(47名频繁饮酒者和34名非饮酒者)完成了一项经过修改的两步学习任务,其中赌注有时高,有时低。使用双系统强化学习模型的最大拟合来评估基于模型的控制程度,并使用效用模型分别评估低赌注和高赌注试验的风险敏感性。正如预期的那样,与较低奖励条件相比,非饮酒者在较高奖励条件下表现出明显更高的基于模型的控制,而饮酒者在这两种条件之间未观察到这种差异。此外,与较低奖励条件相比,两组在较高奖励条件下的风险厌恶程度均显著降低。然而,在较高奖励条件下,饮酒者的风险厌恶程度明显低于非饮酒者。最后,在饮酒者中,更高的基于模型的控制与较低的风险敏感方法相关。综上所述,这些结果表明,频繁饮酒者可能存在元控制受损的情况,这使得他们在面对不同的金钱奖励时灵活性降低,更容易做出冒险决策,尤其是在赌注很高的时候。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11698690/cebf3ee2498e/44277_2024_23_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11698690/e53616d49ef8/44277_2024_23_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11698690/bd1bd6b1704e/44277_2024_23_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11698690/cebf3ee2498e/44277_2024_23_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11698690/e53616d49ef8/44277_2024_23_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11698690/bd1bd6b1704e/44277_2024_23_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/996c/11698690/cebf3ee2498e/44277_2024_23_Fig3_HTML.jpg

相似文献

1
Impaired arbitration between reward-related decision-making strategies in Alcohol Users compared to Alcohol Non-Users: a computational modeling study.与非饮酒者相比,饮酒者在与奖励相关的决策策略之间的仲裁受损:一项计算建模研究。
NPP Digit Psychiatry Neurosci. 2025;3(1):1. doi: 10.1038/s44277-024-00023-8. Epub 2025 Jan 3.
2
Frontal, Striatal, and Medial Temporal Sensitivity to Value Distinguishes Risk-Taking from Risk-Aversive Older Adults during Decision Making.额叶、纹状体和内侧颞叶对价值的敏感性在决策过程中区分了冒险型与规避风险型老年人。
J Neurosci. 2016 Dec 7;36(49):12498-12509. doi: 10.1523/JNEUROSCI.1386-16.2016.
3
Computational and behavioral markers of model-based decision making in childhood.儿童基于模型的决策的计算和行为标志物。
Dev Sci. 2023 Mar;26(2):e13295. doi: 10.1111/desc.13295. Epub 2022 Jun 23.
4
Altered subjective reward valuation among female heavy marijuana users.女性重度大麻使用者主观奖励评估的改变。
Exp Clin Psychopharmacol. 2017 Feb;25(1):1-12. doi: 10.1037/pha0000101. Epub 2016 Dec 12.
5
Need for cognition does not account for individual differences in metacontrol of decision making.认知需求并不能解释个体在决策元认知控制上的差异。
Sci Rep. 2022 May 17;12(1):8240. doi: 10.1038/s41598-022-12341-y.
6
When Habits Are Dangerous: Alcohol Expectancies and Habitual Decision Making Predict Relapse in Alcohol Dependence.当习惯变得危险:酒精预期和习惯性决策预测酒精依赖的复发。
Biol Psychiatry. 2017 Dec 1;82(11):847-856. doi: 10.1016/j.biopsych.2017.04.019. Epub 2017 May 22.
7
Dorsal-Ventral Reinforcement Learning Network Connectivity and Incentive-Driven Changes in Exploration.背腹侧强化学习网络连接性与探索中动机驱动的变化
J Neurosci. 2025 Apr 9;45(15):e0422242025. doi: 10.1523/JNEUROSCI.0422-24.2025.
8
Evaluating the Influence of Musical and Monetary Rewards on Decision Making through Computational Modelling.通过计算建模评估音乐和金钱奖励对决策的影响。
Behav Sci (Basel). 2024 Feb 8;14(2):124. doi: 10.3390/bs14020124.
9
Late acute stress effects on decision-making: The magnified attraction to immediate gains in the iowa gambling task.晚期急性应激对决策的影响:在爱荷华赌博任务中对即时收益的吸引力增强。
Behav Brain Res. 2025 Jan 5;476:115279. doi: 10.1016/j.bbr.2024.115279. Epub 2024 Oct 2.
10
Cost-benefit trade-offs in decision-making and learning.决策和学习中的成本效益权衡。
PLoS Comput Biol. 2019 Sep 6;15(9):e1007326. doi: 10.1371/journal.pcbi.1007326. eCollection 2019 Sep.

本文引用的文献

1
COVID-19 pandemic stressors are associated with reported increases in frequency of drunkenness among individuals with a history of alcohol use disorder.新冠疫情压力源与有酒精使用障碍病史的个体醉酒频率增加的报告有关。
Transl Psychiatry. 2023 Oct 6;13(1):311. doi: 10.1038/s41398-023-02577-1.
2
Trends in Alcohol-Related Deaths by Sex in the US, 1999-2020.美国 1999-2020 年按性别划分的与酒精相关的死亡趋势。
JAMA Netw Open. 2023 Jul 3;6(7):e2326346. doi: 10.1001/jamanetworkopen.2023.26346.
3
Neurocognitive basis of model-based decision making and its metacontrol in childhood.
儿童基于模型的决策及其元控制的神经认知基础。
Dev Cogn Neurosci. 2023 Aug;62:101269. doi: 10.1016/j.dcn.2023.101269. Epub 2023 Jun 16.
4
Risky Decision-Making in Adults with Alcohol Use Disorder-A Systematic and Meta-Analytic Review.酒精使用障碍成年人的风险决策——一项系统评价与荟萃分析
J Clin Med. 2023 Apr 18;12(8):2943. doi: 10.3390/jcm12082943.
5
Decreased reward-related brain function prospectively predicts increased substance use.奖励相关脑功能下降可预测物质使用增加。
J Abnorm Psychol. 2021 Nov;130(8):886-898. doi: 10.1037/abn0000711.
6
Valence bias in metacontrol of decision making in adolescents and young adults.青少年和青年决策元控制中的效价偏差
Child Dev. 2022 Mar;93(2):e103-e116. doi: 10.1111/cdev.13693. Epub 2021 Oct 16.
7
Meta-control: From psychology to computational neuroscience.元控制:从心理学到计算神经科学。
Cogn Affect Behav Neurosci. 2021 Jun;21(3):447-452. doi: 10.3758/s13415-021-00919-4. Epub 2021 Jun 3.
8
The Coronavirus Health and Impact Survey (CRISIS) reveals reproducible correlates of pandemic-related mood states across the Atlantic.《冠状病毒健康与影响调查》(CRISIS)揭示了跨越大西洋的与大流行相关情绪状态的可复制相关性。
Sci Rep. 2021 Apr 14;11(1):8139. doi: 10.1038/s41598-021-87270-3.
9
Changes in Alcohol Use Patterns in the United States During COVID-19 Pandemic.新冠疫情期间美国酒精使用模式的变化
WMJ. 2020 Sep;119(3):171-176.
10
Imprecise action selection in substance use disorder: Evidence for active learning impairments when solving the explore-exploit dilemma.物质使用障碍中的不精确动作选择:在解决探索-利用困境时主动学习损伤的证据。
Drug Alcohol Depend. 2020 Oct 1;215:108208. doi: 10.1016/j.drugalcdep.2020.108208. Epub 2020 Aug 6.