• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

戒烟过程中强化学习的纵向变化:使用概率奖励任务的计算分析

Longitudinal changes in reinforcement learning during smoking cessation: a computational analysis using a probabilistic reward task.

作者信息

Montemitro Chiara, Ossola Paolo, Ross Thomas J, Huys Quentin J M, Fedota John R, Salmeron Betty Jo, di Giannantonio Massimo, Stein Elliot A

机构信息

Neuroimaging Research Branch, National Institute on Drug Abuse-Intramural Research Program, National Institutes of Health, Baltimore, MD, USA.

Department of Neuroscience, Imaging and Clinical Sciences, "G. d'Annunzio" University, Chieti, Italy.

出版信息

Sci Rep. 2024 Dec 31;14(1):32171. doi: 10.1038/s41598-024-84091-y.

DOI:10.1038/s41598-024-84091-y
PMID:39741189
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11688494/
Abstract

Despite progress in smoking reduction in the past several decades, cigarette smoking remains a significant public health concern world-wide, with many smokers attempting but ultimately failing to maintain abstinence. However, little is known about how decision-making evolves in quitting smokers. Based on preregistered hypotheses and analysis plan ( https://osf.io/yq5th ), we examined the evolution of reinforcement learning (RL), a key component of decision-making, in smokers during acute and extended nicotine abstinence. In a longitudinal, within-subject design, we used a probabilistic reward task (PRT) to assess RL in twenty smokers who successfully refrained from smoking for at least 30 days. We evaluated changes in reward-based decision-making using signal-detection analysis and five RL models across three sessions during 30 days of nicotine abstinence. Contrary to our preregistered hypothesis, punishment sensitivity emerged as the only parameter that changed during smoking cessation. While it is plausible that some changes in task performance could be attributed to task repetition effects, we observed a clear impact of the Nicotine Withdrawal Syndrome (NWS) on RL, and a dynamic relationship between craving and reward and punishment sensitivity over time, suggesting a significant recalibration of cognitive processes during abstinence. In this context, the heightened sensitivity to negative outcomes observed at the last session (30 days after quitting) compared to the previous sessions, may be interpreted as a cognitive adaptation aimed at fostering long-term abstinence. While further studies are needed to clarify the mechanisms underlying punishment sensitivity during nicotine abstinence, these results highlight the need for personalized treatment approaches tailored to individual needs.

摘要

尽管在过去几十年中吸烟率有所下降,但吸烟仍然是全球重大的公共卫生问题,许多吸烟者试图戒烟但最终未能保持戒烟状态。然而,对于戒烟者的决策过程如何演变却知之甚少。基于预先注册的假设和分析计划(https://osf.io/yq5th),我们研究了强化学习(RL)这一决策关键组成部分在吸烟者急性和长期尼古丁戒断期间的演变。在一项纵向的、受试者内设计中,我们使用概率奖励任务(PRT)来评估20名成功戒烟至少30天的吸烟者的强化学习。我们在尼古丁戒断的30天内,通过信号检测分析和五个强化学习模型,在三个阶段评估基于奖励的决策变化。与我们预先注册的假设相反,惩罚敏感性成为戒烟期间唯一发生变化的参数。虽然任务表现的一些变化可能归因于任务重复效应,但我们观察到尼古丁戒断综合征(NWS)对强化学习有明显影响,以及随着时间推移渴望与奖励和惩罚敏感性之间的动态关系,这表明在戒断期间认知过程发生了重大重新校准。在这种情况下,与前几个阶段相比,在最后一个阶段(戒烟30天后)观察到的对负面结果的更高敏感性,可能被解释为一种旨在促进长期戒烟的认知适应。虽然需要进一步研究来阐明尼古丁戒断期间惩罚敏感性的潜在机制,但这些结果凸显了针对个体需求制定个性化治疗方法的必要性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/d771b5353266/41598_2024_84091_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/223c78e128e2/41598_2024_84091_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/92b0d3793963/41598_2024_84091_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/aed1cef93a35/41598_2024_84091_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/95ca7611085d/41598_2024_84091_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/d771b5353266/41598_2024_84091_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/223c78e128e2/41598_2024_84091_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/92b0d3793963/41598_2024_84091_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/aed1cef93a35/41598_2024_84091_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/95ca7611085d/41598_2024_84091_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/d477/11688494/d771b5353266/41598_2024_84091_Fig4_HTML.jpg

相似文献

1
Longitudinal changes in reinforcement learning during smoking cessation: a computational analysis using a probabilistic reward task.戒烟过程中强化学习的纵向变化:使用概率奖励任务的计算分析
Sci Rep. 2024 Dec 31;14(1):32171. doi: 10.1038/s41598-024-84091-y.
2
Neural Signatures of Cognitive Flexibility and Reward Sensitivity Following Nicotinic Receptor Stimulation in Dependent Smokers: A Randomized Trial.依赖吸烟者烟碱受体刺激后认知灵活性和奖励敏感性的神经特征:一项随机试验
JAMA Psychiatry. 2017 Jun 1;74(6):632-640. doi: 10.1001/jamapsychiatry.2017.0400.
3
Smoking Decisions: Altered Reinforcement Learning Signals Induced by Nicotine State.吸烟决策:尼古丁状态引起的强化学习信号改变。
Nicotine Tob Res. 2020 Feb 6;22(2):164-171. doi: 10.1093/ntr/nty136.
4
Patterns of change in withdrawal symptoms, desire to smoke, reward motivation and response inhibition across 3 months of smoking abstinence.戒烟3个月期间戒断症状、吸烟欲望、奖赏动机及反应抑制的变化模式。
Addiction. 2009 May;104(5):850-8. doi: 10.1111/j.1360-0443.2009.02522.x. Epub 2009 Mar 13.
5
Effects of smoking abstinence on smoking-reinforced responding, withdrawal, and cognition in adults with and without attention deficit hyperactivity disorder.吸烟戒断对有和没有注意缺陷多动障碍的成年人的吸烟强化反应、戒断症状和认知的影响。
Psychopharmacology (Berl). 2013 May;227(1):19-30. doi: 10.1007/s00213-012-2937-0. Epub 2012 Dec 18.
6
Effects of smoking abstinence on cigarette craving, nicotine withdrawal, and nicotine reinforcement in smokers with and without schizophrenia.戒烟对精神分裂症患者和非精神分裂症患者的吸烟渴求、尼古丁戒断和尼古丁强化的影响。
Nicotine Tob Res. 2014 Mar;16(3):326-34. doi: 10.1093/ntr/ntt152. Epub 2013 Oct 10.
7
Smoking-specific experiential avoidance cognition: explanatory relevance to pre- and post-cessation nicotine withdrawal, craving, and negative affect.吸烟特异性的经验性回避认知:与戒烟前后尼古丁戒断、渴望及消极情绪的解释相关性。
Addict Behav. 2015 May;44:58-64. doi: 10.1016/j.addbeh.2014.07.026. Epub 2014 Aug 6.
8
Depression Severity Moderates Reward Learning Among Smokers With Current or Past Major Depressive Disorder in a Smoking Cessation Randomized Clinical Trial.在一项戒烟随机临床试验中,抑郁严重程度对患有当前或过去重度抑郁症的吸烟者的奖赏学习有调节作用。
Nicotine Tob Res. 2024 Apr 22;26(5):639-644. doi: 10.1093/ntr/ntad221.
9
Smoking history, nicotine dependence, and changes in craving and mood during short-term smoking abstinence in alcohol dependent vs. control smokers.吸烟史、尼古丁依赖以及在酒精依赖和对照吸烟者短期戒烟期间的渴求感和情绪变化。
Addict Behav. 2011 Mar;36(3):244-7. doi: 10.1016/j.addbeh.2010.10.008. Epub 2010 Oct 28.
10
Blunted striatal response to monetary reward anticipation during smoking abstinence predicts lapse during a contingency-managed quit attempt.在戒烟期间,纹状体对金钱奖励预期的反应减弱预示着在应急管理的戒烟尝试中会出现复吸。
Psychopharmacology (Berl). 2016 Mar;233(5):751-60. doi: 10.1007/s00213-015-4152-2. Epub 2015 Dec 11.

引用本文的文献

1
Reinforcement Learning in Personalized Medicine: A Comprehensive Review of Treatment Optimization Strategies.个性化医疗中的强化学习:治疗优化策略的全面综述
Cureus. 2025 Apr 21;17(4):e82756. doi: 10.7759/cureus.82756. eCollection 2025 Apr.

本文引用的文献

1
Depression Severity Moderates Reward Learning Among Smokers With Current or Past Major Depressive Disorder in a Smoking Cessation Randomized Clinical Trial.在一项戒烟随机临床试验中,抑郁严重程度对患有当前或过去重度抑郁症的吸烟者的奖赏学习有调节作用。
Nicotine Tob Res. 2024 Apr 22;26(5):639-644. doi: 10.1093/ntr/ntad221.
2
Listening to the Data: Computational Approaches to Addiction and Learning.倾听数据:成瘾与学习的计算方法。
J Neurosci. 2023 Nov 8;43(45):7547-7553. doi: 10.1523/JNEUROSCI.1415-23.2023.
3
Dopamine regulates decision thresholds in human reinforcement learning in males.
多巴胺调节男性在人类强化学习中的决策阈值。
Nat Commun. 2023 Sep 4;14(1):5369. doi: 10.1038/s41467-023-41130-y.
4
Enhanced decision-making in nicotine dependent individuals who abstain: A computational analysis using Hierarchical Drift Diffusion Modeling.在戒烟的尼古丁依赖个体中增强决策能力:使用分层漂移扩散建模的计算分析。
Drug Alcohol Depend. 2023 Sep 1;250:110890. doi: 10.1016/j.drugalcdep.2023.110890. Epub 2023 Jul 13.
5
Pathways to the persistence of drug use despite its adverse consequences.尽管药物使用会带来不良后果,但仍存在持续使用的途径。
Mol Psychiatry. 2023 Jun;28(6):2228-2237. doi: 10.1038/s41380-023-02040-z. Epub 2023 Mar 30.
6
Anhedonia and sensitivity to punishment in schizophrenia, depression and opiate use disorder.精神分裂症、抑郁症和阿片类物质使用障碍中的快感缺失与对惩罚的敏感性
J Affect Disord. 2023 Jun 1;330:319-328. doi: 10.1016/j.jad.2023.02.120. Epub 2023 Mar 6.
7
Fast evidence accumulation in social anxiety disorder enhances decision making in a probabilistic reward task.快速的社交焦虑障碍证据积累增强了概率奖励任务中的决策。
Emotion. 2022 Feb;22(1):1-18. doi: 10.1037/emo0001053. Epub 2021 Dec 30.
8
Genetic and Depressive Traits Moderate the Reward-Enhancing Effects of Acute Nicotine in Young Light Smokers.遗传和抑郁特征调节急性尼古丁对年轻轻度吸烟者奖赏效应的增强作用。
Nicotine Tob Res. 2021 Aug 29;23(10):1779-1786. doi: 10.1093/ntr/ntab072.
9
Revision of the Wisconsin Smoking Withdrawal Scale: Development of brief and long forms.《威斯康星戒烟量表修订版:简短版和长版的制定》
Psychol Assess. 2021 Mar;33(3):255-266. doi: 10.1037/pas0000978.
10
Evaluating the temporal relationships between withdrawal symptoms and smoking relapse.评估戒断症状与吸烟复吸之间的时间关系。
Psychol Addict Behav. 2019 Mar;33(2):105-116. doi: 10.1037/adb0000434. Epub 2019 Jan 7.