• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

在用于劝说戒烟和积极运动的强化学习算法中解决人们的当前和未来状态。

Addressing people's current and future states in a reinforcement learning algorithm for persuading to quit smoking and to be physically active.

机构信息

Department of Intelligent Systems, Delft University of Technology, Delft, The Netherlands.

Department of Perceptual and Cognitive Systems, Nederlandse Organisatie voor Toegepast Natuurwetenschappelijk Onderzoek (TNO), Soesterberg, The Netherlands.

出版信息

PLoS One. 2022 Dec 1;17(12):e0277295. doi: 10.1371/journal.pone.0277295. eCollection 2022.

DOI:10.1371/journal.pone.0277295
PMID:36454782
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9714722/
Abstract

Behavior change applications often assign their users activities such as tracking the number of smoked cigarettes or planning a running route. To help a user complete these activities, an application can persuade them in many ways. For example, it may help the user create a plan or mention the experience of peers. Intuitively, the application should thereby pick the message that is most likely to be motivating. In the simplest case, this could be the message that has been most effective in the past. However, one could consider several other elements in an algorithm to choose a message. Possible elements include the user's current state (e.g., self-efficacy), the user's future state after reading a message, and the user's similarity to the users on which data has been gathered. To test the added value of subsequently incorporating these elements into an algorithm that selects persuasive messages, we conducted an experiment in which more than 500 people in four conditions interacted with a text-based virtual coach. The experiment consisted of five sessions, in each of which participants were suggested a preparatory activity for quitting smoking or increasing physical activity together with a persuasive message. Our findings suggest that adding more elements to the algorithm is effective, especially in later sessions and for people who thought the activities were useful. Moreover, while we found some support for transferring knowledge between the two activity types, there was rather low agreement between the optimal policies computed separately for the two activity types. This suggests limited policy generalizability between activities for quitting smoking and those for increasing physical activity. We see our results as supporting the idea of constructing more complex persuasion algorithms. Our dataset on 2,366 persuasive messages sent to 671 people is published together with this article for researchers to build on our algorithm.

摘要

行为改变应用程序通常会为用户分配活动,例如跟踪吸烟数量或规划跑步路线。为了帮助用户完成这些活动,应用程序可以通过多种方式说服他们。例如,它可以帮助用户制定计划或提及同行的经验。直观地说,应用程序应该选择最有可能激励用户的消息。在最简单的情况下,这可能是过去最有效的消息。但是,在算法中可以考虑其他几个元素来选择消息。可能的元素包括用户的当前状态(例如,自我效能感)、用户阅读消息后的未来状态以及用户与收集数据的用户的相似性。为了测试随后将这些元素纳入选择有说服力的消息的算法中是否有附加值,我们进行了一项实验,在该实验中,有超过 500 人在四种条件下与基于文本的虚拟教练进行了互动。该实验包括五个会话,在每个会话中,参与者都被建议进行戒烟或增加体育活动的预备活动,并附有一条有说服力的信息。我们的研究结果表明,向算法中添加更多元素是有效的,尤其是在后续会话中,对于那些认为活动有用的人来说更是如此。此外,虽然我们发现了在两种活动类型之间转移知识的一些支持,但为两种活动类型分别计算的最优策略之间的一致性相当低。这表明戒烟和增加体育活动之间的活动策略的通用性有限。我们认为我们的结果支持构建更复杂的说服算法的想法。我们的关于发送给 671 人的 2366 条有说服力的消息的数据集与本文一起发布,供研究人员在我们的算法基础上进行构建。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/8ebb5cbc21b5/pone.0277295.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/48efd280b6b2/pone.0277295.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/79fc691fd4e2/pone.0277295.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/e054813667fa/pone.0277295.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/7338337f2b06/pone.0277295.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/8ebb5cbc21b5/pone.0277295.g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/48efd280b6b2/pone.0277295.g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/79fc691fd4e2/pone.0277295.g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/e054813667fa/pone.0277295.g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/7338337f2b06/pone.0277295.g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/20d9/9714722/8ebb5cbc21b5/pone.0277295.g005.jpg

相似文献

1
Addressing people's current and future states in a reinforcement learning algorithm for persuading to quit smoking and to be physically active.在用于劝说戒烟和积极运动的强化学习算法中解决人们的当前和未来状态。
PLoS One. 2022 Dec 1;17(12):e0277295. doi: 10.1371/journal.pone.0277295. eCollection 2022.
2
Users' needs for a digital smoking cessation application and how to address them: A mixed-methods study.用户对数字戒烟应用程序的需求以及如何满足这些需求:一项混合方法研究。
PeerJ. 2022 Aug 19;10:e13824. doi: 10.7717/peerj.13824. eCollection 2022.
3
The efficacy of mobile phone-based text message interventions ('Happy Quit') for smoking cessation in China.基于手机短信干预措施(“快乐戒烟”)在中国戒烟方面的效果。
BMC Public Health. 2016 Aug 19;16(1):833. doi: 10.1186/s12889-016-3528-5.
4
Motivational support intervention to reduce smoking and increase physical activity in smokers not ready to quit: the TARS RCT.动机支持干预减少吸烟者的吸烟量并增加其运动量,适用于那些尚未准备好戒烟的吸烟者:TARS RCT 研究。
Health Technol Assess. 2023 Mar;27(4):1-277. doi: 10.3310/KLTG1447.
5
Smoking reduction interventions for smoking cessation.用于戒烟的减少吸烟干预措施。
Cochrane Database Syst Rev. 2019 Sep 30;9(9):CD013183. doi: 10.1002/14651858.CD013183.pub2.
6
Nicotine replacement treatment, e-cigarettes and an online behavioural intervention to reduce relapse in recent ex-smokers: a multinational four-arm RCT.尼古丁替代疗法、电子烟和在线行为干预减少近期戒烟者复吸:一项多国家四臂 RCT 研究。
Health Technol Assess. 2020 Dec;24(68):1-82. doi: 10.3310/hta24680.
7
Developing Mood-Based Computer-Tailored Health Communication for Smoking Cessation: Feasibility Randomized Controlled Trial.开发基于情绪的戒烟计算机定制健康传播:可行性随机对照试验。
JMIR Form Res. 2023 Dec 22;7:e48958. doi: 10.2196/48958.
8
E-cigarettes compared with nicotine replacement therapy within the UK Stop Smoking Services: the TEC RCT.电子烟与尼古丁替代疗法在英国戒烟服务中的比较:TEC RCT。
Health Technol Assess. 2019 Aug;23(43):1-82. doi: 10.3310/hta23430.
9
Evaluating the use of a recommender system for selecting optimal messages for smoking cessation: patterns and effects of user-system engagement.评估推荐系统在选择最佳戒烟信息中的应用:用户与系统互动的模式和效果。
BMC Public Health. 2021 Sep 26;21(1):1749. doi: 10.1186/s12889-021-11803-8.
10
Interventions to reduce tobacco use in people experiencing homelessness.减少无家可归人群吸烟的干预措施。
Cochrane Database Syst Rev. 2020 Dec 3;12(12):CD013413. doi: 10.1002/14651858.CD013413.pub2.

引用本文的文献

1
User Experiences With Digital Future-Self Interventions in the Contexts of Smoking and Physical Inactivity: Mixed Methods Multistudy Exploration.吸烟与缺乏身体活动背景下数字未来自我干预的用户体验:混合方法多研究探索
JMIR Form Res. 2025 Jun 20;9:e63893. doi: 10.2196/63893.
2
A Deployed Online Reinforcement Learning Algorithm In An Oral Health Clinical Trial.一种应用于口腔健康临床试验的在线强化学习算法
Proc AAAI Conf Artif Intell. 2025;39(28):28792-28800. doi: 10.1609/aaai.v39i28.35143. Epub 2025 Apr 11.
3
Psychological, economic, and ethical factors in human feedback for a chatbot-based smoking cessation intervention.

本文引用的文献

1
Artificial Intelligence Chatbot Behavior Change Model for Designing Artificial Intelligence Chatbots to Promote Physical Activity and a Healthy Diet: Viewpoint.人工智能聊天机器人行为改变模型设计人工智能聊天机器人促进身体活动和健康饮食:观点。
J Med Internet Res. 2020 Sep 30;22(9):e22845. doi: 10.2196/22845.
2
What kind of smoking identity following quitting would elevate smokers relapse risk?戒烟后哪种吸烟身份会增加吸烟者复吸的风险?
Addict Behav. 2021 Jan;112:106654. doi: 10.1016/j.addbeh.2020.106654. Epub 2020 Sep 12.
3
The Concept and Components of Engagement in Different Domains Applied to eHealth: A Systematic Scoping Review.
基于聊天机器人的戒烟干预中人类反馈的心理、经济和伦理因素。
NPJ Digit Med. 2025 May 31;8(1):326. doi: 10.1038/s41746-025-01701-3.
4
Testing a Machine Learning-Based Adaptive Motivational System for Socioeconomically Disadvantaged Smokers (Adapt2Quit): Protocol for a Randomized Controlled Trial.测试一种针对社会经济地位不利吸烟者的基于机器学习的自适应激励系统(Adapt2Quit):一项随机对照试验的方案。
JMIR Res Protoc. 2025 Apr 16;14:e63693. doi: 10.2196/63693.
5
Targeting Key Risk Factors for Cardiovascular Disease in At-Risk Individuals: Developing a Digital, Personalized, and Real-Time Intervention to Facilitate Smoking Cessation and Physical Activity.针对高危个体的心血管疾病关键风险因素:开发一种数字化、个性化和实时干预措施以促进戒烟和身体活动。
JMIR Cardio. 2024 Dec 20;8:e47730. doi: 10.2196/47730.
6
Did we personalize? Assessing personalization by an online reinforcement learning algorithm using resampling.我们进行个性化了吗?使用重采样通过在线强化学习算法评估个性化。
Mach Learn. 2024 Jul;113(7):3961-3997. doi: 10.1007/s10994-024-06526-x. Epub 2024 Apr 10.
7
Text Messages to Promote Physical Activity in Patients With Cardiovascular Disease: A Micro-Randomized Trial of a Just-In-Time Adaptive Intervention.短信促进心血管疾病患者身体活动的效果:一项即时自适应干预的微随机试验。
Circ Cardiovasc Qual Outcomes. 2024 Jul;17(7):e010731. doi: 10.1161/CIRCOUTCOMES.123.010731. Epub 2024 Jun 18.
8
Acceptability of a Text Message-Based Mobile Health Intervention to Promote Physical Activity in Cardiac Rehabilitation Enrollees: A Qualitative Substudy of Participant Perspectives.基于短信的移动健康干预措施在促进心脏康复患者身体活动中的可接受性:参与者观点的定性子研究。
J Am Heart Assoc. 2024 Jan 16;13(2):e030807. doi: 10.1161/JAHA.123.030807.
9
Feasibility of generating structured motivational messages for tailored physical activity coaching.为量身定制的体育活动指导生成结构化激励信息的可行性。
Front Digit Health. 2023 Sep 12;5:1215187. doi: 10.3389/fdgth.2023.1215187. eCollection 2023.
应用于电子健康领域的不同维度参与的概念与组成部分:一项系统性综述。
Front Psychol. 2020 May 27;11:926. doi: 10.3389/fpsyg.2020.00926. eCollection 2020.
4
Personalizing Mobile Fitness Apps using Reinforcement Learning.利用强化学习实现移动健身应用的个性化定制。
CEUR Workshop Proc. 2018 Mar 7;2068.
5
Determinants of weekly sitting time: construct validation of an initial COM-B model and comparison of its predictive validity with the Theory of Planned Behaviour.每周久坐时间的决定因素:初始 COM-B 模型的构建验证及其与计划行为理论预测有效性的比较。
Psychol Health. 2021 Jan;36(1):96-114. doi: 10.1080/08870446.2020.1763994. Epub 2020 May 14.
6
Informational and emotional daily messages to reduce red and processed meat consumption.提供信息和情感支持的日常信息,以减少红肉类和加工肉类的消费。
Appetite. 2019 Oct 1;141:104331. doi: 10.1016/j.appet.2019.104331. Epub 2019 Jul 2.
7
Different Frames to Reduce Red Meat Intake: The Moderating Role of Self-Efficacy.不同框架对减少红肉摄入的影响:自我效能的调节作用。
Health Commun. 2020 Apr;35(4):475-482. doi: 10.1080/10410236.2019.1567444. Epub 2019 Jan 24.
8
Can the artificial intelligence technique of reinforcement learning use continuously-monitored digital data to optimize treatment for weight loss?强化学习人工智能技术能否利用持续监测的数字数据来优化减肥治疗?
J Behav Med. 2019 Apr;42(2):276-290. doi: 10.1007/s10865-018-9964-1. Epub 2018 Aug 25.
9
Strengthening quitter self-identity: An experimental study.强化戒烟自我认同:一项实验研究。
Psychol Health. 2018 Oct;33(10):1229-1250. doi: 10.1080/08870446.2018.1478976. Epub 2018 Jun 10.
10
Developing and Evaluating Digital Interventions to Promote Behavior Change in Health and Health Care: Recommendations Resulting From an International Workshop.开发和评估促进健康与医疗保健行为改变的数字干预措施:国际研讨会的建议
J Med Internet Res. 2017 Jun 29;19(6):e232. doi: 10.2196/jmir.7126.