• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

通过结合深度强化学习和基于核的强化学习改进脓毒症治疗策略

Improving Sepsis Treatment Strategies by Combining Deep and Kernel-Based Reinforcement Learning.

作者信息

Peng Xuefeng, Ding Yi, Wihl David, Gottesman Omer, Komorowski Matthieu, Lehman Li-Wei H, Ross Andrew, Faisal Aldo, Doshi-Velez Finale

机构信息

Harvard University, Paulson School of Engineering and Applied Sciences, Cambridge, MA.

Harvard University, T.H. Chan School of Public Health, Cambridge, MA.

出版信息

AMIA Annu Symp Proc. 2018 Dec 5;2018:887-896. eCollection 2018.

PMID:30815131
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6371300/
Abstract

Sepsis is the leading cause of mortality in the ICU. It is challenging to manage because individual patients respond differently to treatment. Thus, tailoring treatment to the individual patient is essential for the best outcomes. In this paper, we take steps toward this goal by applying a mixture-of-experts framework to personalize sepsis treatment. The mixture model selectively alternates between neighbor-based (kernel) and deep reinforcement learning (DRL) experts depending on patient's current history. On a large retrospective cohort, this mixture-based approach outperforms physician, kernel only, and DRL-only experts.

摘要

脓毒症是重症监护病房(ICU)死亡的主要原因。由于个体患者对治疗的反应不同,因此管理起来具有挑战性。因此,根据个体患者的情况量身定制治疗方案对于实现最佳治疗效果至关重要。在本文中,我们通过应用专家混合框架来个性化脓毒症治疗,朝着这一目标迈出了步伐。混合模型根据患者当前的病史在基于邻居(内核)的专家和深度强化学习(DRL)专家之间进行选择性切换。在一个大型回顾性队列中,这种基于混合的方法优于医生、仅使用内核的专家和仅使用DRL的专家。

相似文献

1
Improving Sepsis Treatment Strategies by Combining Deep and Kernel-Based Reinforcement Learning.通过结合深度强化学习和基于核的强化学习改进脓毒症治疗策略
AMIA Annu Symp Proc. 2018 Dec 5;2018:887-896. eCollection 2018.
2
Artificial intelligence can use physiological parameters to optimize treatment strategies and predict clinical deterioration of sepsis in ICU.人工智能可以利用生理参数来优化治疗策略,并预测重症监护病房中脓毒症患者的临床病情恶化。
Physiol Meas. 2023 Jan 30;44(1). doi: 10.1088/1361-6579/acb03b.
3
Sepsis-Associated AKI.脓毒症相关急性肾损伤
Clin J Am Soc Nephrol. 2018 Feb 7;13(2):339-342. doi: 10.2215/CJN.07310717. Epub 2017 Oct 25.
4
A Reinforcement Learning Application for Optimal Fluid and Vasopressor Interventions in Septic ICU Patients.强化学习在脓毒症 ICU 患者最佳液体和血管加压素干预中的应用。
Annu Int Conf IEEE Eng Med Biol Soc. 2022 Jul;2022:321-324. doi: 10.1109/EMBC48229.2022.9871055.
5
Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock: 2008.拯救脓毒症运动:严重脓毒症和脓毒性休克治疗国际指南:2008年版
Crit Care Med. 2008 Jan;36(1):296-327. doi: 10.1097/01.CCM.0000298158.12101.41.
6
Effect of an Early Resuscitation Protocol on In-hospital Mortality Among Adults With Sepsis and Hypotension: A Randomized Clinical Trial.早期复苏方案对脓毒症和低血压成年患者院内死亡率的影响:一项随机临床试验
JAMA. 2017 Oct 3;318(13):1233-1240. doi: 10.1001/jama.2017.10913.
7
[Adherence to international guidelines on early management in severe sepsis and septic shock].[遵循严重脓毒症和脓毒性休克早期管理的国际指南]
Biomedica. 2012 Sep;32(3):449-56. doi: 10.1590/S0120-41572012000300015.
8
Severe sepsis and septic shock: clinical overview and update on management.严重脓毒症和脓毒性休克:临床概述及治疗进展。
Mayo Clin Proc. 2014 Nov;89(11):1572-8. doi: 10.1016/j.mayocp.2014.07.009. Epub 2014 Nov 3.
9
The Artificial Intelligence Clinician learns optimal treatment strategies for sepsis in intensive care.人工智能临床医生学习重症监护中脓毒症的最佳治疗策略。
Nat Med. 2018 Nov;24(11):1716-1720. doi: 10.1038/s41591-018-0213-5. Epub 2018 Oct 22.
10
Establishment and Implementation of Potential Fluid Therapy Balance Strategies for ICU Sepsis Patients Based on Reinforcement Learning.基于强化学习的ICU脓毒症患者潜在液体治疗平衡策略的建立与实施
Front Med (Lausanne). 2022 Apr 14;9:766447. doi: 10.3389/fmed.2022.766447. eCollection 2022.

引用本文的文献

1
Learning optimal treatment strategies for intraoperative hypotension using deep reinforcement learning.使用深度强化学习学习术中低血压的最佳治疗策略。
ArXiv. 2025 May 27:arXiv:2505.21596v1.
2
Safety of human-AI cooperative decision-making within intensive care: A physical simulation study.重症监护中人类与人工智能协作决策的安全性:一项物理模拟研究。
PLOS Digit Health. 2025 Feb 24;4(2):e0000726. doi: 10.1371/journal.pdig.0000726. eCollection 2025 Feb.
3
A safe-enhanced fully closed-loop artificial pancreas controller based on deep reinforcement learning.一种基于深度强化学习的安全增强型全闭环人工胰腺控制器。
PLoS One. 2025 Jan 27;20(1):e0317662. doi: 10.1371/journal.pone.0317662. eCollection 2025.
4
Reinforcement Learning to Optimize Ventilator Settings for Patients on Invasive Mechanical Ventilation: Retrospective Study.强化学习优化有创机械通气患者呼吸机设置:回顾性研究。
J Med Internet Res. 2024 Oct 16;26:e44494. doi: 10.2196/44494.
5
Deep Attention Q-Network for Personalized Treatment Recommendation.用于个性化治疗推荐的深度注意力Q网络
IEEE Int Conf Data Min Workshops. 2023 Dec;2023:329-337. doi: 10.1109/icdmw60847.2023.00048. Epub 2024 Feb 6.
6
Continuous-Time Decision Transformer for Healthcare Applications.用于医疗保健应用的连续时间决策变压器
Proc Mach Learn Res. 2023 Apr;206:6245-6262.
7
Optimizing sepsis treatment strategies via a reinforcement learning model.通过强化学习模型优化脓毒症治疗策略。
Biomed Eng Lett. 2024 Jan 4;14(2):279-289. doi: 10.1007/s13534-023-00343-2. eCollection 2024 Mar.
8
Towards more efficient and robust evaluation of sepsis treatment with deep reinforcement learning.用深度强化学习更有效地评估脓毒症治疗效果。
BMC Med Inform Decis Mak. 2023 Mar 1;23(1):43. doi: 10.1186/s12911-023-02126-2.
9
Unifying cardiovascular modelling with deep reinforcement learning for uncertainty aware control of sepsis treatment.将心血管建模与深度强化学习相结合,用于脓毒症治疗的不确定性感知控制。
PLOS Digit Health. 2022 Feb 17;1(2):e0000012. doi: 10.1371/journal.pdig.0000012. eCollection 2022 Feb.
10
Making machine learning matter to clinicians: model actionability in medical decision-making.让机器学习对临床医生产生重要影响:医学决策中的模型可操作性。
NPJ Digit Med. 2023 Jan 24;6(1):7. doi: 10.1038/s41746-023-00753-7.

本文引用的文献

1
The Artificial Intelligence Clinician learns optimal treatment strategies for sepsis in intensive care.人工智能临床医生学习重症监护中脓毒症的最佳治疗策略。
Nat Med. 2018 Nov;24(11):1716-1720. doi: 10.1038/s41591-018-0213-5. Epub 2018 Oct 22.
2
Incidence and Trends of Sepsis in US Hospitals Using Clinical vs Claims Data, 2009-2014.2009 - 2014年美国医院中使用临床数据与索赔数据的脓毒症发病率及趋势
JAMA. 2017 Oct 3;318(13):1241-1249. doi: 10.1001/jama.2017.13836.
3
Combining Kernel and Model Based Learning for HIV Therapy Selection.结合基于核和模型的学习方法进行HIV治疗方案选择
AMIA Jt Summits Transl Sci Proc. 2017 Jul 26;2017:239-248. eCollection 2017.
4
Time to Treatment and Mortality during Mandated Emergency Care for Sepsis.脓毒症强制紧急治疗的治疗时间与死亡率
N Engl J Med. 2017 Jun 8;376(23):2235-2244. doi: 10.1056/NEJMoa1703058. Epub 2017 May 21.
5
MIMIC-III, a freely accessible critical care database.MIMIC-III,一个免费获取的重症监护数据库。
Sci Data. 2016 May 24;3:160035. doi: 10.1038/sdata.2016.35.
6
The demise of early goal-directed therapy for severe sepsis and septic shock.严重脓毒症和脓毒性休克早期目标导向治疗的终结。
Acta Anaesthesiol Scand. 2015 May;59(5):561-7. doi: 10.1111/aas.12479. Epub 2015 Feb 6.
7
Fluid overload in patients with severe sepsis and septic shock treated with early goal-directed therapy is associated with increased acute need for fluid-related medical interventions and hospital death.在接受早期目标导向治疗的严重脓毒症和脓毒性休克患者中,液体超负荷与对与液体相关的医疗干预的急性需求增加及医院死亡相关。
Shock. 2015 Jan;43(1):68-73. doi: 10.1097/SHK.0000000000000268.
8
Interaction between fluids and vasoactive agents on mortality in septic shock: a multicenter, observational study.脓毒性休克中液体与血管活性药物相互作用对死亡率的影响:一项多中心观察性研究
Crit Care Med. 2014 Oct;42(10):2158-68. doi: 10.1097/CCM.0000000000000520.
9
Elevation of blood urea nitrogen is predictive of long-term mortality in critically ill patients independent of "normal" creatinine.血尿素氮升高可预测危重症患者的长期死亡率,与“正常”肌酐无关。
Crit Care Med. 2011 Feb;39(2):305-13. doi: 10.1097/CCM.0b013e3181ffe22a.
10
[Albumin in sepsis].[脓毒症中的白蛋白]
Ann Fr Anesth Reanim. 2010 Sep;29(9):629-34. doi: 10.1016/j.annfar.2010.05.035. Epub 2010 Aug 1.