• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于强化学习的 2 型糖尿病优化血糖控制:一项概念验证试验。

Optimized glycemic control of type 2 diabetes with reinforcement learning: a proof-of-concept trial.

机构信息

Ministry of Education Key Laboratory of Metabolism and Molecular Medicine, Department of Endocrinology and Metabolism, Zhongshan Hospital, Fudan University, Shanghai, China.

State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China.

出版信息

Nat Med. 2023 Oct;29(10):2633-2642. doi: 10.1038/s41591-023-02552-9. Epub 2023 Sep 14.

DOI:10.1038/s41591-023-02552-9
PMID:37710000
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10579102/
Abstract

The personalized titration and optimization of insulin regimens for treatment of type 2 diabetes (T2D) are resource-demanding healthcare tasks. Here we propose a model-based reinforcement learning (RL) framework (called RL-DITR), which learns the optimal insulin regimen by analyzing glycemic state rewards through patient model interactions. When evaluated during the development phase for managing hospitalized patients with T2D, RL-DITR achieved superior insulin titration optimization (mean absolute error (MAE) of 1.10 ± 0.03 U) compared to other deep learning models and standard clinical methods. We performed a stepwise clinical validation of the artificial intelligence system from simulation to deployment, demonstrating better performance in glycemic control in inpatients compared to junior and intermediate-level physicians through quantitative (MAE of 1.18 ± 0.09 U) and qualitative metrics from a blinded review. Additionally, we conducted a single-arm, patient-blinded, proof-of-concept feasibility trial in 16 patients with T2D. The primary outcome was difference in mean daily capillary blood glucose during the trial, which decreased from 11.1 (±3.6) to 8.6 (±2.4) mmol L (P < 0.01), meeting the pre-specified endpoint. No episodes of severe hypoglycemia or hyperglycemia with ketosis occurred. These preliminary results warrant further investigation in larger, more diverse clinical studies. ClinicalTrials.gov registration: NCT05409391 .

摘要

针对 2 型糖尿病(T2D)的胰岛素个体化滴定和优化是一项资源密集型的医疗任务。在这里,我们提出了一种基于模型的强化学习(RL)框架(称为 RL-DITR),该框架通过分析患者模型交互作用中的血糖状态奖励来学习最佳的胰岛素方案。在对 T2D 住院患者进行管理的开发阶段进行评估时,与其他深度学习模型和标准临床方法相比,RL-DITR 实现了卓越的胰岛素滴定优化(平均绝对误差(MAE)为 1.10±0.03 U)。我们通过从模拟到部署的逐步临床验证,证明了人工智能系统在住院患者中的血糖控制性能优于初级和中级医生,通过盲审的定量(MAE 为 1.18±0.09 U)和定性指标进行评估。此外,我们还在 16 名 T2D 患者中进行了一项单臂、患者盲法、概念验证可行性试验。主要结局是试验期间平均每日毛细血管血糖的差异,从 11.1(±3.6)mmol/L 降至 8.6(±2.4)mmol/L(P<0.01),达到了预设的终点。没有出现严重低血糖或伴有酮症的高血糖事件。这些初步结果值得在更大、更多样化的临床研究中进一步调查。临床试验.gov 注册:NCT05409391。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/0165b14d9459/41591_2023_2552_Fig13_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/5f88e7b4514f/41591_2023_2552_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/d9efbaeec05a/41591_2023_2552_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/25d382372fef/41591_2023_2552_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/a4cd2260a86c/41591_2023_2552_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/385cac0c45f9/41591_2023_2552_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/33b24936a5db/41591_2023_2552_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/242d5e8212dd/41591_2023_2552_Fig7_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/46e2e4d80df1/41591_2023_2552_Fig8_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/df0fdb926357/41591_2023_2552_Fig9_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/3a921360f1a4/41591_2023_2552_Fig10_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/331f24b2b886/41591_2023_2552_Fig11_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/6424bf6c67dd/41591_2023_2552_Fig12_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/0165b14d9459/41591_2023_2552_Fig13_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/5f88e7b4514f/41591_2023_2552_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/d9efbaeec05a/41591_2023_2552_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/25d382372fef/41591_2023_2552_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/a4cd2260a86c/41591_2023_2552_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/385cac0c45f9/41591_2023_2552_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/33b24936a5db/41591_2023_2552_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/242d5e8212dd/41591_2023_2552_Fig7_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/46e2e4d80df1/41591_2023_2552_Fig8_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/df0fdb926357/41591_2023_2552_Fig9_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/3a921360f1a4/41591_2023_2552_Fig10_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/331f24b2b886/41591_2023_2552_Fig11_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/6424bf6c67dd/41591_2023_2552_Fig12_ESM.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0269/10579102/0165b14d9459/41591_2023_2552_Fig13_ESM.jpg

相似文献

1
Optimized glycemic control of type 2 diabetes with reinforcement learning: a proof-of-concept trial.基于强化学习的 2 型糖尿病优化血糖控制:一项概念验证试验。
Nat Med. 2023 Oct;29(10):2633-2642. doi: 10.1038/s41591-023-02552-9. Epub 2023 Sep 14.
2
Associations of hypoglycemia, glycemic variability and risk of cardiac arrhythmias in insulin-treated patients with type 2 diabetes: a prospective, observational study.胰岛素治疗的 2 型糖尿病患者低血糖、血糖变异性与心律失常风险的相关性:一项前瞻性、观察性研究。
Cardiovasc Diabetol. 2021 Dec 24;20(1):241. doi: 10.1186/s12933-021-01425-0.
3
Prandial premixed insulin analogue regimens versus basal insulin analogue regimens in the management of type 2 diabetes: an evidence-based comparison.餐时预混胰岛素类似物方案与基础胰岛素类似物方案在2型糖尿病管理中的应用:基于证据的比较
Clin Ther. 2007 Jun;29(6 Pt 1):1254-70. doi: 10.1016/j.clinthera.2007.07.003.
4
Liberal Glycemic Control in Critically Ill Patients With Type 2 Diabetes: An Exploratory Study.2型糖尿病重症患者的宽松血糖控制:一项探索性研究。
Crit Care Med. 2016 Sep;44(9):1695-703. doi: 10.1097/CCM.0000000000001815.
5
Mealtime 50/50 basal + prandial insulin analogue mixture with a basal insulin analogue, both plus metformin, in the achievement of target HbA1c and pre- and postprandial blood glucose levels in patients with type 2 diabetes: a multinational, 24-week, randomized, open-label, parallel-group comparison.在2型糖尿病患者中,使用基础胰岛素类似物的餐时50/50基础胰岛素与餐时胰岛素类似物混合制剂,并联合二甲双胍,以实现糖化血红蛋白(HbA1c)目标值以及餐前和餐后血糖水平:一项多国、24周、随机、开放标签、平行组对照研究。
Clin Ther. 2007 Nov;29(11):2349-64. doi: 10.1016/j.clinthera.2007.11.016.
6
Effect of Dapagliflozin on Glycemic Variability in Patients with Type 2 Diabetes under Insulin Glargine Combined with Other Oral Hypoglycemic Drugs.达格列净对甘精胰岛素联合其他口服降糖药治疗的 2 型糖尿病患者血糖变异性的影响。
J Diabetes Res. 2020 Nov 24;2020:6666403. doi: 10.1155/2020/6666403. eCollection 2020.
7
Glucose-lowering agents for treating pre-existing and new-onset diabetes in kidney transplant recipients.用于治疗肾移植受者中已存在的和新发糖尿病的降糖药物。
Cochrane Database Syst Rev. 2017 Feb 27;2(2):CD009966. doi: 10.1002/14651858.CD009966.pub2.
8
Glycemic control in medical inpatients with type 2 diabetes mellitus receiving sliding scale insulin regimens versus routine diabetes medications: a multicenter randomized controlled trial.接受胰岛素滑动剂量方案与常规糖尿病药物治疗的 2 型糖尿病住院患者的血糖控制:一项多中心随机对照试验。
Ann Fam Med. 2003 May-Jun;1(1):29-35. doi: 10.1370/afm.2.
9
Lower mean blood glucose during short-term intensive insulin therapy is associated with long-term glycemic remission in patients with newly diagnosed type 2 diabetes: Evidence-based recommendations for standardization.短期强化胰岛素治疗期间的平均血糖水平较低与新诊断的 2 型糖尿病患者的长期血糖缓解相关:标准化的循证建议。
J Diabetes Investig. 2018 Jul;9(4):908-916. doi: 10.1111/jdi.12782. Epub 2017 Dec 26.
10
Achieve control: a pragmatic clinical trial of insulin glargine 300 U/mL versus other basal insulins in insulin-naïve patients with type 2 diabetes.实现血糖控制:一项在初治2型糖尿病患者中比较300 U/mL甘精胰岛素与其他基础胰岛素的实用临床试验。
Postgrad Med. 2016 Nov;128(8):731-739. doi: 10.1080/00325481.2016.1241663. Epub 2016 Oct 24.

引用本文的文献

1
Optimizing long term disease prevention with reinforcement learning: a framework for precision lipid control.利用强化学习优化长期疾病预防:精准血脂控制框架
NPJ Digit Med. 2025 Aug 27;8(1):553. doi: 10.1038/s41746-025-01951-1.
2
Artificial intelligence in glycemic management for diabetes: Applications, opportunities and challenges.人工智能在糖尿病血糖管理中的应用、机遇与挑战。
J Transl Int Med. 2025 Aug 12;13(4):314-317. doi: 10.1515/jtim-2025-0039. eCollection 2025 Aug.
3
From Big Data to AI-Driven Decisions in Obstructive Sleep Apnea: A Narrative Review Integrating the DDPP Framework.

本文引用的文献

1
9. Pharmacologic Approaches to Glycemic Treatment: Standards of Care in Diabetes-2023.9. 血糖治疗的药物学方法:2023 年糖尿病的护理标准。
Diabetes Care. 2023 Jan 1;46(Suppl 1):S140-S157. doi: 10.2337/dc23-S009.
2
Beyond Greedy Search: Tracking by Multi-Agent Reinforcement Learning-Based Beam Search.超越贪婪搜索:基于多智能体强化学习的束搜索跟踪
IEEE Trans Image Process. 2022;31:6239-6254. doi: 10.1109/TIP.2022.3208437. Epub 2022 Sep 30.
3
Subcutaneous insulin administration by deep reinforcement learning for blood glucose level control of type-2 diabetic patients.
从大数据到阻塞性睡眠呼吸暂停中人工智能驱动的决策:整合DDPP框架的叙述性综述
Nat Sci Sleep. 2025 Aug 21;17:1863-1882. doi: 10.2147/NSS.S543091. eCollection 2025.
4
The coming era of proteomics-driven precision medicine.蛋白质组学驱动的精准医学时代即将来临。
Natl Sci Rev. 2025 Jul 14;12(8):nwaf278. doi: 10.1093/nsr/nwaf278. eCollection 2025 Aug.
5
Applying large language model for automated quality scoring of radiology requisitions using a standardized criteria.使用标准化标准将大语言模型应用于放射检查申请的自动质量评分。
Eur Radiol. 2025 Aug 20. doi: 10.1007/s00330-025-11933-2.
6
Machine learning in endocrinology: current applications and future perspectives.内分泌学中的机器学习:当前应用与未来展望。
Endocrine. 2025 Aug 20. doi: 10.1007/s12020-025-04378-6.
7
DeLLiriuM: A large language model for delirium prediction in the ICU using structured EHR.谵妄:一种使用结构化电子健康记录在重症监护病房预测谵妄的大型语言模型。
Res Sq. 2025 Aug 13:rs.3.rs-7216692. doi: 10.21203/rs.3.rs-7216692/v1.
8
Benchmarking Transformer Embedding Models for Biomedical Terminology Standardization.用于生物医学术语标准化的基准测试变压器嵌入模型
Mach Learn Appl. 2025 Sep;21. doi: 10.1016/j.mlwa.2025.100683. Epub 2025 Jun 5.
9
Artificial Intelligence in Diabetes Care: Applications, Challenges, and Opportunities Ahead.糖尿病护理中的人工智能:应用、挑战与未来机遇
Endocr Pract. 2025 Jul 17. doi: 10.1016/j.eprac.2025.07.008.
10
Empirically derived evaluation requirements for responsible deployments of AI in safety-critical settings.针对安全关键环境中人工智能的负责任部署,基于经验得出的评估要求。
NPJ Digit Med. 2025 Jun 18;8(1):374. doi: 10.1038/s41746-025-01784-y.
通过深度强化学习进行皮下胰岛素给药,以控制 2 型糖尿病患者的血糖水平。
Comput Biol Med. 2022 Sep;148:105860. doi: 10.1016/j.compbiomed.2022.105860. Epub 2022 Jul 14.
4
Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI.人工智能驱动的决策支持系统早期临床评估报告指南:DECIDE-AI。
Nat Med. 2022 May;28(5):924-933. doi: 10.1038/s41591-022-01772-9. Epub 2022 May 18.
5
Learning dynamic treatment strategies for coronary heart diseases by artificial intelligence: real-world data-driven study.通过人工智能学习冠心病的动态治疗策略:基于真实世界数据的研究。
BMC Med Inform Decis Mak. 2022 Feb 15;22(1):39. doi: 10.1186/s12911-022-01774-0.
6
IDF Diabetes Atlas: Global, regional and country-level diabetes prevalence estimates for 2021 and projections for 2045.国际糖尿病联盟(IDF)糖尿病地图集:2021 年全球、区域和国家糖尿病患病率估算值以及 2045 年预测值。
Diabetes Res Clin Pract. 2022 Jan;183:109119. doi: 10.1016/j.diabres.2021.109119. Epub 2021 Dec 6.
7
Reinforcement learning for intelligent healthcare applications: A survey.强化学习在智能医疗保健应用中的研究进展:综述
Artif Intell Med. 2020 Sep;109:101964. doi: 10.1016/j.artmed.2020.101964. Epub 2020 Sep 28.
8
Designing an integrated, nurse-driven and home-based digital intervention to improve insulin management in under-resourced settings.设计一种综合的、由护士主导的家庭式数字干预措施,以改善资源匮乏地区的胰岛素管理。
Ther Adv Endocrinol Metab. 2021 Oct 29;12:20420188211054688. doi: 10.1177/20420188211054688. eCollection 2021.
9
Deep-learning models for the detection and incidence prediction of chronic kidney disease and type 2 diabetes from retinal fundus images.基于视网膜眼底图像的慢性肾脏病和 2 型糖尿病的检测和发病预测的深度学习模型。
Nat Biomed Eng. 2021 Jun;5(6):533-545. doi: 10.1038/s41551-021-00745-6. Epub 2021 Jun 15.
10
Clinical integration of machine learning for curative-intent radiation treatment of patients with prostate cancer.临床整合机器学习治疗前列腺癌患者的治疗意图放射治疗。
Nat Med. 2021 Jun;27(6):999-1005. doi: 10.1038/s41591-021-01359-w. Epub 2021 Jun 3.