文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

Comparison of artificial intelligence-generated and physician-generated patient education materials on early diabetic kidney disease.

作者信息

Cheng Miaomiao, Zhang Qi, Liang Hua, Wang Yanan, Qin Jun, Gong Lei, Wang Sha, Li Luyao, Xiao Xiaoyan

机构信息

Qilu Hospital of Shandong University, Department of Nephrology, Jinan, Shandong, China.

Healthcare Big Data Research Institute, Cheeloo College of Medicine, Shandong University, Jinan, Shandong, China.

出版信息

Front Endocrinol (Lausanne). 2025 Apr 22;16:1559265. doi: 10.3389/fendo.2025.1559265. eCollection 2025.


DOI:10.3389/fendo.2025.1559265
PMID:40331140
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC12052532/
Abstract

BACKGROUND: Diabetic kidney disease (DKD) is a common and serious complication of diabetes mellitus and has become the most important cause of end-stage renal disease (ESRD). In light of the rising prevalence of diabetes, there is a growing imperative for the early detection and intervention of DKD. With the rapid development of artificial intelligence (AI) technologies, its potential applications in patient education are receiving increasing attention, especially large language models (LLMs). The aim of this study was to evaluate the quality of LLMs-generated patient education materials (PEMs) for early DKD and to explore its feasibility in patient education. METHODS: Four LLMs (ERNIE Bot 4.0, GPT-4o, ChatGLM4, and ChatGPT-o1) were selected for this study to generate PEMs. Among them, ERNIE Bot 4.0, GPT-4o, and ChatGLM4 generated 2 versions of PEMs based on American Diabetes Association(ADA) guidelines and without ADA guidelines, respectively. ChatGPT-o1 only generated a PEM without ADA guidelines. An experienced physician wrote a PEM based on ADA guidelines. All materials were assessed using a Likert scale which covered the dimensions of accuracy, completeness, safety, and patient comprehensibility. A total of 7 medical experts (including nephrologists and endocrinologists) and 50 diabetic patients were invited to evaluate the study. We recorded basic information on the patient evaluators. RESULTS: Experts evaluated PEMs from ERNIE Bot 4.0, GPT-4o, ChatGLM4, and ChatGPT-o1, plus physician-sourced PEM. Results showed ERNIE Bot 4.0's non-guideline PEM and physician-sourced PEM were the top two. Patient assessments of the 2 top-scoring PEMs found that the ERNIE Bot 4.0's non-guideline PEM performed as well as, if not slightly better than, the physician-sourced PEM in terms of patient comprehensibility, completeness, and safety. In addition, the non-guideline-based PEM was preferred for patients with a history of diabetes longer than 5 years and for patients with proteinuria. Surprisingly, GPT-4o and ChatGLM4's non-guideline PEMs outperformed guideline-based ones. CONCLUSION: The LLMs-sourced PEMs, especially the ERNIE Bot 4.0's non-guideline PEM for early DKD, performed comparably to the physician-sourced PEM in terms of accuracy, completeness, safety, and patient comprehensibility, and exerted a high degree of feasibility. AI may show the potential for broader applications in patient education in the near future.

摘要
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dedd/12052532/377b065f9fb6/fendo-16-1559265-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dedd/12052532/93d7b57da2fd/fendo-16-1559265-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dedd/12052532/5b2912fbd5f3/fendo-16-1559265-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dedd/12052532/d421971e2ccf/fendo-16-1559265-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dedd/12052532/377b065f9fb6/fendo-16-1559265-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dedd/12052532/93d7b57da2fd/fendo-16-1559265-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dedd/12052532/5b2912fbd5f3/fendo-16-1559265-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dedd/12052532/d421971e2ccf/fendo-16-1559265-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/dedd/12052532/377b065f9fb6/fendo-16-1559265-g004.jpg

相似文献

[1]
Comparison of artificial intelligence-generated and physician-generated patient education materials on early diabetic kidney disease.

Front Endocrinol (Lausanne). 2025-4-22

[2]
Artificial Intelligence-Generated Patient Education Materials for Helicobacter pylori Infection: A Comparative Analysis.

Helicobacter. 2024

[3]
Physician Versus Large Language Model Chatbot Responses to Web-Based Questions From Autistic Patients in Chinese: Cross-Sectional Comparative Analysis.

J Med Internet Res. 2024-4-30

[4]
Assessing the Application of Large Language Models in Generating Dermatologic Patient Education Materials According to Reading Level: Qualitative Study.

JMIR Dermatol. 2024-5-16

[5]
Evaluating the Effectiveness of Large Language Models in Providing Patient Education for Chinese Patients With Ocular Myasthenia Gravis: Mixed Methods Study.

J Med Internet Res. 2025-4-10

[6]
The performance of ChatGPT and ERNIE Bot in surgical resident examinations.

Int J Med Inform. 2025-8

[7]
Comparing the performance of ChatGPT and ERNIE Bot in answering questions regarding liver cancer interventional radiology in Chinese and English contexts: A comparative study.

Digit Health. 2025-1-23

[8]
Do people prefer AI-generated patient educational materials over traditional ones?

Patient Educ Couns. 2025-5

[9]
Comparing Artificial Intelligence-Generated and Clinician-Created Personalized Self-Management Guidance for Patients With Knee Osteoarthritis: Blinded Observational Study.

J Med Internet Res. 2025-5-7

[10]
Application value of generative artificial intelligence in the field of stomatology.

Hua Xi Kou Qiang Yi Xue Za Zhi. 2024-12-1

本文引用的文献

[1]
Worldwide trends in diabetes prevalence and treatment from 1990 to 2022: a pooled analysis of 1108 population-representative studies with 141 million participants.

Lancet. 2024-11-23

[2]
Large language models in patient education: a scoping review of applications in medicine.

Front Med (Lausanne). 2024-10-29

[3]
Artificial intelligence chatbots as sources of patient education material for cataract surgery: ChatGPT-4 versus Google Bard.

BMJ Open Ophthalmol. 2024-10-17

[4]
The Potential of Large Language Model-Based Chatbot Solutions for Supplementary Counseling in Gestational Diabetes Care.

J Diabetes Sci Technol. 2024-9

[5]
Integrated image-based deep learning and language models for primary diabetes care.

Nat Med. 2024-10

[6]
The Role of Artificial Intelligence in Medical Education: A Systematic Review.

Surg Innov. 2024-8

[7]
Accuracy and Readability of Kidney Stone Patient Information Materials Generated by a Large Language Model Compared to Official Urologic Organizations.

Urology. 2024-4

[8]
Structured information extraction from scientific text with large language models.

Nat Commun. 2024-2-15

[9]
Large Language Models in Medicine: The Potentials and Pitfalls : A Narrative Review.

Ann Intern Med. 2024-2

[10]
A study of generative large language model for medical research and healthcare.

NPJ Digit Med. 2023-11-16

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索