文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

评估大型语言模型为患者提供的乳腺癌手术准备和康复指导的准确性和可读性。

Assessing the Accuracy and Readability of Large Language Model Guidance for Patients on Breast Cancer Surgery Preparation and Recovery.

作者信息

Palmarin Elena, Lando Stefania, Marchet Alberto, Saibene Tania, Michieletto Silvia, Cagol Matteo, Milardi Francesco, Gregori Dario, Lorenzoni Giulia

机构信息

Unit of Biostatistics, Epidemiology and Public Health, Department of Cardiac, Thoracic, Vascular Sciences and Public Health, University of Padova, 35131 Padova, Italy.

Breast Surgery Unit, Veneto Institute of Oncology IOV, IRCCS, 35128 Padova, Italy.

出版信息

J Clin Med. 2025 Aug 1;14(15):5411. doi: 10.3390/jcm14155411.


DOI:10.3390/jcm14155411
PMID:40807032
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC12347998/
Abstract

Accurate and accessible perioperative health information empowers patients and enhances recovery outcomes. Artificial intelligence tools, such as ChatGPT, have garnered attention for their potential in health communication. This study evaluates the accuracy and readability of responses generated by ChatGPT to questions commonly asked about breast cancer. Fifteen simulated patient queries about breast cancer surgery preparation and recovery were prepared. Responses generated by ChatGPT (4o version) were evaluated for accuracy by a pool of breast surgeons using a 4-point Likert scale. Readability was assessed with the Flesch-Kincaid Grade Level (FKGL). Descriptive statistics were used to summarize the findings. Of the 15 responses evaluated, 11 were rated as "accurate and comprehensive", while 4 out of 15 were deemed "correct but incomplete". No responses were classified as "partially incorrect" or "completely incorrect". The median FKGL score was 11.2, indicating a high school reading level. While most responses were technically accurate, the complexity of language exceeded the recommended readability levels for patient-directed materials. The model shows potential as a complementary resource for patient education in breast cancer surgery, but should not replace direct interaction with healthcare providers. Future research should focus on enhancing language models' ability to generate accessible and patient-friendly content.

摘要

准确且易于获取的围手术期健康信息能赋予患者力量并改善康复效果。诸如ChatGPT之类的人工智能工具因其在健康交流方面的潜力而受到关注。本研究评估了ChatGPT对常见乳腺癌问题所生成回答的准确性和可读性。准备了15个关于乳腺癌手术准备和康复的模拟患者问题。由一组乳腺外科医生使用4点李克特量表对ChatGPT(4.0版本)生成的回答进行准确性评估。使用弗莱什-金凯德年级水平(FKGL)评估可读性。采用描述性统计来总结研究结果。在评估的15个回答中,11个被评为“准确且全面”,而15个中有4个被认为“正确但不完整”。没有回答被归类为“部分错误”或“完全错误”。FKGL得分中位数为11.2,表明为高中阅读水平。虽然大多数回答在技术上是准确的,但语言的复杂性超过了针对患者的材料所建议的可读性水平。该模型显示出作为乳腺癌手术患者教育补充资源的潜力,但不应取代与医疗服务提供者的直接互动。未来的研究应侧重于提高语言模型生成易懂且对患者友好内容的能力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba7e/12347998/3b4264915d47/jcm-14-05411-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba7e/12347998/3b4264915d47/jcm-14-05411-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ba7e/12347998/3b4264915d47/jcm-14-05411-g001.jpg

相似文献

[1]
Assessing the Accuracy and Readability of Large Language Model Guidance for Patients on Breast Cancer Surgery Preparation and Recovery.

J Clin Med. 2025-8-1

[2]
Using Artificial Intelligence ChatGPT to Access Medical Information About Chemical Eye Injuries: Comparative Study.

JMIR Form Res. 2025-8-13

[3]
Assessing ChatGPT's Educational Potential in Lung Cancer Radiotherapy From Clinician and Patient Perspectives: Content Quality and Readability Analysis.

JMIR Cancer. 2025-8-13

[4]
Artificial Intelligence in Peripheral Artery Disease Education: A Battle Between ChatGPT and Google Gemini.

Cureus. 2025-6-1

[5]
Using Artificial Intelligence ChatGPT to Access Medical Information about Chemical Eye Injuries: A Comparative Study.

JMIR Form Res. 2025-6-30

[6]
Artificial Intelligence Shows Limited Success in Improving Readability Levels of Spanish-language Orthopaedic Patient Education Materials.

Clin Orthop Relat Res. 2025-2-11

[7]
Is Information About Musculoskeletal Malignancies From Large Language Models or Web Resources at a Suitable Reading Level for Patients?

Clin Orthop Relat Res. 2025-2-1

[8]
Prescription of Controlled Substances: Benefits and Risks

2025-1

[9]
Can Artificial Intelligence Improve the Readability of Patient Education Materials?

Clin Orthop Relat Res. 2023-11-1

[10]
Evaluating DeepResearch and DeepThink in anterior cruciate ligament surgery patient education: ChatGPT-4o excels in comprehensiveness, DeepSeek R1 leads in clarity and readability of orthopaedic information.

Knee Surg Sports Traumatol Arthrosc. 2025-6-1

本文引用的文献

[1]
ChatGPT's Agreement with the Recommendations from the 18th St. Gallen International Consensus Conference on the Treatment of Early Breast Cancer.

Cancers (Basel). 2024-12-13

[2]
Assessing Fat Grafting in Breast Surgery: A Narrative Review of Evaluation Techniques.

J Clin Med. 2024-11-27

[3]
Evaluating the Accuracy of Large Language Model (ChatGPT) in Providing Information on Metastatic Breast Cancer.

Adv Pharm Bull. 2024-10

[4]
The utility of ChatGPT in gender-affirming mastectomy education.

J Plast Reconstr Aesthet Surg. 2024-12

[5]
ChatGPT as Valuable Patient Education Resource in Breast Cancer Care.

Ann Surg Oncol. 2025-2

[6]
The Cancer Patient Empowerment Program: A Comprehensive Approach to Reducing Psychological Distress in Cancer Survivors, with Insights from a Mixed-Model Analysis, Including Implications for Breast Cancer Patients.

Cancers (Basel). 2024-10-2

[7]
An assessment of ChatGPT's responses to frequently asked questions about cervical and breast cancer.

BMC Womens Health. 2024-9-2

[8]
Generative artificial intelligence as a source of breast cancer information for patients: Proceed with caution.

Cancer. 2025-1-1

[9]
ChatGPT in medicine: A cross-disciplinary systematic review of ChatGPT's (artificial intelligence) role in research, clinical practice, education, and patient interaction.

Medicine (Baltimore). 2024-8-9

[10]
Quality of ChatGPT-Generated Therapy Recommendations for Breast Cancer Treatment in Gynecology.

Curr Oncol. 2024-7-1

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索