文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

Evaluation of the quality and readability of ChatGPT responses to frequently asked questions about myopia in traditional Chinese language.

作者信息

Chang Li-Chun, Sun Chi-Chin, Chen Ting-Han, Tsai Der-Chong, Lin Hui-Ling, Liao Li-Ling

机构信息

School of Nursing, Chang Gung University of Science and Technology, Gueishan.

School of Nursing, College of Medicine, Chang Gung University, Tao-Yuan.

出版信息

Digit Health. 2024 Sep 2;10:20552076241277021. doi: 10.1177/20552076241277021. eCollection 2024 Jan-Dec.


DOI:10.1177/20552076241277021
PMID:39229462
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11369861/
Abstract

INTRODUCTION: ChatGPT can serve as an adjunct informational tool for ophthalmologists and their patients. However, the reliability and readability of its responses to myopia-related queries in the Chinese language remain underexplored. PURPOSE: This study aimed to evaluate the ability of ChatGPT to address frequently asked questions (FAQs) about myopia by parents and caregivers. METHOD: Myopia-related FAQs were input three times into fresh ChatGPT sessions, and the responses were evaluated by 10 ophthalmologists using a Likert scale for appropriateness, usability, and clarity. The Chinese Readability Index Explorer (CRIE) was used to evaluate the readability of each response. Inter-rater reliability among the reviewers was examined using Cohen's kappa coefficient, and Spearman's rank correlation analysis and one-way analysis of variance were used to investigate the relationship between CRIE scores and each criterion. RESULTS: Forty-five percent of the responses of ChatGPT in Chinese language were appropriate and usable and only 35% met all the set criteria. The CRIE scores for 20 ChatGPT responses ranged from 7.29 to 12.09, indicating that the readability level was equivalent to a middle-to-high school level. Responses about the treatment efficacy and side effects were deficient for all three criteria. CONCLUSIONS: The performance of ChatGPT in addressing pediatric myopia-related questions is currently suboptimal. As parents increasingly utilize digital resources to obtain health information, it has become crucial for eye care professionals to familiarize themselves with artificial intelligence-driven information on pediatric myopia.

摘要
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4eb9/11369861/f6ea89aa8099/10.1177_20552076241277021-fig1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4eb9/11369861/f6ea89aa8099/10.1177_20552076241277021-fig1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4eb9/11369861/f6ea89aa8099/10.1177_20552076241277021-fig1.jpg

相似文献

[1]
Evaluation of the quality and readability of ChatGPT responses to frequently asked questions about myopia in traditional Chinese language.

Digit Health. 2024-9-2

[2]
Dr. Google vs. Dr. ChatGPT: Exploring the Use of Artificial Intelligence in Ophthalmology by Comparing the Accuracy, Safety, and Readability of Responses to Frequently Asked Patient Questions Regarding Cataracts and Cataract Surgery.

Semin Ophthalmol. 2024-8

[3]
Assessment of the Responses of the Artificial Intelligence-based Chatbot ChatGPT-4 to Frequently Asked Questions About Amblyopia and Childhood Myopia.

J Pediatr Ophthalmol Strabismus. 2024

[4]
Is Information About Musculoskeletal Malignancies From Large Language Models or Web Resources at a Suitable Reading Level for Patients?

Clin Orthop Relat Res. 2025-2-1

[5]
Assessing the utility of ChatGPT as an artificial intelligence-based large language model for information to answer questions on myopia.

Ophthalmic Physiol Opt. 2023-11

[6]
Is ChatGPT a Reliable Source of Patient Information on Asthma?

Cureus. 2024-7-8

[7]
Benchmarking large language models' performances for myopia care: a comparative analysis of ChatGPT-3.5, ChatGPT-4.0, and Google Bard.

EBioMedicine. 2023-9

[8]
Digesting Digital Health: A Study of Appropriateness and Readability of ChatGPT-Generated Gastroenterological Information.

Clin Transl Gastroenterol. 2024-11-1

[9]
ChatGPT vs Google for Queries Related to Dementia and Other Cognitive Decline: Comparison of Results.

J Med Internet Res. 2023-7-25

[10]
Evaluating the Efficacy of ChatGPT as a Patient Education Tool in Prostate Cancer: Multimetric Assessment.

J Med Internet Res. 2024-8-14

引用本文的文献

[1]
Leveraging ChatGPT to strengthen pediatric healthcare systems: a systematic review.

Eur J Pediatr. 2025-7-12

[2]
Large language models in the management of chronic ocular diseases: a scoping review.

Front Cell Dev Biol. 2025-6-18

[3]
Enhancing ophthalmology students' awareness of retinitis pigmentosa: assessing the efficacy of ChatGPT in AI-assisted teaching of rare diseases-a quasi-experimental study.

Front Med (Lausanne). 2025-3-18

本文引用的文献

[1]
Evaluating the accuracy and readability of ChatGPT in providing parental guidance for adenoidectomy, tonsillectomy, and ventilation tube insertion surgery.

Int J Pediatr Otorhinolaryngol. 2024-6

[2]
Appropriateness of ChatGPT in Answering Heart Failure Related Questions.

Heart Lung Circ. 2024-9

[3]
Empowering inclusivity: improving readability of living kidney donation information with ChatGPT.

Front Digit Health. 2024-4-10

[4]
A Multidisciplinary Assessment of ChatGPT's Knowledge of Amyloidosis: Observational Study.

JMIR Cardio. 2024-4-19

[5]
ChatGPT-3.5 and Bing Chat in ophthalmology: an updated evaluation of performance, readability, and informative sources.

Eye (Lond). 2024-7

[6]
ChatGPT: Is This Patient Education Tool for Urological Malignancies Readable for the General Population?

Res Rep Urol. 2024-1-16

[7]
Talking technology: exploring chatbots as a tool for cataract patient education.

Clin Exp Optom. 2025-1

[8]
Performance of ChatGPT incorporated chain-of-thought method in bilingual nuclear medicine physician board examinations.

Digit Health. 2024-1-5

[9]
Assessment of the Responses of the Artificial Intelligence-based Chatbot ChatGPT-4 to Frequently Asked Questions About Amblyopia and Childhood Myopia.

J Pediatr Ophthalmol Strabismus. 2024

[10]
Benchmarking large language models' performances for myopia care: a comparative analysis of ChatGPT-3.5, ChatGPT-4.0, and Google Bard.

EBioMedicine. 2023-9

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索