Suppr超能文献

基于人工智能的ChatGPT对患者关于视盘玻璃疣问题的回答。

Artificial Intelligence-Based ChatGPT Responses for Patient Questions on Optic Disc Drusen.

作者信息

Potapenko Ivan, Malmqvist Lasse, Subhi Yousif, Hamann Steffen

机构信息

Department of Ophthalmology, Rigshospitalet, Valdemar Hansens Vej 3, 2600, Glostrup, Denmark.

Department of Clinical Research, University of Southern Denmark, Odense, Denmark.

出版信息

Ophthalmol Ther. 2023 Dec;12(6):3109-3119. doi: 10.1007/s40123-023-00800-2. Epub 2023 Sep 12.

Abstract

INTRODUCTION

Optic disc drusen (ODD) are acellular deposits in the optic nerve head, which are most often benign and asymptomatic. Patients may develop visual field defects and be at increased risk of ischemic co-morbidities. As ODD can be difficult to distinguish from papilledema, patients are at risk of unnecessary clinical workups. Patient information is a key aspect of ODD management. In this study, we explored the accuracy of ChatGPT responses for typical patient questions on ODD.

METHODS

Two content experts reached consensus on 20 typical patient questions. We retrieved five separate responses for each question from ChatGPT, totaling 100 responses. Each response was evaluated on a 5-point Likert-scale on accuracy by each content expert in an individual fashion.

RESULTS

The two experts were in fair/substantial agreement in the evaluation of responses (Cronbach's alpha: 0.64). Of the 100 responses, 17 were relevant and without any inaccuracies, 78 were relevant and with inaccuracies not being harmful, and five were relevant and with inaccuracies potentially harmful. The lowest accuracy scores were obtained for questions dealing with treatment and prognosis.

CONCLUSIONS

ChatGPT often provides relevant answers for patient questions on ODD, but inaccuracies become potentially harmful when questions deal with treatment and prognosis.

摘要

引言

视盘玻璃疣(ODD)是视神经乳头处的无细胞沉积物,大多为良性且无症状。患者可能会出现视野缺损,并且患缺血性合并症的风险增加。由于ODD可能难以与视乳头水肿区分,患者有接受不必要临床检查的风险。患者信息是ODD管理的一个关键方面。在本研究中,我们探讨了ChatGPT对关于ODD的典型患者问题的回答的准确性。

方法

两位内容专家就20个典型患者问题达成共识。我们从ChatGPT为每个问题检索了5个不同的回答,共100个回答。每位内容专家以个人方式根据准确性在5点李克特量表上对每个回答进行评估。

结果

两位专家在回答评估中达成了中等/高度一致(克朗巴哈系数:0.64)。在这100个回答中,17个相关且无任何不准确之处,78个相关且不准确但无害,5个相关且不准确可能有害。关于治疗和预后的问题获得的准确性分数最低。

结论

ChatGPT经常为关于ODD的患者问题提供相关答案,但当问题涉及治疗和预后时,不准确之处可能会造成危害。

相似文献

1
Artificial Intelligence-Based ChatGPT Responses for Patient Questions on Optic Disc Drusen.
Ophthalmol Ther. 2023 Dec;12(6):3109-3119. doi: 10.1007/s40123-023-00800-2. Epub 2023 Sep 12.
2
Optic disc drusen: a systematic review : Up-to-date and future perspective.
Int Ophthalmol. 2020 Aug;40(8):2119-2127. doi: 10.1007/s10792-020-01365-w. Epub 2020 May 7.
3
Assessing the utility of ChatGPT as an artificial intelligence-based large language model for information to answer questions on myopia.
Ophthalmic Physiol Opt. 2023 Nov;43(6):1562-1570. doi: 10.1111/opo.13207. Epub 2023 Jul 21.
4
Artificial intelligence and allergic rhinitis: does ChatGPT increase or impair the knowledge?
J Public Health (Oxf). 2024 Feb 23;46(1):123-126. doi: 10.1093/pubmed/fdad219.
5
Optic disc drusen: understanding an old problem from a new perspective.
Acta Ophthalmol. 2018 Nov;96(7):673-684. doi: 10.1111/aos.13748. Epub 2018 Apr 16.
6
Discriminating Between Papilledema and Optic Disc Drusen Using 3D Structural Analysis of the Optic Nerve Head.
Neurology. 2023 Jan 10;100(2):e192-e202. doi: 10.1212/WNL.0000000000201350. Epub 2022 Sep 29.
7
Prevalence and histopathological signatures of optic disc drusen based on microscopy of 1713 enucleated eyes.
Acta Ophthalmol. 2020 Mar;98(2):195-200. doi: 10.1111/aos.14180. Epub 2019 Jul 1.
8
Long-term evolution of superficial optic disc drusen.
Acta Ophthalmol. 2017 Jun;95(4):352-356. doi: 10.1111/aos.13315. Epub 2016 Dec 20.
9
Investigating the Accuracy and Completeness of an Artificial Intelligence Large Language Model About Uveitis: An Evaluation of ChatGPT.
Ocul Immunol Inflamm. 2024 Nov;32(9):2052-2055. doi: 10.1080/09273948.2024.2317417. Epub 2024 Feb 23.
10
[Optic disc drusen or true papilledema?].
Rev Neurol (Paris). 2010 Jan;166(1):32-8. doi: 10.1016/j.neurol.2009.05.003. Epub 2009 Jun 21.

引用本文的文献

1
Comparative analysis of ChatGPT-4o mini, ChatGPT-4o and Gemini Advanced in the treatment of postmenopausal osteoporosis.
BMC Musculoskelet Disord. 2025 Apr 16;26(1):369. doi: 10.1186/s12891-025-08601-3.
2
Evaluating the Efficacy of Artificial Intelligence-Driven Chatbots in Addressing Queries on Vernal Conjunctivitis.
Cureus. 2025 Feb 26;17(2):e79688. doi: 10.7759/cureus.79688. eCollection 2025 Feb.
3
Large Language Models in Ophthalmology: A Review of Publications from Top Ophthalmology Journals.
Ophthalmol Sci. 2024 Dec 17;5(3):100681. doi: 10.1016/j.xops.2024.100681. eCollection 2025 May-Jun.
4
Large Language Models for Chatbot Health Advice Studies: A Systematic Review.
JAMA Netw Open. 2025 Feb 3;8(2):e2457879. doi: 10.1001/jamanetworkopen.2024.57879.
6
The Goldilocks Zone: Finding the right balance of user and institutional risk for suicide-related generative AI queries.
PLOS Digit Health. 2025 Jan 8;4(1):e0000711. doi: 10.1371/journal.pdig.0000711. eCollection 2025 Jan.
7
Large language models in patient education: a scoping review of applications in medicine.
Front Med (Lausanne). 2024 Oct 29;11:1477898. doi: 10.3389/fmed.2024.1477898. eCollection 2024.
8
Exploring the Potential of Code-Free Custom GPTs in Ophthalmology: An Early Analysis of GPT Store and User-Creator Guidance.
Ophthalmol Ther. 2024 Oct;13(10):2697-2713. doi: 10.1007/s40123-024-01014-w. Epub 2024 Aug 14.
9
Blinded by Stress: A Patient and Physician Perspective on Central Serous Chorioretinopathy.
Ophthalmol Ther. 2024 Apr;13(4):861-866. doi: 10.1007/s40123-024-00907-0. Epub 2024 Feb 22.

本文引用的文献

1
Using cognitive psychology to understand GPT-3.
Proc Natl Acad Sci U S A. 2023 Feb 7;120(6):e2218523120. doi: 10.1073/pnas.2218523120. Epub 2023 Feb 2.
4
Branch retinal vein occlusion precipitated by compression between a major retinal artery and underlying optic disc drusen.
Acta Ophthalmol. 2021 Dec;99(8):931-933. doi: 10.1111/aos.14840. Epub 2021 Apr 20.
6
Young Adults With Anterior Ischemic Optic Neuropathy: A Multicenter Optic Disc Drusen Study.
Am J Ophthalmol. 2020 Sep;217:174-181. doi: 10.1016/j.ajo.2020.03.052. Epub 2020 Apr 13.
8
Prevalence and histopathological signatures of optic disc drusen based on microscopy of 1713 enucleated eyes.
Acta Ophthalmol. 2020 Mar;98(2):195-200. doi: 10.1111/aos.14180. Epub 2019 Jul 1.
9
Optic disc drusen: understanding an old problem from a new perspective.
Acta Ophthalmol. 2018 Nov;96(7):673-684. doi: 10.1111/aos.13748. Epub 2018 Apr 16.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验