Potapenko Ivan, Malmqvist Lasse, Subhi Yousif, Hamann Steffen
Department of Ophthalmology, Rigshospitalet, Valdemar Hansens Vej 3, 2600, Glostrup, Denmark.
Department of Clinical Research, University of Southern Denmark, Odense, Denmark.
Ophthalmol Ther. 2023 Dec;12(6):3109-3119. doi: 10.1007/s40123-023-00800-2. Epub 2023 Sep 12.
Optic disc drusen (ODD) are acellular deposits in the optic nerve head, which are most often benign and asymptomatic. Patients may develop visual field defects and be at increased risk of ischemic co-morbidities. As ODD can be difficult to distinguish from papilledema, patients are at risk of unnecessary clinical workups. Patient information is a key aspect of ODD management. In this study, we explored the accuracy of ChatGPT responses for typical patient questions on ODD.
Two content experts reached consensus on 20 typical patient questions. We retrieved five separate responses for each question from ChatGPT, totaling 100 responses. Each response was evaluated on a 5-point Likert-scale on accuracy by each content expert in an individual fashion.
The two experts were in fair/substantial agreement in the evaluation of responses (Cronbach's alpha: 0.64). Of the 100 responses, 17 were relevant and without any inaccuracies, 78 were relevant and with inaccuracies not being harmful, and five were relevant and with inaccuracies potentially harmful. The lowest accuracy scores were obtained for questions dealing with treatment and prognosis.
ChatGPT often provides relevant answers for patient questions on ODD, but inaccuracies become potentially harmful when questions deal with treatment and prognosis.
视盘玻璃疣(ODD)是视神经乳头处的无细胞沉积物,大多为良性且无症状。患者可能会出现视野缺损,并且患缺血性合并症的风险增加。由于ODD可能难以与视乳头水肿区分,患者有接受不必要临床检查的风险。患者信息是ODD管理的一个关键方面。在本研究中,我们探讨了ChatGPT对关于ODD的典型患者问题的回答的准确性。
两位内容专家就20个典型患者问题达成共识。我们从ChatGPT为每个问题检索了5个不同的回答,共100个回答。每位内容专家以个人方式根据准确性在5点李克特量表上对每个回答进行评估。
两位专家在回答评估中达成了中等/高度一致(克朗巴哈系数:0.64)。在这100个回答中,17个相关且无任何不准确之处,78个相关且不准确但无害,5个相关且不准确可能有害。关于治疗和预后的问题获得的准确性分数最低。
ChatGPT经常为关于ODD的患者问题提供相关答案,但当问题涉及治疗和预后时,不准确之处可能会造成危害。