J Pediatr Ophthalmol Strabismus. 2024 Mar-Apr;61(2):86-89. doi: 10.3928/01913913-20231005-02. Epub 2023 Oct 26.
To assess the responses of the ChatGPT-4, the forerunner artificial intelligence-based chatbot, to frequently asked questions regarding two common pediatric ophthalmologic disorders, amblyopia and childhood myopia.
Twenty-seven questions about amblyopia and 28 questions about childhood myopia were asked of the ChatGPT twice (totally 110 questions). The responses were evaluated by two pediatric ophthalmologists as acceptable, incomplete, or unacceptable.
There was remarkable agreement (96.4%) between the two pediatric ophthalmologists on their assessment of the responses. Acceptable responses were provided by the ChatGPT to 93 of 110 (84.6%) questions in total (44 of 54 [81.5%] for amblyopia and 49 of 56 [87.5%] questions for childhood myopia). Seven of 54 (12.9%) responses to questions on amblyopia were graded as incomplete compared to 4 of 56 (7.1%) of questions on childhood myopia. The ChatGPT gave inappropriate responses to three questions about amblyopia (5.6%) and childhood myopia (5.4%). The most noticeable inappropriate responses were related to the definition of reverse amblyopia and the threshold of refractive error for prescription of spectacles to children with myopia.
The ChatGPT has the potential to serve as an adjunct informational tool for pediatric ophthalmology patients and their caregivers by demonstrating a relatively good performance in answering 84.6% of the most frequently asked questions about amblyopia and childhood myopia. .
评估 ChatGPT-4(一种基于人工智能的聊天机器人先驱)对两种常见儿科眼科疾病——弱视和儿童近视的常见问题的反应。
向 ChatGPT 提出了 27 个关于弱视的问题和 28 个关于儿童近视的问题,共 110 个问题。由两名小儿眼科医生评估这些回答是否可以接受、不完整或不可接受。
两名小儿眼科医生对回答的评估结果具有显著一致性(96.4%)。ChatGPT 总共对 110 个问题中的 93 个(54 个问题中的 44 个[81.5%]为弱视,56 个问题中的 49 个[87.5%]为儿童近视)给出了可接受的回答。与儿童近视的 56 个问题中 4 个(7.1%)相比,有 7 个弱视问题(12.9%)的回答被评为不完整。ChatGPT 对三个弱视问题(5.6%)和三个儿童近视问题(5.4%)给出了不恰当的回答。最明显的不恰当回答与弱视的定义和为近视儿童配镜的屈光不正阈值有关。
ChatGPT 通过相对较好地回答弱视和儿童近视这两种疾病中最常见问题的 84.6%,具有成为小儿眼科学患者及其照顾者辅助信息工具的潜力。