Senbaykal Yigit Ece, Taskirdi Ilke, Haci Idil Akay, Tuncel Tuba
Department of Pediatrics, Division of Pediatric Allergy and Immunology, Izmir City Hospital, Izmir, Turkey.
Department of Pediatrics, Division of Pediatric Allergy and Immunology, Faculty of Medicine, Izmir Katip Celebi University, Izmir, Turkey.
J Asthma. 2025 Aug 1:1-7. doi: 10.1080/02770903.2025.2531500.
Asthma is the most common chronic disease of childhood, characterized by symptoms such as wheezing, shortness of breath, and coughing. With the advancement of technology, artificial intelligence (AI) applications are increasingly being used in various fields, among which ChatGPT is one of the most widely utilized. The aim of this study is to evaluate the reliability, quality, and readability of the answers provided by the ChatGPT-4o application to questions related to pediatric asthma.
The ChatGPT-4o application was used to record answers to 25 of the most frequently asked questions about asthma in children. To determine the quality and reliability of the answers, we used the Global Quality Scale and modified DISCERN tool. We tested readability using seven indices: Automated Readability Index, Flesch Reading Ease Score, Flesch-Kincaid Grade Level (FKGL), Gunning Fog Readability Index, Simple Measure of Gobbledygook, Coleman-Liau Readability Index, and Linsear Write Formula.
The answers provided by the ChatGPT-4o application to questions about childhood asthma were found to have good reliability (88% by the first evaluator and 84% by the second evaluator) and high quality (88% by both evaluators). The application scored 10.77 ± 1.58 on the FKGL scale, and in conjunction with the other indices, the results indicated that the answers required a high level of reading proficiency.
Artificial intelligence can be a reliable tool for parents in providing information about pediatric asthma. However, these findings suggest that readability issues may hinder the clinical application of AI-generated content in asthma diagnosis and treatment.
哮喘是儿童最常见的慢性疾病,其特征为喘息、呼吸急促和咳嗽等症状。随着技术的进步,人工智能(AI)应用在各个领域的使用越来越广泛,其中ChatGPT是应用最为广泛的之一。本研究的目的是评估ChatGPT-4o应用程序对小儿哮喘相关问题提供答案的可靠性、质量和可读性。
使用ChatGPT-4o应用程序记录对儿童哮喘25个最常见问题的答案。为了确定答案的质量和可靠性,我们使用了全球质量量表和改良的DISCERN工具。我们使用七个指标测试可读性:自动可读性指数、弗莱什阅读简易度得分、弗莱什-金凯德年级水平(FKGL)、冈宁雾度可读性指数、复杂程度简易衡量指标、科尔曼-廖可读性指数和林西厄书写公式。
发现ChatGPT-4o应用程序对小儿哮喘问题提供的答案具有良好的可靠性(第一位评估者为88%,第二位评估者为84%)和高质量(两位评估者均为88%)。该应用程序在FKGL量表上的得分为10.77±1.58,结合其他指标,结果表明这些答案需要较高的阅读水平。
人工智能可以成为家长获取小儿哮喘信息的可靠工具。然而,这些发现表明可读性问题可能会阻碍人工智能生成的内容在哮喘诊断和治疗中的临床应用。