Ratuszniak Anna, Gos Elzbieta, Lorens Artur, Skarzynski Piotr Henryk, Skarzynski Henryk, Jedrzejczak W Wiktor
Institute of Physiology and Pathology of Hearing, Mochnackiego 10 Street, 02-042 Warsaw, Poland.
World Hearing Center, Mokra 17 Street, 05-830 Kajetany, Poland.
J Clin Med. 2025 Jan 28;14(3):875. doi: 10.3390/jcm14030875.
: Despite the growing popularity of artificial intelligence (AI)-based systems such as ChatGPT, there is still little evidence of their effectiveness in audiology, particularly in pediatric audiology. The present study aimed to verify the performance of ChatGPT in this field, as assessed by both students and professionals, and to compare its Polish and English versions. : ChatGPT was presented with 20 questions, which were posed twice, first in Polish and then in English. A group of 20 students and 16 professionals in the field of audiology and otolaryngology rated the answers on a Likert scale of 1 to 5 in terms of correctness, relevance, completeness, and linguistic accuracy. Both groups were also asked to assess the usefulness of ChatGPT as a source of information for patients, in educational settings for students, and in professional work. : Both students and professionals generally rated ChatGPT's responses to be satisfactory. For most of the questions, ChatGPT's responses were rated somewhat higher by the students than the professionals, although statistically significant differences were only evident for completeness and linguistic accuracy. Those who rated ChatGPT's responses more highly also rated its usefulness more highly. : ChatGPT can possibly be used for quick information retrieval, especially by non-experts, but it lacks the depth and reliability required by professionals. The different ratings given by students and professionals, and its language dependency, indicate it works best as a supplementary tool, not as a replacement for verifiable sources, particularly in a healthcare setting.
尽管基于人工智能（AI）的系统如ChatGPT越来越受欢迎，但在听力学领域，尤其是儿科听力学中，几乎没有证据表明它们的有效性。本研究旨在验证ChatGPT在该领域的表现，由学生和专业人士进行评估，并比较其波兰语和英语版本。向ChatGPT提出了20个问题，这些问题分两次提出，先使用波兰语，然后使用英语。一组20名听力学和耳鼻喉科领域的学生和16名专业人士根据答案的正确性、相关性、完整性和语言准确性，在1至5的李克特量表上对答案进行评分。两组人员还被要求评估ChatGPT作为患者信息来源、学生教育环境以及专业工作中的信息来源的有用性。学生和专业人士普遍认为ChatGPT的回答令人满意。对于大多数问题，学生对ChatGPT回答的评分略高于专业人士，尽管在完整性和语言准确性方面仅存在统计学上的显著差异。那些对ChatGPT回答评价更高的人也对其有用性评价更高。ChatGPT可能可用于快速信息检索，尤其是非专家，但它缺乏专业人士所需的深度和可靠性。学生和专业人士给出的不同评分及其语言依赖性表明，它最适合作为一种辅助工具，而不是可验证来源的替代品，尤其是在医疗环境中。
