Arpaci Aysenur, Ozturk Asel Usdat, Okur Ismail, Sadry Sanaz
Faculty of Dentistry, Department of Periodontology, Istanbul Aydin University, Istanbul, Turkey.
Faculty of Dentistry, Department of Maxillofacial Radiology, Istanbul Atlas University, Istanbul, Turkey.
BMC Oral Health. 2025 Aug 2;25(1):1293. doi: 10.1186/s12903-025-06624-9.
The field of artificial intelligence (AI) has experienced considerable growth in recent years, with the advent of technologies that are transforming a range of industries, including healthcare and dentistry. Large language models (LLMs) and natural language processing (NLP) are pivotal to this transformation. This study aimed to assess the efficacy of AI-supported chatbots in responding to questions frequently asked by patients to their doctors regarding oral health.
Frequently asked questions in the oral health section of the World Dental Federation FDI website were asked about Google-Gemini Trends and ChatGPT-4 chatbots on July 9, 2024. Responses from ChatGPT and Gemini, as well as those from the FDI webpage, were recorded. The accuracy of the responses given by ChatGPT-4 and Gemini to the four specified questions, the detection of similarities and differences, and the comprehensive examination of ChatGPT-4 and Gemini's capabilities were analyzed and reported by the researchers. Furthermore, the content of the texts was evaluated in terms of their similarity with respect to the following criteria: "Main Idea," "Quality Analysis," "Common Ideas," and "Inconsistent Ideas."
It was observed that both ChatGPT-4 and Gemini exhibited performance comparable to that of the FDI responses in terms of completeness and clarity. Compared with Gemini, ChatGPT-4 provided responses that were more similar to the FDI responses in terms of relevance. Furthermore, ChatGPT-4 provided responses that were more accurate than those of Gemini in terms of the "Accuracy" criterion.
This study demonstrated that, according to the assessment conducted by FDI, the ChatGPT-4 and Gemini applications contain contemporary and comprehensible information in response to general inquiries concerning oral health. These applications are regarded as a prevalent and dependable source of information for individuals seeking to access such data.
近年来，随着人工智能（AI）技术的出现，该领域取得了显著发展，这些技术正在改变包括医疗保健和牙科在内的一系列行业。大语言模型（LLMs）和自然语言处理（NLP）对这一转变至关重要。本研究旨在评估人工智能支持的聊天机器人在回答患者向医生频繁询问的有关口腔健康问题方面的效果。
2024年7月9日，在世界牙科联盟（FDI）网站的口腔健康板块中常见的问题被输入到谷歌Gemini Trends和ChatGPT-4聊天机器人中。记录了ChatGPT和Gemini的回答，以及FDI网页的回答。研究人员分析并报告了ChatGPT-4和Gemini对四个指定问题的回答准确性、异同检测以及对ChatGPT-4和Gemini能力的综合考察。此外，还根据以下标准对文本内容的相似性进行了评估：“主要观点”、“质量分析”、“共同观点”和“不一致观点”。
观察到ChatGPT-4和Gemini在完整性和清晰度方面的表现与FDI的回答相当。与Gemini相比，ChatGPT-4在相关性方面提供的回答与FDI的回答更相似。此外，在“准确性”标准方面，ChatGPT-4提供的回答比Gemini更准确。
本研究表明根据FDI的评估，ChatGPT-4和Gemini应用程序包含了当代且易于理解的信息，以回应有关口腔健康的一般询问。这些应用程序被视为寻求此类数据的个人普遍且可靠的信息来源。
