Suárez Ana, Jiménez Jaime, Llorente de Pedro María, Andreu-Vázquez Cristina, Díaz-Flores García Víctor, Gómez Sánchez Margarita, Freire Yolanda
Department of Pre-Clinic Dentistry, Faculty of Biomedical and Health Sciences, Universidad Europea de Madrid, Calle Tajo s/n, Villaviciosa de Odón, 28670 Madrid, Spain.
Department of Clinic Dentistry, Faculty of Biomedical and Health Sciences, Universidad Europea de Madrid, Calle Tajo s/n, Villaviciosa de Odón, 28670 Madrid, Spain.
Comput Struct Biotechnol J. 2023 Dec 6;24:46-52. doi: 10.1016/j.csbj.2023.11.058. eCollection 2024 Dec.
AI has revolutionized the way we interact with technology. Noteworthy advances in AI algorithms and large language models (LLM) have led to the development of natural generative language (NGL) systems such as ChatGPT. Although these LLM can simulate human conversations and generate content in real time, they face challenges related to the topicality and accuracy of the information they generate. This study aimed to assess whether ChatGPT-4 could provide accurate and reliable answers to general dentists in the field of oral surgery, and thus explore its potential as an intelligent virtual assistant in clinical decision making in oral surgery. Thirty questions related to oral surgery were posed to ChatGPT4, each question repeated 30 times. Subsequently, a total of 900 responses were obtained. Two surgeons graded the answers according to the guidelines of the Spanish Society of Oral Surgery, using a three-point Likert scale (correct, partially correct/incomplete, and incorrect). Disagreements were arbitrated by an experienced oral surgeon, who provided the final grade Accuracy was found to be 71.7%, and consistency of the experts' grading across iterations, ranged from moderate to almost perfect. ChatGPT-4, with its potential capabilities, will inevitably be integrated into dental disciplines, including oral surgery. In the future, it could be considered as an auxiliary intelligent virtual assistant, though it would never replace oral surgery experts. Proper training and verified information by experts will remain vital to the implementation of the technology. More comprehensive research is needed to ensure the safe and successful application of AI in oral surgery.
人工智能已经彻底改变了我们与技术交互的方式。人工智能算法和大语言模型(LLM)的显著进步催生了诸如ChatGPT这样的自然生成语言(NGL)系统。尽管这些大语言模型能够模拟人类对话并实时生成内容,但它们在生成信息的时效性和准确性方面面临挑战。本研究旨在评估ChatGPT-4能否为口腔外科领域的普通牙医提供准确可靠的答案,从而探索其作为口腔外科临床决策智能虚拟助手的潜力。向ChatGPT-4提出了30个与口腔外科相关的问题,每个问题重复30次。随后,共获得900个回答。两名外科医生根据西班牙口腔外科学会的指南,采用三点李克特量表(正确、部分正确/不完整、错误)对答案进行评分。分歧由一位经验丰富的口腔外科医生进行仲裁,他给出最终评分。结果发现准确率为71.7%,专家在各轮评分中的一致性从中度到几乎完美不等。ChatGPT-4凭借其潜在能力,将不可避免地融入包括口腔外科在内的牙科领域。未来,它可以被视为辅助智能虚拟助手,尽管它永远无法取代口腔外科专家。专家的适当培训和经过验证的信息对于该技术的实施仍然至关重要。需要进行更全面的研究,以确保人工智能在口腔外科中的安全和成功应用。