Hatia Arjeta, Doldo Tiziana, Parrini Stefano, Chisci Elettra, Cipriani Linda, Montagna Livia, Lagana Giuseppina, Guenza Guia, Agosta Edoardo, Vinjolli Franceska, Hoxha Meladiona, D'Amelio Claudio, Favaretto Nicolò, Chisci Glauco
Orthodontics Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy.
Oral Surgery Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy.
J Clin Med. 2024 Jan 27;13(3):735. doi: 10.3390/jcm13030735.
: this study aims to investigate the accuracy and completeness of ChatGPT in answering questions and solving clinical scenarios of interceptive orthodontics. : ten specialized orthodontists from ten Italian postgraduate orthodontics schools developed 21 clinical open-ended questions encompassing all of the subspecialities of interceptive orthodontics and 7 comprehensive clinical cases. Questions and scenarios were inputted into ChatGPT4, and the resulting answers were evaluated by the researchers using predefined accuracy (range 1-6) and completeness (range 1-3) Likert scales. : For the open-ended questions, the overall median score was 4.9/6 for the accuracy and 2.4/3 for completeness. In addition, the reviewers rated the accuracy of open-ended answers as entirely correct (score 6 on Likert scale) in 40.5% of cases and completeness as entirely correct (score 3 n Likert scale) in 50.5% of cases. As for the clinical cases, the overall median score was 4.9/6 for accuracy and 2.5/3 for completeness. Overall, the reviewers rated the accuracy of clinical case answers as entirely correct in 46% of cases and the completeness of clinical case answers as entirely correct in 54.3% of cases. : The results showed a high level of accuracy and completeness in AI responses and a great ability to solve difficult clinical cases, but the answers were not 100% accurate and complete. ChatGPT is not yet sophisticated enough to replace the intellectual work of human beings.
Otolaryngol Head Neck Surg. 2024-6
Am J Orthod Dentofacial Orthop. 2024-6
BMC Oral Health. 2025-5-28
Cleft Palate Craniofac J. 2025-4
J Prosthet Dent. 2025-5
Otolaryngol Head Neck Surg. 2024-6
Bioengineering (Basel). 2023-6-26
Front Public Health. 2023-7-3
JAMA Intern Med. 2023-9-1