Alhazmi Nora, Alshehri Aram, BaHammam Fahad, Philip Manju, Nadeem Muhammad, Khanagar Sanjeev
Department of Preventive Dental Sciences, College of Dentistry, King Saud bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Ministry of the National Guard Health Affairs, Riyadh, Saudi Arabia.
Department of Restorative and Prosthetic Dental Sciences, College of Dentistry, King Saud bin Abdulaziz University for Health Sciences, King Abdullah International Medical Research Center, Ministry of the National Guard Health Affairs, Riyadh, Saudi Arabia.
Int Dent J. 2025 May 16;75(4):100835. doi: 10.1016/j.identj.2025.04.015.
Large language models (LLMs) have gained popularity among dental students for generating subject-related answers. However, their widespread use raises significant concerns about misinformation. This systematic review aims to critically evaluate studies assessing the performance of LLMs in dentistry. A comprehensive electronic search was conducted in PubMed/Medline, Scopus, Embase, Web of Science, Google Scholar, and the Saudi Digital Library to identify studies published up to September 2024. The study quality was assessed using the Prediction Model Risk of Bias Assessment Tool (PROBAST). A total of 2030 studies have been identified. After removing 907 duplicate records, 1123 studies remained for screening. Ultimately, 31 studies met the inclusion criteria. Approximately half of these studies were classified as "high risk," while the remainder were classified as "low risk." The applicability of the findings was rated as "low concern." The primary limitations of LLMs include their inability to specify information sources and their tendency to generate fabricated citations. Based on this review, LLMs hold promise as supplementary educational tools in dentistry. Evidence indicates that students using LLMs may achieve improved academic performance compared to traditional methods. However, concerns about occasional inaccuracies and unreliable citations underscore the need for further research, integration with validated sources, and adherence to ethical guidelines. Ultimately, LLMs should be viewed as complementary tools within dental education, with careful consideration of their limitations.
大语言模型(LLMs)在牙科学生中因能生成与学科相关的答案而颇受欢迎。然而,它们的广泛使用引发了对错误信息的重大担忧。本系统综述旨在严格评估评估大语言模型在牙科领域表现的研究。在PubMed/Medline、Scopus、Embase、Web of Science、谷歌学术和沙特数字图书馆中进行了全面的电子检索,以识别截至2024年9月发表的研究。使用预测模型偏倚风险评估工具(PROBAST)评估研究质量。共识别出2030项研究。去除907条重复记录后,剩余1123项研究进行筛选。最终,31项研究符合纳入标准。其中约一半的研究被归类为“高风险”,其余的被归类为“低风险”。研究结果的适用性被评为“低关注度”。大语言模型的主要局限性包括无法指明信息来源以及有生成虚假引用的倾向。基于本综述,大语言模型有望成为牙科领域的辅助教育工具。有证据表明,与传统方法相比,使用大语言模型的学生可能会取得更好的学业成绩。然而,对偶尔出现的不准确信息和不可靠引用的担忧凸显了进一步研究、与经过验证的来源整合以及遵守道德准则的必要性。最终,大语言模型应被视为牙科教育中的补充工具,并需仔细考虑其局限性。
Patient Prefer Adherence. 2025-7-31
Cochrane Database Syst Rev. 2014-4-29
JBI Database System Rev Implement Rep. 2016-4
Imaging Sci Dent. 2024-9
J Coll Physicians Surg Pak. 2024-7
Clin Oral Investig. 2024-6-29
Int J Oral Maxillofac Surg. 2024-10
Dentomaxillofac Radiol. 2024-9-1