Bagde Hiroj, Dhopte Ashwini, Alam Mohammad Khursheed, Basri Rehana
Department of Periodontology, Chhattisgarh Dental College and Research Institute, Rajnandgaon, Chhattisgarh, India.
Department of Oral Medicine and Radiology, Chhattisgarh Dental College and Research Institute, Rajnandgaon, Chhattisgarh, India.
Heliyon. 2023 Nov 29;9(12):e23050. doi: 10.1016/j.heliyon.2023.e23050. eCollection 2023 Dec.
Since its release, ChatGPT has taken the world by storm with its utilization in various fields of life. This review's main goal was to offer a thorough and fact-based evaluation of ChatGPT's potential as a tool for medical and dental research, which could direct subsequent research and influence clinical practices.
Different online databases were scoured for relevant articles that were in accordance with the study objectives. A team of reviewers was assembled to devise a proper methodological framework for inclusion of articles and meta-analysis.
11 descriptive studies were considered for this review that evaluated the accuracy of ChatGPT in answering medical queries related to different domains such as systematic reviews, cancer, liver diseases, diagnostic imaging, education, and COVID-19 vaccination. The studies reported different accuracy ranges, from 18.3 % to 100 %, across various datasets and specialties. The meta-analysis showed an odds ratio (OR) of 2.25 and a relative risk (RR) of 1.47 with a 95 % confidence interval (CI), indicating that the accuracy of ChatGPT in providing correct responses was significantly higher compared to the total responses for queries. However, significant heterogeneity was present among the studies, suggesting considerable variability in the effect sizes across the included studies.
The observations indicate that ChatGPT has the ability to provide appropriate solutions to questions in the medical and dentistry areas, but researchers and doctors should cautiously assess its responses because they might not always be dependable. Overall, the importance of this study rests in shedding light on ChatGPT's accuracy in the medical and dentistry fields and emphasizing the need for additional investigation to enhance its performance. © 2017 Elsevier Inc. All rights reserved.
自发布以来，ChatGPT在生活的各个领域得到应用，席卷全球。本综述的主要目标是对ChatGPT作为医学和牙科研究工具的潜力进行全面且基于事实的评估，这可为后续研究提供指导并影响临床实践。
在不同在线数据库中搜索符合研究目标的相关文章。组建了一个评审团队来设计纳入文章和进行荟萃分析的适当方法框架。
本综述纳入了11项描述性研究，这些研究评估了ChatGPT回答与不同领域相关医学问题的准确性，如系统评价、癌症、肝脏疾病、诊断成像、教育和新冠疫苗接种。这些研究报告了不同数据集和专业领域的准确率范围，从18.3%到100%不等。荟萃分析显示，优势比（OR）为2.25，相对风险（RR）为1.47，95%置信区间（CI）表明，ChatGPT提供正确回答的准确率显著高于查询的总回答率。然而，研究之间存在显著异质性，表明纳入研究的效应大小存在相当大的变异性。
观察结果表明，ChatGPT有能力为医学和牙科领域的问题提供适当解决方案，但研究人员和医生应谨慎评估其回答，因为它们可能并不总是可靠的。总体而言，本研究的重要性在于揭示ChatGPT在医学和牙科领域的准确性，并强调需要进一步研究以提高其性能。© 2017爱思唯尔公司。保留所有权利。
