文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study.

作者信息

Hatia Arjeta, Doldo Tiziana, Parrini Stefano, Chisci Elettra, Cipriani Linda, Montagna Livia, Lagana Giuseppina, Guenza Guia, Agosta Edoardo, Vinjolli Franceska, Hoxha Meladiona, D'Amelio Claudio, Favaretto Nicolò, Chisci Glauco

机构信息

Orthodontics Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy.

Oral Surgery Postgraduate School, Department of Medical Biotechnologies, University of Siena, 53100 Siena, Italy.

出版信息

J Clin Med. 2024 Jan 27;13(3):735. doi: 10.3390/jcm13030735.


DOI:10.3390/jcm13030735
PMID:38337430
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10856539/
Abstract

: this study aims to investigate the accuracy and completeness of ChatGPT in answering questions and solving clinical scenarios of interceptive orthodontics. : ten specialized orthodontists from ten Italian postgraduate orthodontics schools developed 21 clinical open-ended questions encompassing all of the subspecialities of interceptive orthodontics and 7 comprehensive clinical cases. Questions and scenarios were inputted into ChatGPT4, and the resulting answers were evaluated by the researchers using predefined accuracy (range 1-6) and completeness (range 1-3) Likert scales. : For the open-ended questions, the overall median score was 4.9/6 for the accuracy and 2.4/3 for completeness. In addition, the reviewers rated the accuracy of open-ended answers as entirely correct (score 6 on Likert scale) in 40.5% of cases and completeness as entirely correct (score 3 n Likert scale) in 50.5% of cases. As for the clinical cases, the overall median score was 4.9/6 for accuracy and 2.5/3 for completeness. Overall, the reviewers rated the accuracy of clinical case answers as entirely correct in 46% of cases and the completeness of clinical case answers as entirely correct in 54.3% of cases. : The results showed a high level of accuracy and completeness in AI responses and a great ability to solve difficult clinical cases, but the answers were not 100% accurate and complete. ChatGPT is not yet sophisticated enough to replace the intellectual work of human beings.

摘要
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ed3d/10856539/3535ccf8061f/jcm-13-00735-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ed3d/10856539/3535ccf8061f/jcm-13-00735-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ed3d/10856539/3535ccf8061f/jcm-13-00735-g001.jpg

相似文献

[1]
Accuracy and Completeness of ChatGPT-Generated Information on Interceptive Orthodontics: A Multicenter Collaborative Study.

J Clin Med. 2024-1-27

[2]
Accuracy of ChatGPT-Generated Information on Head and Neck and Oromaxillofacial Surgery: A Multicenter Collaborative Analysis.

Otolaryngol Head Neck Surg. 2024-6

[3]
Assessing the Accuracy of Information on Medication Abortion: A Comparative Analysis of ChatGPT and Google Bard AI.

Cureus. 2024-1-2

[4]
The performance of artificial intelligence models in generating responses to general orthodontic questions: ChatGPT vs Google Bard.

Am J Orthod Dentofacial Orthop. 2024-6

[5]
Evaluation of Artificial Intelligence as a Search Tool for Patients: Can ChatGPT-4 Provide Accurate Evidence-Based Orthodontic-Related Information?

Cureus. 2024-7-31

[6]
Investigating the Accuracy and Completeness of an Artificial Intelligence Large Language Model About Uveitis: An Evaluation of ChatGPT.

Ocul Immunol Inflamm. 2024-11

[7]
Assessing the Accuracy, Completeness, and Reliability of Artificial Intelligence-Generated Responses in Dentistry: A Pilot Study Evaluating the ChatGPT Model.

Cureus. 2024-7-29

[8]
Assessing ChatGPT's theoretical knowledge and prescriptive accuracy in bacterial infections: a comparative study with infectious diseases residents and specialists.

Infection. 2024-7-12

[9]
Accuracy of Information given by ChatGPT for Patients with Inflammatory Bowel Disease in Relation to ECCO Guidelines.

J Crohns Colitis. 2024-8-14

[10]
Assessing the Accuracy and Reliability of AI-Generated Medical Responses: An Evaluation of the Chat-GPT Model.

Res Sq. 2023-2-28

引用本文的文献

[1]
Accuracy and Safety of ChatGPT-3.5 in Assessing Over-the-Counter Medication Use During Pregnancy: A Descriptive Comparative Study.

Pharmacy (Basel). 2025-7-30

[2]
Artificial Intelligence for Individualized Radiological Dialogue: The Impact of RadioBot on Precision-Driven Medical Practices.

J Pers Med. 2025-8-8

[3]
Evaluating GPT-4o in infectious disease diagnostics and management: A comparative study with residents and specialists on accuracy, completeness, and clinical support potential.

Digit Health. 2025-7-7

[4]
Comparative analysis of AI chatbot (ChatGPT-4.0 and Microsoft Copilot) and expert responses to common orthodontic questions: patient and orthodontist evaluations.

BMC Oral Health. 2025-6-3

[5]
Comparing orthodontic pre-treatment information provided by large language models.

BMC Oral Health. 2025-5-28

[6]
Evaluation of the impact of AI-based chatbot on orthodontic patient education: a preliminary randomised controlled trial.

Clin Oral Investig. 2025-4-30

[7]
Effectiveness of AI-generated orthodontic treatment plans compared to expert orthodontist recommendations: a cross-sectional pilot study.

Dental Press J Orthod. 2025-3-24

[8]
Artificial intelligence solutions for temporomandibular joint disorders: Contributions and future potential of ChatGPT.

Korean J Orthod. 2025-3-25

[9]
Assessing the performance of an artificial intelligence based chatbot in the differential diagnosis of oral mucosal lesions: clinical validation study.

Clin Oral Investig. 2025-3-18

[10]
Balancing the Load: How Optimal Forces Shape the Longevity and Stability of Orthodontic Mini-Implants.

Dent J (Basel). 2025-2-5

本文引用的文献

[1]
The Quality of CLP-Related Information for Patients Provided by ChatGPT.

Cleft Palate Craniofac J. 2025-4

[2]
Assessing the reliability of ChatGPT: a content analysis of self-generated and self-answered questions on clear aligners, TADs and digital imaging.

Dental Press J Orthod. 2023

[3]
Artificial intelligence in the detection and classification of dental caries.

J Prosthet Dent. 2025-5

[4]
Accuracy of ChatGPT-Generated Information on Head and Neck and Oromaxillofacial Surgery: A Multicenter Collaborative Analysis.

Otolaryngol Head Neck Surg. 2024-6

[5]
The Use of Tactile Sensors in Oral and Maxillofacial Surgery: An Overview.

Bioengineering (Basel). 2023-6-26

[6]
The Potential Usefulness of ChatGPT in Oral and Maxillofacial Radiology.

Cureus. 2023-7-19

[7]
Applying ChatGPT in public health: a SWOT and PESTLE analysis.

Front Public Health. 2023-7-3

[8]
Chatbot vs Medical Student Performance on Free-Response Clinical Reasoning Examinations.

JAMA Intern Med. 2023-9-1

[9]
Artificial Intelligence Can Generate Fraudulent but Authentic-Looking Scientific Medical Articles: Pandora's Box Has Been Opened.

J Med Internet Res. 2023-5-31

[10]
How could ChatGPT impact my practice as an intensivist? An overview of potential applications, risks and limitations.

Intensive Care Med. 2023-7

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索