文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

ChatGPT 在整形外科学在职培训考试中的表现。

Performance of ChatGPT on the Plastic Surgery Inservice Training Examination.

出版信息

Aesthet Surg J. 2023 Nov 16;43(12):NP1078-NP1082. doi: 10.1093/asj/sjad128.


DOI:10.1093/asj/sjad128
PMID:37128784
Abstract

BACKGROUND: Developed originally as a tool for resident self-evaluation, the Plastic Surgery Inservice Training Examination (PSITE) has become a standardized tool adopted by Plastic Surgery residency programs. The introduction of large language models (LLMs), such as ChatGPT (OpenAI, San Francisco, CA), has demonstrated the potential to help propel the field of Plastic Surgery. OBJECTIVES: The authors of this study wanted to assess whether or not ChatGPT could be utilized as a tool in resident education by assessing its accuracy on the PSITE. METHODS: Questions were obtained from the 2022 PSITE, which was present on the American Council of Academic Plastic Surgeons (ACAPS) website. Questions containing images or tables were carefully inspected and flagged before being inputted into ChatGPT. All responses by ChatGPT were qualified utilizing the properties of natural coherence. Responses that were found to be incorrect were divided into the following categories: logical, informational, or explicit fallacy. RESULTS: ChatGPT answered a total of 242 questions with an accuracy of 54.96%. The software incorporated logical reasoning in 88.8% of questions, internal information in 95.5% of questions, and external information in 92.1% of questions. When stratified by correct and incorrect responses, we determined that there was a statistically significant difference in ChatGPT's use of external information (P < .05). CONCLUSIONS: ChatGPT is a versatile tool that has the potential to impact resident education by providing general knowledge, clarifying information, providing case-based learning, and promoting evidence-based medicine. With advancements in LLM and artificial intelligence (AI), it is possible that ChatGPT may be an impactful tool for resident education within Plastic Surgery.

摘要

背景:整形外科住院医师培训考试(PSITE)最初是作为住院医师自我评价的工具而开发的,现已成为整形外科住院医师项目采用的标准化工具。大型语言模型(LLM)的引入,如 ChatGPT(OpenAI,旧金山,加利福尼亚州),已经证明了其有潜力帮助推动整形外科领域的发展。

目的:本研究的作者希望通过评估 ChatGPT 在 PSITE 上的准确性,来确定它是否可以作为住院医师教育的工具。

方法:从美国整形外科学会学术委员会(ACAPS)网站上的 2022 年 PSITE 中获取问题。对包含图像或表格的问题进行仔细检查和标记,然后输入 ChatGPT。利用自然连贯性的特性对 ChatGPT 的所有回复进行了限定。将发现不正确的回复分为逻辑、信息或明确错误。

结果:ChatGPT 共回答了 242 个问题,准确率为 54.96%。该软件在 88.8%的问题中纳入了逻辑推理,在 95.5%的问题中纳入了内部信息,在 92.1%的问题中纳入了外部信息。在正确和错误回答分层后,我们确定 ChatGPT 在使用外部信息方面存在统计学上的显著差异(P <.05)。

结论:ChatGPT 是一种多功能工具,它有潜力通过提供一般知识、澄清信息、提供基于案例的学习以及促进循证医学来影响住院医师教育。随着大型语言模型和人工智能(AI)的进步,ChatGPT 可能成为整形外科住院医师教育的一个有影响力的工具。

相似文献

[1]
Performance of ChatGPT on the Plastic Surgery Inservice Training Examination.

Aesthet Surg J. 2023-11-16

[2]
Applying GPT-4 to the Plastic Surgery Inservice Training Examination.

J Plast Reconstr Aesthet Surg. 2023-12

[3]
Expanding Cosmetic Plastic Surgery Research With ChatGPT.

Aesthet Surg J. 2023-7-15

[4]
Performance of ChatGPT on the Chinese Postgraduate Examination for Clinical Medicine: Survey Study.

JMIR Med Educ. 2024-2-9

[5]
ChatGPT Is Equivalent to First-Year Plastic Surgery Residents: Evaluation of ChatGPT on the Plastic Surgery In-Service Examination.

Aesthet Surg J. 2023-11-16

[6]
Can Artificial Intelligence Pass the American Board of Orthopaedic Surgery Examination? Orthopaedic Residents Versus ChatGPT.

Clin Orthop Relat Res. 2023-8-1

[7]
Exploring the Unknown: Evaluating ChatGPT's Performance in Uncovering Novel Aspects of Plastic Surgery and Identifying Areas for Future Innovation.

Aesthetic Plast Surg. 2024-7

[8]
Large Language Models and Artificial Intelligence: A Primer for Plastic Surgeons on the Demonstrated and Potential Applications, Promises, and Limitations of ChatGPT.

Aesthet Surg J. 2024-2-15

[9]
Exploring the Potential of ChatGPT-4 in Responding to Common Questions About Abdominoplasty: An AI-Based Case Study of a Plastic Surgery Consultation.

Aesthetic Plast Surg. 2024-4

[10]
Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study.

J Med Internet Res. 2023-8-22

引用本文的文献

[1]
Exploring the role of DeepSeek-R1, ChatGPT-4, and Google Gemini in medical education: How valid and reliable are they?

Pak J Med Sci. 2025-7

[2]
Evaluation of ChatGPT Performance on Emergency Medicine Board Examination Questions: Observational Study.

JMIR AI. 2025-3-12

[3]
Artificial Intelligence Augmentation: Performance of GPT-4 and GPT-3.5 on the Plastic Surgery In-service Examination.

Plast Reconstr Surg Glob Open. 2025-4-10

[4]
EVALUATION OF THE PERFORMANCE OF CHATGPT/ARTIFICIAL INTELLIGENCE IN THE MULTIPLE-CHOICE TEST TO OBTAIN THE TITLE OF SPECIALIST IN ORTHOPEDICS AND TRAUMATOLOGY.

Acta Ortop Bras. 2025-4-7

[5]
Evaluating Large Language Models for Burning Mouth Syndrome Diagnosis.

J Pain Res. 2025-3-19

[6]
Performance of Artificial Intelligence Chatbots on Ultrasound Examinations: Cross-Sectional Comparative Analysis.

JMIR Med Inform. 2025-1-9

[7]
Utility of ChatGPT as a preparation tool for the Orthopaedic In-Training Examination.

J Exp Orthop. 2025-1-2

[8]
Artificial Intelligence, the ChatGPT Large Language Model: Assessing the Accuracy of Responses to the Gynaecological Endoscopic Surgical Education and Assessment (GESEA) Level 1-2 knowledge tests.

Facts Views Vis Obgyn. 2024-12

[9]
Analyzing evaluation methods for large language models in the medical field: a scoping review.

BMC Med Inform Decis Mak. 2024-11-29

[10]
Performance of Artificial Intelligence Chatbots in Answering Clinical Questions on Japanese Practical Guidelines for Implant-based Breast Reconstruction.

Aesthetic Plast Surg. 2025-4

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索