• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利：CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法，用中文像聊天一样搜索，搜遍4000万医学文献。AI智能推荐，让科研检索更轻松。

立即免费搜索

文件翻译

保留排版，准确专业，支持PDF/Word/PPT等文件格式，支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述，25分钟生成高质量综述，智能提取关键信息，辅助科研写作。

立即免费体验

评估ChatGPT/人工智能在获得骨科与创伤学专家头衔的多项选择题测试中的表现。

EVALUATION OF THE PERFORMANCE OF CHATGPT/ARTIFICIAL INTELLIGENCE IN THE MULTIPLE-CHOICE TEST TO OBTAIN THE TITLE OF SPECIALIST IN ORTHOPEDICS AND TRAUMATOLOGY.

作者信息

Costa Lucas Plens DE Britto, Castro Danilo Henrique Pizzo DE, Cordeiro Renato Pinheiro, Albino Rômulo Ballarin

机构信息

Universidade Estadual Paulista, Grupo de Medicina e Cirurgia do Pe e Tornozelo, Department of Surgery and Orthopedics, Botucatu, SP, Brazil.

Universidade Federal de São Paulo, Escola Paulista de Medicina, Departamento de Ortopedia e Traumatologia, São Paulo,SP, Brazil.

出版信息

Acta Ortop Bras. 2025 Apr 7;33(spe1):e280947. doi: 10.1590/1413-785220243201e280947. eCollection 2025.

DOI:10.1590/1413-785220243201e280947
PMID:40206447
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11978311/
Abstract

INTRODUCTION

ChatGPT, an advanced Artificial Intelligence model specialized in natural language processing, shows remarkable abilities, achieving high scores in certification exams in various specialties. This study aims to evaluate ChatGPT's performance in multiple-choice tests applied to obtain specialist certification in Orthopedics and Traumatology.

METHODS

We used ChatGPT 4.0 to answer 100 questions from the first phase of the 2022 (TEOT) (Specialist in Orthopedics and Traumatology Test). We excluded non-text-based questions. Each question was entered individually into ChatGPT, with a new session initiated for each question. Performance was evaluated regarding number of words and questions' taxonomic classification.

RESULTS

Of the 95 questions analyzed, ChatGPT answered 61.05% correctly and 38.95% incorrectly. There was no statistically significant difference regarding number of words, and ChatGPT's performance did not vary according to taxonomic level.

CONCLUSION

ChatGPT demonstrated vast knowledge in Orthopedics, with acceptable performance in the TEOT exam. Results suggest ChatGPT's an educational and clinical resource in Orthopedics, but needs future progress and human supervision for its effective application.

摘要

引言

ChatGPT是一种专门用于自然语言处理的先进人工智能模型，展现出卓越的能力，在各个专业的认证考试中都取得了高分。本研究旨在评估ChatGPT在用于获得骨科与创伤学专业认证的多项选择题测试中的表现。

方法

我们使用ChatGPT 4.0回答了2022年骨科与创伤学专业考试（TEOT）第一阶段的100道问题。我们排除了非基于文本的问题。每个问题单独输入ChatGPT，每个问题开启一个新会话。从单词数量和问题的分类学分类方面评估其表现。

结果

在分析的95道问题中，ChatGPT回答正确的比例为61.05%，回答错误的比例为38.95%。在单词数量方面没有统计学上的显著差异，并且ChatGPT的表现不会因分类学级别而有所不同。

结论

ChatGPT在骨科领域展现出了丰富的知识，在TEOT考试中的表现尚可。结果表明ChatGPT是骨科领域的一种教育和临床资源，但要有效应用还需要未来的改进和人工监督。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/efdd/11978311/746f5be43c92/1809-4406-aob-33-spe1-e280947-gf1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/efdd/11978311/746f5be43c92/1809-4406-aob-33-spe1-e280947-gf1.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/efdd/11978311/746f5be43c92/1809-4406-aob-33-spe1-e280947-gf1.jpg

相似文献

1
EVALUATION OF THE PERFORMANCE OF CHATGPT/ARTIFICIAL INTELLIGENCE IN THE MULTIPLE-CHOICE TEST TO OBTAIN THE TITLE OF SPECIALIST IN ORTHOPEDICS AND TRAUMATOLOGY.评估ChatGPT/人工智能在获得骨科与创伤学专家头衔的多项选择题测试中的表现。
Acta Ortop Bras. 2025 Apr 7;33(spe1):e280947. doi: 10.1590/1413-785220243201e280947. eCollection 2025.
2
Can ChatGPT pass the Turkish Orthopedics and Traumatology Board Examination? Turkish orthopedic surgeons versus artificial intelligence.ChatGPT能通过土耳其骨科学与创伤外科学委员会考试吗？土耳其骨科医生与人工智能的较量。
Ulus Travma Acil Cerrahi Derg. 2025 Mar;31(3):310-315. doi: 10.14744/tjtes.2025.07724.
3
Integrating ChatGPT in Orthopedic Education for Medical Undergraduates: Randomized Controlled Trial.将 ChatGPT 融入骨科医学本科生教育：随机对照试验。
J Med Internet Res. 2024 Aug 20;26:e57037. doi: 10.2196/57037.
4
Performance of an Artificial Intelligence Chatbot in Ophthalmic Knowledge Assessment.人工智能聊天机器人在眼科知识评估中的表现。
JAMA Ophthalmol. 2023 Jun 1;141(6):589-597. doi: 10.1001/jamaophthalmol.2023.1144.
5
ChatGPT's performance in German OB/GYN exams - paving the way for AI-enhanced medical education and clinical practice.ChatGPT在德国妇产科考试中的表现——为人工智能强化医学教育和临床实践铺平道路。
Front Med (Lausanne). 2023 Dec 13;10:1296615. doi: 10.3389/fmed.2023.1296615. eCollection 2023.
6
Assessing question characteristic influences on ChatGPT's performance and response-explanation consistency: Insights from Taiwan's Nursing Licensing Exam.评估问题特征对 ChatGPT 表现和回应解释一致性的影响：来自台湾护理执照考试的见解。
Int J Nurs Stud. 2024 May;153:104717. doi: 10.1016/j.ijnurstu.2024.104717. Epub 2024 Feb 8.
7
Artificial Intelligence in Orthopaedics: Performance of ChatGPT on Text and Image Questions on a Complete AAOS Orthopaedic In-Training Examination (OITE).人工智能在骨科领域的应用：ChatGPT 在 AAOS 骨科住院医师培训考试（OITE）全题文本和图像问题上的表现。
J Surg Educ. 2024 Nov;81(11):1645-1649. doi: 10.1016/j.jsurg.2024.08.002. Epub 2024 Sep 14.
8
A comparative analysis of GPT-3.5 and GPT-4.0 on a multiple-choice ophthalmology question bank: A study on artificial intelligence developments.基于多项选择题眼科题库对GPT-3.5和GPT-4.0的比较分析：一项关于人工智能发展的研究。
Rom J Ophthalmol. 2024 Oct-Dec;68(4):367-371. doi: 10.22336/rjo.2024.67.
9
Analyzing Question Characteristics Influencing ChatGPT's Performance in 3000 USMLE®-Style Questions.分析影响ChatGPT在3000道美国医师执照考试（USMLE®）风格题目中表现的问题特征
Med Sci Educ. 2024 Sep 28;35(1):257-267. doi: 10.1007/s40670-024-02176-9. eCollection 2025 Feb.
10
How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment.ChatGPT在美国医师执照考试（USMLE）中的表现如何？大语言模型对医学教育和知识评估的影响。
JMIR Med Educ. 2023 Feb 8;9:e45312. doi: 10.2196/45312.

本文引用的文献

1
Where Medical Statistics Meets Artificial Intelligence.医学统计学与人工智能的交汇之处。
N Engl J Med. 2023 Sep 28;389(13):1211-1219. doi: 10.1056/NEJMra2212850.
2
Evaluating ChatGPT Performance on the Orthopaedic In-Training Examination.评估ChatGPT在骨科住院医师培训考试中的表现。
JB JS Open Access. 2023 Sep 8;8(3). doi: 10.2106/JBJS.OA.23.00056. eCollection 2023 Jul-Sep.
3
Artificial intelligence and ChatGPT in Orthopaedics and sports medicine.人工智能与ChatGPT在骨科和运动医学中的应用
J Exp Orthop. 2023 Jul 26;10(1):74. doi: 10.1186/s40634-023-00642-8.
4
Artificial intelligence in orthopaedics: can Chat Generative Pre-trained Transformer (ChatGPT) pass Section 1 of the Fellowship of the Royal College of Surgeons (Trauma & Orthopaedics) examination?人工智能在骨科领域的应用：ChatGPT 能否通过皇家外科学院（创伤与骨科）研究员资格 Section 1 考试？
Postgrad Med J. 2023 Sep 21;99(1176):1110-1114. doi: 10.1093/postmj/qgad053.
5
Can Artificial Intelligence Pass the American Board of Orthopaedic Surgery Examination? Orthopaedic Residents Versus ChatGPT.人工智能能通过美国骨科医师学会考试吗？骨科住院医师与ChatGPT的对比。
Clin Orthop Relat Res. 2023 Aug 1;481(8):1623-1630. doi: 10.1097/CORR.0000000000002704. Epub 2023 May 23.
6
ChatGPT Is Equivalent to First-Year Plastic Surgery Residents: Evaluation of ChatGPT on the Plastic Surgery In-Service Examination.ChatGPT 相当于第一年整形外科住院医师：ChatGPT 在整形外科住院医师年度考核中的评估。
Aesthet Surg J. 2023 Nov 16;43(12):NP1085-NP1089. doi: 10.1093/asj/sjad130.
7
Performance of ChatGPT on the Plastic Surgery Inservice Training Examination.ChatGPT 在整形外科学在职培训考试中的表现。
Aesthet Surg J. 2023 Nov 16;43(12):NP1078-NP1082. doi: 10.1093/asj/sjad128.
8
Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models.ChatGPT在美国医师执照考试中的表现：使用大语言模型进行人工智能辅助医学教育的潜力。
PLOS Digit Health. 2023 Feb 9;2(2):e0000198. doi: 10.1371/journal.pdig.0000198. eCollection 2023 Feb.
9
How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment.ChatGPT在美国医师执照考试（USMLE）中的表现如何？大语言模型对医学教育和知识评估的影响。
JMIR Med Educ. 2023 Feb 8;9:e45312. doi: 10.2196/45312.
10
ChatGPT and Other Large Language Models Are Double-edged Swords.ChatGPT和其他大型语言模型是双刃剑。
Radiology. 2023 Apr;307(2):e230163. doi: 10.1148/radiol.230163. Epub 2023 Jan 26.