Variability in Large Language Models' Responses to Medical Licensing and Certification Examinations. Comment on "How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment".
作者信息
Epstein Richard H, Dexter Franklin
机构信息
Department of Anesthesiology, Perioperative Medicine and Pain Management, University of Miami Miller School of Medicine, Miami, FL, United States.
Division of Management Consulting, Department of Anesthesia, University of Iowa, Iowa City, IA, United States.
出版信息
JMIR Med Educ. 2023 Jul 13;9:e48305. doi: 10.2196/48305.
Abstract
摘要
相似文献
1
Variability in Large Language Models' Responses to Medical Licensing and Certification Examinations. Comment on "How Does ChatGPT Perform on the United States Medical Licensing Examination? The Implications of Large Language Models for Medical Education and Knowledge Assessment".大语言模型对医学执照和认证考试的回答的变异性。对《ChatGPT在美国医学执照考试中的表现如何？大语言模型对医学教育和知识评估的影响》的评论
JMIR Med Educ. 2023 Jul 13;9:e48305. doi: 10.2196/48305.
2
Authors' Reply to: Variability in Large Language Models' Responses to Medical Licensing and Certification Examinations.作者对《大语言模型对医学执照和认证考试的回答中的变异性》的回复
JMIR Med Educ. 2023 Jul 13;9:e50336. doi: 10.2196/50336.
3
4
Capability of GPT-4V(ision) in the Japanese National Medical Licensing Examination: Evaluation Study.GPT-4V（视觉）在日本国家医师资格考试中的能力：评估研究。
JMIR Med Educ. 2024 Mar 12;10:e54393. doi: 10.2196/54393.
5
Performance of ChatGPT on the Peruvian National Licensing Medical Examination: Cross-Sectional Study.ChatGPT在秘鲁国家医学执照考试中的表现：横断面研究
JMIR Med Educ. 2023 Sep 28;9:e48039. doi: 10.2196/48039.
6
A Novel Evaluation Model for Assessing ChatGPT on Otolaryngology-Head and Neck Surgery Certification Examinations: Performance Study.一种评估 ChatGPT 在耳鼻喉头颈外科认证考试中表现的新评价模型：性能研究。
JMIR Med Educ. 2024 Jan 16;10:e49970. doi: 10.2196/49970.
7
A Generative Pretrained Transformer (GPT)-Powered Chatbot as a Simulated Patient to Practice History Taking: Prospective, Mixed Methods Study.基于生成式预训练转换器（GPT）的聊天机器人作为模拟患者进行病史采集的实践研究：前瞻性混合方法研究。
JMIR Med Educ. 2024 Jan 16;10:e53961. doi: 10.2196/53961.
8
Performance of GPT-3.5 and GPT-4 on the Japanese Medical Licensing Examination: Comparison Study.GPT-3.5和GPT-4在日本医师执照考试中的表现：比较研究。
JMIR Med Educ. 2023 Jun 29;9:e48002. doi: 10.2196/48002.
9
Success of ChatGPT, an AI language model, in taking the French language version of the European Board of Ophthalmology examination: A novel approach to medical knowledge assessment.ChatGPT 人工智能语言模型成功通过欧洲眼科委员会法语考试：医学知识评估的新方法。
J Fr Ophtalmol. 2023 Sep;46(7):706-711. doi: 10.1016/j.jfo.2023.05.006. Epub 2023 Aug 1.
10
The performance of large language models in intercollegiate Membership of the Royal College of Surgeons examination.大型语言模型在皇家外科学院会员联合考试中的表现。
Ann R Coll Surg Engl. 2024 Nov;106(8):700-704. doi: 10.1308/rcsann.2024.0023. Epub 2024 Mar 6.
引用本文的文献
1
ChatGPT and Other Large Language Models in Medical Education - Scoping Literature Review.医学教育中的ChatGPT及其他大语言模型——文献综述
Med Sci Educ. 2024 Nov 13;35(1):555-567. doi: 10.1007/s40670-024-02206-6. eCollection 2025 Feb.
2
Evaluating the Role of GPT-4 and GPT-4o in the Detectability of Chest Radiography Reports Requiring Further Assessment.评估GPT-4和GPT-4o在需要进一步评估的胸部X光报告可检测性中的作用。
Cureus. 2024 Dec 11;16(12):e75532. doi: 10.7759/cureus.75532. eCollection 2024 Dec.
3
Factors influencing Chinese doctors to use medical large language models.影响中国医生使用医学大语言模型的因素。
Digit Health. 2024 Nov 8;10:20552076241297237. doi: 10.1177/20552076241297237. eCollection 2024 Jan-Dec.
4
Comparison of the Performance of GPT-3.5 and GPT-4 With That of Medical Students on the Written German Medical Licensing Examination: Observational Study.GPT-3.5 和 GPT-4 与医学生在书面德语文凭考试中的表现比较：观察性研究。
JMIR Med Educ. 2024 Feb 8;10:e50965. doi: 10.2196/50965.
5
Evaluating the Efficacy of ChatGPT in Navigating the Spanish Medical Residency Entrance Examination (MIR): Promising Horizons for AI in Clinical Medicine.评估ChatGPT在应对西班牙医学住院医师入学考试（MIR）中的效果：人工智能在临床医学中的广阔前景。
Clin Pract. 2023 Nov 20;13(6):1460-1487. doi: 10.3390/clinpract13060130.
6
Reshaping medical education: Performance of ChatGPT on a PES medical examination.重塑医学教育：ChatGPT 在 PES 医学考试中的表现。
Cardiol J. 2024;31(3):442-450. doi: 10.5603/cj.97517. Epub 2023 Oct 13.
7
Authors' Reply to: Variability in Large Language Models' Responses to Medical Licensing and Certification Examinations.作者对《大语言模型对医学执照和认证考试的回答中的变异性》的回复
JMIR Med Educ. 2023 Jul 13;9:e50336. doi: 10.2196/50336.
本文引用的文献
1
Zotero 插件