Department of Otolaryngology and Head and Neck Surgery, Sheba Medical Center, Tel Hashomer, Israel, ARC Innovation Center, Sheba Medical Center, Tel Hashomer, Israel, Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
Department of Otolaryngology and Head and Neck Surgery, Sheba Medical Center, Tel Hashomer, Israel, Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
Isr Med Assoc J. 2024 Feb;26(2):80-85.
Advancements in artificial intelligence (AI) and natural language processing (NLP) have led to the development of language models such as ChatGPT. These models have the potential to transform healthcare and medical research. However, understanding their applications and limitations is essential.
To present a view of ChatGPT research and to critically assess ChatGPT's role in medical writing and clinical environments.
We performed a literature review via the PubMed search engine from 20 November 2022, to 23 April 2023. The search terms included ChatGPT, OpenAI, and large language models. We included studies that focused on ChatGPT, explored its use or implications in medicine, and were original research articles. The selected studies were analyzed considering study design, NLP tasks, main findings, and limitations.
Our study included 27 articles that examined ChatGPT's performance in various tasks and medical fields. These studies covered knowledge assessment, writing, and analysis tasks. While ChatGPT was found to be useful in tasks such as generating research ideas, aiding clinical reasoning, and streamlining workflows, limitations were also identified. These limitations included inaccuracies, inconsistencies, fictitious information, and limited knowledge, highlighting the need for further improvements.
The review underscores ChatGPT's potential in various medical applications. Yet, it also points to limitations that require careful human oversight and responsible use to improve patient care, education, and decision-making.
人工智能 (AI) 和自然语言处理 (NLP) 的进步催生了 ChatGPT 等语言模型。这些模型有可能改变医疗保健和医学研究。然而，理解它们的应用和局限性至关重要。
介绍 ChatGPT 研究，并批判性评估 ChatGPT 在医学写作和临床环境中的作用。
我们通过 PubMed 搜索引擎于 2022 年 11 月 20 日至 2023 年 4 月 23 日进行了文献回顾。搜索词包括 ChatGPT、OpenAI 和大型语言模型。我们纳入了专注于 ChatGPT 的研究，探讨其在医学中的使用或影响，且为原创研究文章的研究。我们考虑了研究设计、NLP 任务、主要发现和局限性对选定的研究进行了分析。
我们的研究纳入了 27 篇评估 ChatGPT 在各种任务和医学领域中的表现的文章。这些研究涵盖了知识评估、写作和分析任务。虽然 ChatGPT 在生成研究思路、辅助临床推理和简化工作流程等任务中被发现是有用的，但也发现了其局限性。这些局限性包括不准确、不一致、虚构信息和知识有限，这突显了需要进一步改进。
该综述强调了 ChatGPT 在各种医学应用中的潜力。然而，它也指出了需要人类仔细监督和负责任使用的局限性，以改善患者护理、教育和决策。
