Department of Pathology and Molecularpathology, Helios University Hospital Wuppertal, Witten/Herdecke University, Witten, Germany.
Faculty of Health, Witten/Herdecke University, Witten, Germany.
J Med Internet Res. 2023 Nov 16;25:e49368. doi: 10.2196/49368.
ChatGPT is a 175-billion-parameter natural language processing model that is already involved in scientific content and publications. Its influence ranges from providing quick access to information on medical topics, assisting in generating medical and scientific articles and papers, performing medical data analyses, and even interpreting complex data sets.
The future role of ChatGPT remains uncertain and a matter of debate already shortly after its release. This review aimed to analyze the role of ChatGPT in the medical literature during the first 3 months after its release.
We performed a concise review of literature published in PubMed from December 1, 2022, to March 31, 2023. To find all publications related to ChatGPT or considering ChatGPT, the search term was kept simple ("ChatGPT" in AllFields). All publications available as full text in German or English were included. All accessible publications were evaluated according to specifications by the author team (eg, impact factor, publication modus, article type, publication speed, and type of ChatGPT integration or content). The conclusions of the articles were used for later SWOT (strengths, weaknesses, opportunities, and threats) analysis. All data were analyzed on a descriptive basis.
Of 178 studies in total, 160 met the inclusion criteria and were evaluated. The average impact factor was 4.423 (range 0-96.216), and the average publication speed was 16 (range 0-83) days. Among the articles, there were 77 editorials (48,1%), 43 essays (26.9%), 21 studies (13.1%), 6 reviews (3.8%), 6 case reports (3.8%), 6 news (3.8%), and 1 meta-analysis (0.6%). Of those, 54.4% (n=87) were published as open access, with 5% (n=8) provided on preprint servers. Over 400 quotes with information on strengths, weaknesses, opportunities, and threats were detected. By far, most (n=142, 34.8%) were related to weaknesses. ChatGPT excels in its ability to express ideas clearly and formulate general contexts comprehensibly. It performs so well that even experts in the field have difficulty identifying abstracts generated by ChatGPT. However, the time-limited scope and the need for corrections by experts were mentioned as weaknesses and threats of ChatGPT. Opportunities include assistance in formulating medical issues for nonnative English speakers, as well as the possibility of timely participation in the development of such artificial intelligence tools since it is in its early stages and can therefore still be influenced.
Artificial intelligence tools such as ChatGPT are already part of the medical publishing landscape. Despite their apparent opportunities, policies and guidelines must be implemented to ensure benefits in education, clinical practice, and research and protect against threats such as scientific misconduct, plagiarism, and inaccuracy.
ChatGPT 是一个拥有 1750 亿个参数的自然语言处理模型，已经涉及到科学内容和出版物。它的影响范围从提供有关医学主题的快速信息访问，协助生成医学和科学文章和论文，进行医学数据分析，甚至解释复杂的数据集。
ChatGPT 的未来角色在发布后不久就已经存在不确定性和争议。本综述旨在分析 ChatGPT 在发布后的头 3 个月内在医学文献中的作用。
我们对 2022 年 12 月 1 日至 2023 年 3 月 31 日期间在 PubMed 上发表的文献进行了简明回顾。为了找到所有与 ChatGPT 相关或考虑 ChatGPT 的出版物，我们使用了简单的搜索词（“ChatGPT”在所有字段中）。包括所有可全文获取的德文或英文出版物。根据作者团队的规范（例如，影响因子、出版模式、文章类型、出版速度以及 ChatGPT 集成或内容的类型）评估所有可获取的出版物。文章的结论用于后来的 SWOT（优势、劣势、机会和威胁）分析。所有数据均进行描述性分析。
总共 178 项研究中，有 160 项符合纳入标准并进行了评估。平均影响因子为 4.423（范围 0-96.216），平均出版速度为 16（范围 0-83）天。在这些文章中，有 77 篇社论（48.1%）、43 篇随笔（26.9%）、21 篇研究（13.1%）、6 篇评论（3.8%）、6 篇病例报告（3.8%）、6 篇新闻（3.8%）和 1 篇荟萃分析（0.6%）。其中，54.4%（n=87）以开放获取形式发表，其中 5%（n=8）在预印本服务器上提供。共检测到超过 400 条包含优势、劣势、机会和威胁信息的引用。到目前为止，大多数（n=142，34.8%）与劣势有关。ChatGPT 在清晰表达思想和全面形成一般语境方面表现出色。它的表现非常出色，以至于该领域的专家也难以识别 ChatGPT 生成的摘要。然而，限时范围和需要专家纠正被认为是 ChatGPT 的劣势和威胁。机会包括为非英语母语者在医学问题上提供帮助，以及由于它处于早期阶段，因此可以及时参与此类人工智能工具的开发，从而仍然可以产生影响。
人工智能工具，如 ChatGPT，已经成为医学出版领域的一部分。尽管它们具有明显的优势，但必须实施政策和准则，以确保在教育、临床实践和研究中受益，并防范科学不端行为、剽窃和不准确等威胁。
