Rashidi Hooman H, Pantanowitz Joshua, Chamanzar Alireza, Fennell Brandon, Wang Yanshan, Gullapalli Rama R, Tafti Ahmad, Deebajah Mustafa, Albahra Samer, Glassy Eric, Hanna Matthew G, Pantanowitz Liron
Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania.
School of Medicine, University of Pittsburgh, Pittsburgh, Pennsylvania.
Mod Pathol. 2025 Apr;38(4):100687. doi: 10.1016/j.modpat.2024.100687. Epub 2024 Dec 15.
This review article builds upon the introductory piece in our 7-part series, delving deeper into the transformative potential of generative artificial intelligence (Gen AI) in pathology and medicine. The article explores the applications of Gen AI models in pathology and medicine, including the use of custom chatbots for diagnostic report generation, synthetic image synthesis for training new models, data set augmentation, hypothetical scenario generation for educational purposes, and the use of multimodal along with multiagent models. This article also provides an overview of the common categories within Gen AI models, discussing open-source and closed-source models, as well as specific examples of popular models such as GPT-4, Llama, Mistral, DALL-E, Stable Diffusion, and their associated frameworks (eg, transformers, generative adversarial networks, diffusion-based neural networks), along with their limitations and challenges, especially within the medical domain. We also review common libraries and tools that are currently deemed necessary to build and integrate such models. Finally, we look to the future, discussing the potential impact of Gen AI on health care, including benefits, challenges, and concerns related to privacy, bias, ethics, application programming interface costs, and security measures.
这篇综述文章基于我们7部分系列中的介绍性文章,更深入地探讨了生成式人工智能(Gen AI)在病理学和医学中的变革潜力。文章探讨了Gen AI模型在病理学和医学中的应用,包括使用定制聊天机器人生成诊断报告、合成图像合成以训练新模型、数据集扩充、用于教育目的的假设情景生成,以及多模态和多智能体模型的使用。本文还概述了Gen AI模型中的常见类别,讨论了开源和闭源模型,以及流行模型的具体示例,如GPT-4、Llama、Mistral、DALL-E、Stable Diffusion及其相关框架(如变压器、生成对抗网络、基于扩散的神经网络),以及它们的局限性和挑战,特别是在医学领域。我们还回顾了目前构建和集成此类模型所需的常见库和工具。最后,我们展望未来,讨论Gen AI对医疗保健的潜在影响,包括益处、挑战以及与隐私、偏差、伦理、应用程序编程接口成本和安全措施相关的问题。