Suppr超能文献

通过稳定扩散合成COVID-19肺炎的胸部X光图像模式

COVID-19 PNEUMONIA CHEST X-RAY PATTERN SYNTHESIS BY STABLE DIFFUSION.

作者信息

Liang Zhaohui, Xue Zhiyun, Rajaraman Sivaramakrishnan, Antani Sameer

机构信息

Computational Health Research Branch, National Library of Medicine, NIH.

出版信息

Proc IEEE Southwest Symp Image Anal Interpret. 2024 Mar;2024:21-24. doi: 10.1109/ssiai59505.2024.10508671. Epub 2024 Apr 29.

Abstract

In this study, we fine-tuned a stable diffusion model to synthesize high resolution chest X-ray images (512×512) with bilateral lung edema caused by COVID-19 pneumonia using the class-specific prior preservation strategy. 300 positive images were selected from the MIDRC dataset as subject instances with an additional 400 negative images for class prior preservation. We synthesized images respectively using the new technique and the conventional technique for comparison. The synthetic images by the stable diffusion fine-tuned by the prior preservation technique have the Frechet inception distance (FID) of 9.2158 and kernel inception distance (KID) 0.0818 computed with the real positive images, which is superior to the synthetic images using the conventional methods such as WGAN and DDIM. The classification accuracy is 0.9975 with precision of 1.0 and recall of 0.9950 when the synthetic positive images with the real negative images were classified by a trained vision transformer (ViT). We conclude that the stable diffusion model can synthesize high-quality and high-resolution chest x-ray images using the prior preservation strategy with a small number of real images as subject instances and text prompt as guidance for the designated patterns.

摘要

在本研究中,我们使用特定类别先验保留策略对稳定扩散模型进行微调,以合成由新冠病毒肺炎引起的双侧肺水肿的高分辨率胸部X光图像(512×512)。从MIDRC数据集中选择了300张阳性图像作为主题实例,并额外选择了400张阴性图像用于类别先验保留。我们分别使用新技术和传统技术合成图像以进行比较。通过先验保留技术微调的稳定扩散合成的图像与真实阳性图像计算的弗雷歇因距离(FID)为9.2158,核因距离(KID)为0.0818,优于使用WGAN和DDIM等传统方法合成的图像。当由训练好的视觉Transformer(ViT)对合成阳性图像与真实阴性图像进行分类时,分类准确率为0.9975,精确率为1.0,召回率为0.9950。我们得出结论,稳定扩散模型可以使用先验保留策略,以少量真实图像作为主题实例,并以文本提示作为指定模式的指导,来合成高质量和高分辨率的胸部X光图像。

相似文献

1
COVID-19 PNEUMONIA CHEST X-RAY PATTERN SYNTHESIS BY STABLE DIFFUSION.通过稳定扩散合成COVID-19肺炎的胸部X光图像模式
Proc IEEE Southwest Symp Image Anal Interpret. 2024 Mar;2024:21-24. doi: 10.1109/ssiai59505.2024.10508671. Epub 2024 Apr 29.
7
Advanced image generation for cancer using diffusion models.使用扩散模型进行癌症的高级图像生成。
Biol Methods Protoc. 2024 Aug 23;9(1):bpae062. doi: 10.1093/biomethods/bpae062. eCollection 2024.

本文引用的文献

6
The acute respiratory distress syndrome.急性呼吸窘迫综合征。
J Clin Invest. 2012 Aug;122(8):2731-40. doi: 10.1172/JCI60331. Epub 2012 Aug 1.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验