Kidder Benjamin L
Department of Oncology, Wayne State University School of Medicine, Detroit, MI, 48201, United States.
Karmanos Cancer Institute, Wayne State University School of Medicine, Detroit, MI, 48201, United States.
Biol Methods Protoc. 2024 Aug 23;9(1):bpae062. doi: 10.1093/biomethods/bpae062. eCollection 2024.
Deep neural networks have significantly advanced the field of medical image analysis, yet their full potential is often limited by relatively small dataset sizes. Generative modeling, particularly through diffusion models, has unlocked remarkable capabilities in synthesizing photorealistic images, thereby broadening the scope of their application in medical imaging. This study specifically investigates the use of diffusion models to generate high-quality brain MRI scans, including those depicting low-grade gliomas, as well as contrast-enhanced spectral mammography (CESM) and chest and lung X-ray images. By leveraging the DreamBooth platform, we have successfully trained stable diffusion models utilizing text prompts alongside class and instance images to generate diverse medical images. This approach not only preserves patient anonymity but also substantially mitigates the risk of patient re-identification during data exchange for research purposes. To evaluate the quality of our synthesized images, we used the Fréchet inception distance metric, demonstrating high fidelity between the synthesized and real images. Our application of diffusion models effectively captures oncology-specific attributes across different imaging modalities, establishing a robust framework that integrates artificial intelligence in the generation of oncological medical imagery.
深度神经网络极大地推动了医学图像分析领域的发展,但其全部潜力往往受到相对较小数据集规模的限制。生成式建模,特别是通过扩散模型,在合成逼真图像方面展现出非凡能力,从而拓宽了其在医学成像中的应用范围。本研究专门探讨了利用扩散模型生成高质量脑部磁共振成像(MRI)扫描图像,包括描绘低级别胶质瘤的图像,以及对比增强光谱乳腺造影(CESM)和胸部及肺部X光图像。通过利用DreamBooth平台,我们成功地使用文本提示以及类别和实例图像训练了稳定扩散模型,以生成多样的医学图像。这种方法不仅保护了患者的匿名性,还大大降低了在研究数据交换过程中患者被重新识别的风险。为了评估我们合成图像的质量,我们使用了弗雷歇因距离度量,结果表明合成图像与真实图像之间具有高保真度。我们对扩散模型的应用有效地捕捉了不同成像模态下的肿瘤学特定属性,建立了一个在肿瘤医学图像生成中集成人工智能的强大框架。