Ghahfarokhi Sepehr Salem, To Tyrell, Jorns Julie, Yen Tina, Yu Bing, Ye Dong Hye
Department of Computer Science, Georgia State University, Atlanta, GA, USA.
Department of Electrical and Computer Engineering, Marquette University, Milwaukee, WI, USA.
Proc IEEE Int Symp Biomed Imaging. 2024 May;2024. doi: 10.1109/ISBI56570.2024.10635349. Epub 2024 Aug 22.
Data limitation is a significant challenge in applying deep learning to medical images. Recently, the diffusion probabilistic model (DPM) has shown the potential to generate high-quality images by converting Gaussian random noise into realistic images. In this paper, we apply the DPM to augment the deep ultraviolet fluorescence (DUV) image dataset with an aim to improve breast cancer classification for intra-operative margin assessment. For classification, we divide the whole surface DUV image into small patches and extract convolutional features for each patch by utilizing the pre-trained ResNet. Then, we feed them into an XGBoost classifier for patch-level decisions and then fuse them with a regional importance map computed by Grad-CAM++ for whole surface-level prediction. Our experimental results show that augmenting the training dataset with the DPM significantly improves breast cancer detection performance in DUV images, increasing accuracy from 93% to 97%, compared to using Affine transformations and ProGAN.
数据限制是将深度学习应用于医学图像时面临的一项重大挑战。最近,扩散概率模型(DPM)已显示出通过将高斯随机噪声转换为真实图像来生成高质量图像的潜力。在本文中,我们应用DPM来扩充深紫外荧光(DUV)图像数据集,旨在改善用于术中切缘评估的乳腺癌分类。对于分类,我们将整个表面DUV图像划分为小补丁,并利用预训练的ResNet为每个补丁提取卷积特征。然后,我们将它们输入到XGBoost分类器中进行补丁级别的决策,然后将其与通过Grad-CAM++计算的区域重要性图融合,以进行整个表面级别的预测。我们的实验结果表明,与使用仿射变换和ProGAN相比,用DPM扩充训练数据集可显著提高DUV图像中乳腺癌的检测性能,将准确率从93%提高到97%。