Department of Electrical and Computer Engineering, University of Windsor, Windsor, ON, Canada.
Department of Electrical and Computer Engineering, Queen's University, Kingston, ON, Canada.
Comput Med Imaging Graph. 2023 Sep;108:102249. doi: 10.1016/j.compmedimag.2023.102249. Epub 2023 May 30.
Magnetic resonance (MR) and computer tomography (CT) images are two typical types of medical images that provide mutually-complementary information for accurate clinical diagnosis and treatment. However, obtaining both images may be limited due to some considerations such as cost, radiation dose and modality missing. Recently, medical image synthesis has aroused gaining research interest to cope with this limitation. In this paper, we propose a bidirectional learning model, denoted as dual contrast cycleGAN (DC-cycleGAN), to synthesize medical images from unpaired data. Specifically, a dual contrast loss is introduced into the discriminators to indirectly build constraints between real source and synthetic images by taking advantage of samples from the source domain as negative samples and enforce the synthetic images to fall far away from the source domain. In addition, cross-entropy and structural similarity index (SSIM) are integrated into the DC-cycleGAN in order to consider both the luminance and structure of samples when synthesizing images. The experimental results indicate that DC-cycleGAN is able to produce promising results as compared with other cycleGAN-based medical image synthesis methods such as cycleGAN, RegGAN, DualGAN, and NiceGAN. Code is available at https://github.com/JiayuanWang-JW/DC-cycleGAN.
磁共振(MR)和计算机断层扫描(CT)图像是两种典型的医学图像,它们为准确的临床诊断和治疗提供了相互补充的信息。然而,由于成本、辐射剂量和模态缺失等因素的考虑,可能会限制同时获取这两种图像。最近,医学图像合成引起了越来越多的研究兴趣,以应对这种限制。在本文中,我们提出了一种双向学习模型,称为双对比循环生成对抗网络(DC-cycleGAN),用于从非配对数据中合成医学图像。具体来说,我们在鉴别器中引入了双对比损失,通过利用源域中的样本作为负样本,间接在真实源和合成图像之间建立约束,并迫使合成图像远离源域,从而利用源域中的样本来间接构建约束。此外,我们还将交叉熵和结构相似性指数(SSIM)集成到 DC-cycleGAN 中,以便在合成图像时同时考虑样本的亮度和结构。实验结果表明,与其他基于循环生成对抗网络的医学图像合成方法(如 cycleGAN、RegGAN、DualGAN 和 NiceGAN)相比,DC-cycleGAN 能够产生有前景的结果。代码可在 https://github.com/JiayuanWang-JW/DC-cycleGAN 上获得。