Fang Jing, Ma Xiaole, Wang Jingjing, Qin Kai, Hu Shaohai, Zhao Yuefeng
Shandong Province Key Laboratory of Medical Physics and Image Processing Technology, School of Physics and Electronics, Shandong Normal University, Jinan 250014, China.
Shandong Provincial Engineering and Technical Center of Light Manipulations & Shandong Provincial Key Laboratory of Optics and Photonic Device, School of Physics and Electronics, Shandong Normal University, Jinan 250014, China.
Entropy (Basel). 2021 Mar 30;23(4):410. doi: 10.3390/e23040410.
The unavoidable noise often present in synthetic aperture radar (SAR) images, such as speckle noise, negatively impacts the subsequent processing of SAR images. Further, it is not easy to find an appropriate application for SAR images, given that the human visual system is sensitive to color and SAR images are gray. As a result, a noisy SAR image fusion method based on nonlocal matching and generative adversarial networks is presented in this paper. A nonlocal matching method is applied to processing source images into similar block groups in the pre-processing step. Then, adversarial networks are employed to generate a final noise-free fused SAR image block, where the generator aims to generate a noise-free SAR image block with color information, and the discriminator tries to increase the spatial resolution of the generated image block. This step ensures that the fused image block contains high resolution and color information at the same time. Finally, a fused image can be obtained by aggregating all the image blocks. By extensive comparative experiments on the SEN1-2 datasets and source images, it can be found that the proposed method not only has better fusion results but is also robust to image noise, indicating the superiority of the proposed noisy SAR image fusion method over the state-of-the-art methods.
合成孔径雷达(SAR)图像中经常存在不可避免的噪声,如斑点噪声,这会对SAR图像的后续处理产生负面影响。此外,鉴于人类视觉系统对颜色敏感而SAR图像是灰度图像,为SAR图像找到合适的应用并不容易。因此,本文提出了一种基于非局部匹配和生成对抗网络的含噪SAR图像融合方法。在预处理步骤中,应用非局部匹配方法将源图像处理成相似的块组。然后,利用对抗网络生成最终的无噪声融合SAR图像块,其中生成器旨在生成具有颜色信息的无噪声SAR图像块,判别器则试图提高生成图像块的空间分辨率。这一步确保融合后的图像块同时包含高分辨率和颜色信息。最后,通过聚合所有图像块可得到融合图像。通过在SEN1-2数据集和源图像上进行大量对比实验发现,所提方法不仅具有更好的融合效果,而且对图像噪声具有鲁棒性,表明所提含噪SAR图像融合方法优于现有方法。