Guo Wen, Fan Yugang, Zhang Guanghui
Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China.
Yunnan Key Laboratory of Intelligent Control and Application, Kunming University of Science and Technology, Kunming 650500, China.
Sensors (Basel). 2024 Oct 17;24(20):6677. doi: 10.3390/s24206677.
A lightweight infrared image denoising method based on adversarial transfer learning is proposed. The method adopts a generative adversarial network (GAN) framework and optimizes the model through a phased transfer learning strategy. In the initial stage, the generator is pre-trained using a large-scale grayscale visible light image dataset. Subsequently, the generator is fine-tuned on an infrared image dataset using feature transfer techniques. This phased transfer strategy helps address the problem of insufficient sample quantity and variety in infrared images. Through the adversarial process of the GAN, the generator is continuously optimized to enhance its feature extraction capabilities in environments with limited data. Moreover, the generator structure incorporates structural reparameterization technology, edge convolution modules, and progressive multi-scale attention block (PMAB), significantly improving the model's ability to recognize edge and texture features. During the inference stage, structural reparameterization further optimizes the network architecture, significantly reducing model parameters and complexity and thereby improving denoising efficiency. The experimental results of public and real-world datasets demonstrate that this method effectively removes additive white Gaussian noise from infrared images, showing outstanding denoising performance.
提出了一种基于对抗性迁移学习的轻量级红外图像去噪方法。该方法采用生成对抗网络(GAN)框架,并通过分阶段迁移学习策略对模型进行优化。在初始阶段,使用大规模灰度可见光图像数据集对生成器进行预训练。随后,使用特征迁移技术在红外图像数据集上对生成器进行微调。这种分阶段迁移策略有助于解决红外图像中样本数量不足和种类单一的问题。通过GAN的对抗过程,不断优化生成器,以增强其在数据有限环境中的特征提取能力。此外,生成器结构 incorporates 结构重参数化技术、边缘卷积模块和渐进多尺度注意力块(PMAB),显著提高了模型识别边缘和纹理特征的能力。在推理阶段,结构重参数化进一步优化网络架构,显著减少模型参数和复杂度,从而提高去噪效率。公共和真实世界数据集的实验结果表明,该方法能有效去除红外图像中的加性高斯白噪声,表现出出色的去噪性能。