Electronic Information School, Wuhan University, Wuhan 430072, China.
Neural Netw. 2024 Dec;180:106689. doi: 10.1016/j.neunet.2024.106689. Epub 2024 Aug 31.
Compared to pixel-level content loss, domain-level style loss in CycleGAN-based dehazing algorithms just imposes relatively soft constraints on the intermediate translated images, resulting in struggling to accurately model haze-free features from real hazy scenes. Furthermore, globally perceptual discriminator may misclassify real hazy images with significant scene depth variations as clean style, thereby resulting in severe haze residue. To address these issues, we propose a pseudo self-distillation based CycleGAN with enhanced local adversarial interaction for image dehazing, termed as PSD-ELGAN. On the one hand, we leverage the characteristic of CycleGAN to generate pseudo image pairs during training. Knowledge distillation is employed in this unsupervised framework to transfer the informative high-quality features from the self-reconstruction network of real clean images to the dehazing generator of paired pseudo hazy images, which effectively improves its haze-free feature representation ability without increasing network parameters. On the other hand, in the output of dehazing generator, four non-uniform image patches severely affected by residual haze are adaptively selected as input samples. The local discriminator could easily distinguish their hazy style, thereby further compelling the dehazing generator to suppress haze residues in such regions, thus enhancing its dehazing performance. Extensive experiments show that our PSD-ELGAN can achieve promising results and better generality across various datasets.
与基于 CycleGAN 的去雾算法中的像素级内容损失相比,域级风格损失只是对中间翻译图像施加相对软的约束,从而难以准确地从真实的有雾场景中建模无雾特征。此外,全局感知鉴别器可能会错误地将具有显著场景深度变化的真实有雾图像分类为干净的风格,从而导致严重的雾残留。为了解决这些问题,我们提出了一种基于伪自蒸馏的增强局部对抗交互的 CycleGAN 用于图像去雾,称为 PSD-ELGAN。一方面,我们利用 CycleGAN 的特性在训练期间生成伪图像对。在这个无监督的框架中,知识蒸馏被用来将来自真实干净图像的自重建网络的信息丰富的高质量特征转移到配对的伪有雾图像的去雾生成器,从而有效地提高其无雾特征表示能力,而不会增加网络参数。另一方面,在去雾生成器的输出中,自适应地选择四个严重受残留雾影响的非均匀图像块作为输入样本。局部鉴别器可以很容易地分辨出它们的雾态,从而进一步迫使去雾生成器抑制这些区域的雾残留,从而提高其去雾性能。广泛的实验表明,我们的 PSD-ELGAN 可以在各种数据集上取得有希望的结果和更好的通用性。