School of Electrical and Information Engineering, Tianjin University, Tianjin, China; Shanghai Artificial Intelligence Laboratory, China.
School of Electrical and Information Engineering, Tianjin University, Tianjin, China.
Neural Netw. 2023 Oct;167:1-9. doi: 10.1016/j.neunet.2023.08.010. Epub 2023 Aug 9.
Most of the existing learning-based dehazing methods require a diverse and large collection of paired hazy/clean images, which is intractable to obtain. Therefore, existing dehazing methods resort to training on synthetic images. This may result in a possible domain shift when treating real scenes. In this paper, we propose a novel unsupervised dehazing (lightweight) network without any reference images to directly predict clear images from the original hazy images, which consists of an interactive fusion module (IFM) and an iterative optimization module (IOM). Specifically, IFM interactively fuses multi-level features to make up for the missing information among deep and shallow features while IOM iteratively optimizes dehazed results to obtain pleasing visual effects. Particularly, based on the observation that hazy images usually suffer from quality degradation, four non-reference visual-quality-driven loss functions are designed to enable the network trained in an unsupervised way, including dark channel loss, contrast loss, saturation loss, and edge sharpness loss. Extensive experiments on two synthetic datasets and one real-world dataset demonstrate that our method performs favorably against the state-of-the-art unsupervised dehazing methods and even matches some supervised methods in terms of metrics such as PSNR, SSIM, and UQI.
大多数现有的基于学习的去雾方法都需要大量多样的成对的雾天/清晰图像,这是难以获得的。因此,现有的去雾方法求助于对合成图像进行训练。当处理真实场景时,这可能会导致可能的领域转移。在本文中,我们提出了一种新颖的无监督去雾(轻量级)网络,无需任何参考图像,即可直接从原始雾天图像预测清晰图像,该网络由一个交互式融合模块(IFM)和一个迭代优化模块(IOM)组成。具体来说,IFM 交互式融合多级特征,以弥补深、浅层特征之间缺失的信息,而 IOM 迭代优化去雾结果,以获得令人愉悦的视觉效果。特别是,基于雾天图像通常会受到质量下降的观察,我们设计了四个无参考视觉质量驱动的损失函数,以使网络在无监督的方式下进行训练,包括暗通道损失、对比度损失、饱和度损失和边缘锐度损失。在两个合成数据集和一个真实世界数据集上的广泛实验表明,我们的方法在无监督去雾方法中表现良好,甚至在 PSNR、SSIM 和 UQI 等指标上与一些有监督方法相匹配。