Zhang Xiaoqin, Jiang Runhua, Wang Tao, Luo Wenhan
IEEE Trans Image Process. 2021;30:5211-5222. doi: 10.1109/TIP.2021.3078319. Epub 2021 May 25.
An image can be decomposed into two parts: the basic content and details, which usually correspond to the low-frequency and high-frequency information of the image. For a hazy image, these two parts are often affected by haze in different levels, e.g., high-frequency parts are often affected more serious than low-frequency parts. In this paper, we approach the single image dehazing problem as two restoration problems of recovering basic content and image details, and propose a Dual-Path Recurrent Network (DPRN) to simultaneously tackle these two problems. Specifically, the core structure of DPRN is a dual-path block, which uses two parallel branches to learn the characteristics of the basic content and details of hazy images. Each branch consists of several Convolutional LSTM blocks and convolution layers. Moreover, a parallel interaction function is incorporated into the dual-path block, thus enables each branch to dynamically fuse the intermediate features of both the basic content and image details. In this way, both branches can benefit from each other, and recover the basic content and image details alternately, therefore alleviating the color distortion problem in the dehazing process. Experimental results show that the proposed DPRN outperforms state-of-the-art image dehazing methods in terms of both quantitative accuracy and qualitative visual effect.
基本内容和细节,它们通常对应于图像的低频和高频信息。对于一幅模糊图像,这两部分通常会受到不同程度的雾霾影响,例如,高频部分受到的影响往往比低频部分更严重。在本文中,我们将单图像去雾问题视为恢复基本内容和图像细节的两个恢复问题,并提出了一种双路径循环网络(DPRN)来同时解决这两个问题。具体来说,DPRN的核心结构是一个双路径块,它使用两个并行分支来学习模糊图像基本内容和细节的特征。每个分支由几个卷积LSTM块和卷积层组成。此外,双路径块中融入了一个并行交互函数,从而使每个分支能够动态融合基本内容和图像细节的中间特征。通过这种方式,两个分支可以相互受益,并交替恢复基本内容和图像细节,从而减轻去雾过程中的颜色失真问题。实验结果表明,所提出的DPRN在定量准确性和定性视觉效果方面均优于现有的图像去雾方法。