Liu Risheng, Fan Xin, Hou Minjun, Jiang Zhiying, Luo Zhongxuan, Zhang Lei
IEEE Trans Neural Netw Learn Syst. 2019 Oct;30(10):2973-2986. doi: 10.1109/TNNLS.2018.2862631. Epub 2018 Aug 29.
Single-image dehazing is an important low-level vision task with many applications. Early studies have investigated different kinds of visual priors to address this problem. However, they may fail when their assumptions are not valid on specific images. Recent deep networks also achieve a relatively good performance in this task. But unfortunately, due to the disappreciation of rich physical rules in hazes, a large amount of data are required for their training. More importantly, they may still fail when there exist completely different haze distributions in testing images. By considering the collaborations of these two perspectives, this paper designs a novel residual architecture to aggregate both prior (i.e., domain knowledge) and data (i.e., haze distribution) information to propagate transmissions for scene radiance estimation. We further present a variational energy-based perspective to investigate the intrinsic propagation behavior of our aggregated deep model. In this way, we actually bridge the gap between prior-driven models and data-driven networks and leverage advantages but avoid limitations of previous dehazing approaches. A lightweight learning framework is proposed to train our propagation network. Finally, by introducing a task-aware image separation formulation with a flexible optimization scheme, we extend the proposed model for more challenging vision tasks, such as underwater image enhancement and single-image rain removal. Experiments on both synthetic and real-world images demonstrate the effectiveness and efficiency of the proposed framework.
单图像去雾是一项重要的底层视觉任务,有许多应用。早期研究探讨了不同类型的视觉先验来解决这个问题。然而,当它们的假设在特定图像上不成立时,可能会失败。最近的深度网络在这项任务中也取得了相对较好的性能。但不幸的是,由于对雾中丰富物理规则的忽视,它们的训练需要大量数据。更重要的是,当测试图像中存在完全不同的雾分布时,它们可能仍然会失败。通过考虑这两种观点的协作,本文设计了一种新颖的残差架构,以聚合先验(即领域知识)和数据(即雾分布)信息,用于传播场景辐射估计的透射率。我们进一步提出了一种基于变分能量的观点,以研究我们聚合深度模型的内在传播行为。通过这种方式,我们实际上弥合了先验驱动模型和数据驱动网络之间的差距,并利用了优势,同时避免了先前去雾方法的局限性。提出了一种轻量级学习框架来训练我们的传播网络。最后,通过引入具有灵活优化方案的任务感知图像分离公式,我们将所提出的模型扩展到更具挑战性的视觉任务,如水下图像增强和单图像雨去除。在合成图像和真实世界图像上的实验证明了所提出框架的有效性和效率。