Jiang Tai-Xiang, Huang Ting-Zhu, Zhao Xi-Le, Deng Liang-Jian, Wang Yao
IEEE Trans Image Process. 2018 Nov 12. doi: 10.1109/TIP.2018.2880512.
Rain streaks removal is an important issue in outdoor vision systems and has recently been investigated extensively. In this paper, we propose a novel video rain streak removal approach FastDeRain, which fully considers the discriminative characteristics of rain streaks and the clean video in the gradient domain. Specifically, on the one hand, rain streaks are sparse and smooth along the direction of the raindrops, whereas on the other hand, clean videos exhibit piecewise smoothness along the rain-perpendicular direction and continuity along the temporal direction. Theses smoothness and continuity results in the sparse distribution in the different directional gradient domain, respectively. Thus, we minimize 1) the ℓ1 norm to enhance the sparsity of the underlying rain streaks, 2) two ℓ1 norm of unidirectional Total Variation (TV) regularizers to guarantee the anisotropic spatial smoothness, and 3) an ℓ1 norm of the time-directional difference operator to characterize the temporal continuity. A split augmented Lagrangian shrinkage algorithm (SALSA) based algorithm is designed to solve the proposed minimization model. Experiments conducted on synthetic and real data demonstrate the effectiveness and efficiency of the proposed method. According to comprehensive quantitative performance measures, our approach outperforms other state-of-the-art methods, especially on account of the running time. The code of FastDeRain can be downloaded at https://github.com/TaiXiangJiang/FastDeRain.
去除雨痕是户外视觉系统中的一个重要问题,近年来已得到广泛研究。在本文中,我们提出了一种新颖的视频雨痕去除方法FastDeRain,该方法充分考虑了雨痕和清晰视频在梯度域中的判别特征。具体而言,一方面,雨痕沿雨滴方向稀疏且平滑,而另一方面,清晰视频沿垂直于雨的方向表现出分段平滑性,沿时间方向表现出连续性。这些平滑性和连续性分别导致在不同方向梯度域中的稀疏分布。因此,我们最小化:1) ℓ1范数以增强潜在雨痕的稀疏性;2) 单向全变差(TV)正则化器的两个ℓ1范数以保证各向异性空间平滑性;3) 时间方向差分算子的ℓ1范数以表征时间连续性。设计了一种基于分裂增广拉格朗日收缩算法(SALSA)的算法来求解所提出的最小化模型。在合成数据和真实数据上进行的实验证明了该方法的有效性和效率。根据综合定量性能指标,我们的方法优于其他现有方法,尤其是在运行时间方面。FastDeRain的代码可在https://github.com/TaiXiangJiang/FastDeRain上下载。