School of Information Science and Engineering, Dalian Polytechnic University, Dalian 116034, China.
Sensors (Basel). 2022 Sep 9;22(18):6823. doi: 10.3390/s22186823.
Computer vision technology is increasingly being used in areas such as intelligent security and autonomous driving. Users need accurate and reliable visual information, but the images obtained under severe weather conditions are often disturbed by rainy weather, causing image scenes to look blurry. Many current single image deraining algorithms achieve good performance but have limitations in retaining detailed image information. In this paper, we design a Scale-space Feature Recalibration Network (SFR-Net) for single image deraining. The proposed network improves the image feature extraction and characterization capability of a Multi-scale Extraction Recalibration Block (MERB) using dilated convolution with different convolution kernel sizes, which results in rich multi-scale rain streaks features. In addition, we develop a Subspace Coordinated Attention Mechanism (SCAM) and embed it into MERB, which combines coordinated attention recalibration and a subspace attention mechanism to recalibrate the rain streaks feature information learned from the feature extraction phase and eliminate redundant feature information to enhance the transfer of important feature information. Meanwhile, the overall SFR-Net structure uses dense connection and cross-layer feature fusion to repeatedly utilize the feature maps, thus enhancing the understanding of the network and avoiding gradient disappearance. Through extensive experiments on synthetic and real datasets, the proposed method outperforms the recent state-of-the-art deraining algorithms in terms of both the rain removal effect and the preservation of image detail information.
计算机视觉技术在智能安全和自动驾驶等领域得到了越来越广泛的应用。用户需要准确可靠的视觉信息,但在恶劣天气条件下获得的图像往往会受到雨天的干扰,导致图像场景变得模糊。许多现有的单幅图像去雨算法虽然性能良好,但在保留详细图像信息方面存在局限性。本文设计了一种用于单幅图像去雨的尺度空间特征重校准网络(SFR-Net)。所提出的网络使用不同卷积核大小的扩张卷积,提高了多尺度提取重校准块(MERB)的图像特征提取和表征能力,从而产生丰富的多尺度雨条纹特征。此外,我们开发了一种子空间协调注意机制(SCAM),并将其嵌入 MERB 中,该机制结合了协调注意重校准和子空间注意力机制,对从特征提取阶段学习到的雨条纹特征信息进行重校准,消除冗余特征信息,增强重要特征信息的传递。同时,整个 SFR-Net 结构采用密集连接和跨层特征融合,反复利用特征图,从而增强了网络的理解能力,避免了梯度消失。通过对合成和真实数据集的广泛实验,所提出的方法在去雨效果和图像细节信息保留方面均优于最新的去雨算法。