Hu Mingdi, Song Yao, Zhang Songxin, Xie Zejian, Jing Bingyi
School of Communication and Information Engineering, Xi'an University of Posts and Telecommunications, No. 618 Chang'an West St. Chang'an District, Xi'an, 710121, P.R. China.
Department of Statistics & Data Science, Southern University of Science and Technology, 1088 Xueyuan Avenue, Shenzhen, 518055, P.R. China.
Sci Rep. 2025 Mar 25;15(1):10277. doi: 10.1038/s41598-025-94643-5.
In this paper, a plug and play fuzzy mask extraction module for single image rain streak removal is proposed. Specifically, fuzzy mask maps of the rain data-set are obtained by optimizing the convex combination of several grouping functions; Based on these fuzzy mask maps as ground truth, we develop a deep learning architecture that learns the fuzzy rain map; We then fix the model to obtain a unified network model as a plug and play fuzzy mask extraction module for Single Image Deraining; When we embed a plug and play fuzzy mask extraction module into a deraining deep neural network architecture, it will improve performance due to fusion with the fine guided information of the fuzzy rain mask map. Our method differs from other mask maps as the fuzzy mask ground truth is extracted based on the pixel-level membership of the background and foreground of the image, so the grey similarity and spatial similarity between each pixel and its neighboring pixels of a single rain image can be expressed more elaborately. We provide a unified fuzzy mask module in image rain removal, which can lessen the burden of designing an attention module. The advantage of our proposed method is, as long as our fuzzy mask extraction module is embedded in any encoding and decoding rain removal network, it can obtain additional guided information such as rainy/non-rainy regions and the degree of degraded image, which can be greatly beneficial in rain detection and removal. Comprehensive experiments show that combining the rain removal network with our proposed model not only improves the rain removal effect of the algorithm, but also gives clearer background details of the image. The proposed fuzzy mask learning model is critically beneficial for either rain removal algorithms.
本文提出了一种用于单图像雨痕去除的即插即用模糊掩码提取模块。具体来说,通过优化几个分组函数的凸组合来获得雨数据集的模糊掩码图;基于这些模糊掩码图作为真值,我们开发了一种深度学习架构来学习模糊雨图;然后我们固定模型以获得一个统一的网络模型,作为单图像去雨的即插即用模糊掩码提取模块;当我们将即插即用模糊掩码提取模块嵌入到去雨深度神经网络架构中时,由于与模糊雨掩码图的精细引导信息融合,它将提高性能。我们的方法与其他掩码图不同,因为模糊掩码真值是基于图像背景和前景的像素级隶属度提取的,所以单个雨图像中每个像素与其相邻像素之间的灰度相似性和空间相似性可以更精细地表示。我们在图像去雨中提供了一个统一的模糊掩码模块,这可以减轻设计注意力模块的负担。我们提出的方法的优点是,只要我们的模糊掩码提取模块嵌入到任何编码和解码去雨网络中,它就可以获得诸如雨区/非雨区和图像退化程度等额外的引导信息,这在雨检测和去除中非常有益。综合实验表明,将去雨网络与我们提出的模型相结合不仅提高了算法的去雨效果,而且还给出了图像更清晰的背景细节。所提出的模糊掩码学习模型对任何去雨算法都非常有益。