Ren Xutong, Yang Wenhan, Cheng Wen-Huang, Liu Jiaying
IEEE Trans Image Process. 2020 Apr 3. doi: 10.1109/TIP.2020.2984098.
Noise causes unpleasant visual effects in low-light image/video enhancement. In this paper, we aim to make the enhancement model and method aware of noise in the whole process. To deal with heavy noise which is not handled in previous methods, we introduce a robust low-light enhancement approach, aiming at well enhancing low-light images/videos and suppressing intensive noise jointly. Our method is based on the proposed Low-Rank Regularized Retinex Model (LR3M), which is the first to inject low-rank prior into a Retinex decomposition process to suppress noise in the reflectance map. Our method estimates a piece-wise smoothed illumination and a noise-suppressed reflectance sequentially, avoiding remaining noise in the illumination and reflectance maps which are usually presented in alternative decomposition methods. After getting the estimated illumination and reflectance, we adjust the illumination layer and generate our enhancement result. Furthermore, we apply our LR3M to video low-light enhancement. We consider inter-frame coherence of illumination maps and find similar patches through reflectance maps of successive frames to form the low-rank prior to make use of temporal correspondence. Our method performs well for a wide variety of images and videos, and achieves better quality both in enhancing and denoising, compared with the state-of-the-art methods.
噪声在低光照图像/视频增强中会产生令人不悦的视觉效果。在本文中,我们旨在使增强模型和方法在整个过程中都能感知噪声。为了处理先前方法无法处理的重度噪声,我们引入了一种鲁棒的低光照增强方法,旨在同时很好地增强低光照图像/视频并抑制密集噪声。我们的方法基于所提出的低秩正则化视网膜模型(LR3M),该模型首次将低秩先验引入视网膜分解过程以抑制反射率图中的噪声。我们的方法依次估计分段平滑的光照和噪声抑制后的反射率,避免了交替分解方法中通常在光照图和反射率图中残留的噪声。在获得估计的光照和反射率后,我们调整光照层并生成增强结果。此外,我们将LR3M应用于视频低光照增强。我们考虑光照图的帧间连贯性,并通过连续帧的反射率图找到相似块以形成低秩先验,从而利用时间对应关系。与现有方法相比,我们的方法在各种图像和视频上都表现良好,并且在增强和去噪方面都取得了更好的质量。