Chao Ke, Song Wei, Shao Sen, Liu Dan, Liu Xiangchun, Zhao XiaoBing
School of Information Engineering, Minzu University of China, Beijing, 100081, China.
Key Laboratory of Marine Environmental Survey Technology and Application, Ministry of Natural Resource, Guangzhou, 510300, China.
Sci Rep. 2023 Aug 9;13(1):12894. doi: 10.1038/s41598-023-39524-5.
Uneven lighting conditions often occur during real-life photography, such as images taken at night that may have both low-light dark areas and high-light overexposed areas. Traditional algorithms for enhancing low-light areas also increase the brightness of overexposed areas, affecting the overall visual effect of the image. Therefore, it is important to achieve differentiated enhancement of low-light and high-light areas. In this paper, we propose a network called correcting uneven illumination network (CUI-Net) with sparse attention transformer and convolutional neural network (CNN) to better extract low-light features by constraining high-light features. Specifically, CUI-Net consists of two main modules: a low-light enhancement module and an auxiliary module. The enhancement module is a hybrid network that combines the advantages of CNN and Transformer network, which can alleviate uneven lighting problems and enhance local details better. The auxiliary module is used to converge the enhancement results of multiple enhancement modules during the training phase, so that only one enhancement module is needed during the testing phase to speed up inference. Furthermore, zero-shot learning is used in this paper to adapt to complex uneven lighting environments without requiring paired or unpaired training data. Finally, to validate the effectiveness of the algorithm, we tested it on multiple datasets of different types, and the algorithm showed stable performance, demonstrating its good robustness. Additionally, by applying this algorithm to practical visual tasks such as object detection, face detection, and semantic segmentation, and comparing it with other state-of-the-art low-light image enhancement algorithms, we have demonstrated its practicality and advantages.
在现实生活中的摄影过程中,不均匀的光照条件经常出现,比如夜间拍摄的图像可能既有低光的暗区,也有高光的过曝区域。传统的增强低光区域的算法也会增加过曝区域的亮度,影响图像的整体视觉效果。因此,实现低光和高光区域的差异化增强非常重要。在本文中,我们提出了一种名为校正不均匀光照网络(CUI-Net)的网络,它结合了稀疏注意力变换器和卷积神经网络(CNN),通过约束高光特征来更好地提取低光特征。具体来说,CUI-Net由两个主要模块组成:一个低光增强模块和一个辅助模块。增强模块是一个混合网络,结合了CNN和Transformer网络的优点,能够缓解不均匀光照问题并更好地增强局部细节。辅助模块用于在训练阶段融合多个增强模块的增强结果,以便在测试阶段只需要一个增强模块来加速推理。此外,本文使用零样本学习来适应复杂的不均匀光照环境,而无需成对或不成对的训练数据。最后,为了验证算法的有效性,我们在多个不同类型的数据集上对其进行了测试,该算法表现出稳定的性能,证明了其良好的鲁棒性。此外,通过将该算法应用于目标检测、人脸检测和语义分割等实际视觉任务,并与其他先进的低光图像增强算法进行比较,我们证明了它的实用性和优势。