Li Lu, Li Daoyu, Wang Shuai, Jiao Qiang, Bian Liheng
Opt Express. 2023 Mar 13;31(6):10368-10385. doi: 10.1364/OE.484628.
Complex lighting conditions and the limited dynamic range of imaging devices result in captured images with ill exposure and information loss. Existing image enhancement methods based on histogram equalization, Retinex-inspired decomposition model, and deep learning suffer from manual tuning or poor generalization. In this work, we report an image enhancement method against ill exposure with self-supervised learning, enabling tuning-free correction. First, a dual illumination estimation network is constructed to estimate the illumination for under- and over-exposed areas. Thus, we get the corresponding intermediate corrected images. Second, given the intermediate corrected images with different best-exposed areas, Mertens' multi-exposure fusion strategy is utilized to fuse the intermediate corrected images to acquire a well-exposed image. The correction-fusion manner allows adaptive dealing with various types of ill-exposed images. Finally, the self-supervised learning strategy is studied which learns global histogram adjustment for better generalization. Compared to training on paired datasets, we only need ill-exposed images. This is crucial in cases where paired data is inaccessible or less than perfect. Experiments show that our method can reveal more details with better visual perception than other state-of-the-art methods. Furthermore, the weighted average scores of image naturalness matrics NIQE and BRISQUE, and contrast matrics CEIQ and NSS on five real-world image datasets are boosted by 7%, 15%, 4%, and 2%, respectively, over the recent exposure correction method.
复杂的光照条件和成像设备有限的动态范围导致捕获的图像曝光不良和信息丢失。现有的基于直方图均衡化、视网膜启发式分解模型和深度学习的图像增强方法存在人工调优或泛化能力差的问题。在这项工作中,我们报告了一种基于自监督学习的针对曝光不良的图像增强方法,能够实现免调优校正。首先,构建一个双光照估计网络来估计曝光不足和过度曝光区域的光照。因此,我们得到相应的中间校正图像。其次,给定具有不同最佳曝光区域的中间校正图像,利用Mertens的多曝光融合策略融合中间校正图像以获得曝光良好的图像。这种校正-融合方式允许自适应处理各种类型的曝光不良图像。最后,研究了自监督学习策略,该策略学习全局直方图调整以实现更好的泛化。与在配对数据集上进行训练相比,我们只需要曝光不良的图像。这在无法获得配对数据或配对数据不完美的情况下至关重要。实验表明,我们的方法比其他现有方法能够揭示更多细节,视觉感知更好。此外,在五个真实世界图像数据集上,图像自然度指标NIQE和BRISQUE以及对比度指标CEIQ和NSS的加权平均得分分别比最近的曝光校正方法提高了7%、15%、4%和2%。