Cai Jianrui, Gu Shuhang, Zhang Lei, Zhang Lei
IEEE Trans Image Process. 2018 Jan 15. doi: 10.1109/TIP.2018.2794218.
Due to the poor lighting condition and limited dynamic range of digital imaging devices, the recorded images are often under-/over-exposed and with low contrast. Most of previous single image contrast enhancement (SICE) methods adjust the tone curve to correct the contrast of an input image. Those methods, however, often fail in revealing image details because of the limited information in a single image. On the other hand, the SICE task can be better accomplished if we can learn extra information from appropriately collected training data. In this work, we propose to use the convolutional neural network (CNN) to train a SICE enhancer. One key issue is how to construct a training dataset of low-contrast and high-contrast image pairs for end-to-end CNN learning. To this end, we build a large-scale multi-exposure image dataset, which contains 589 elaborately selected high-resolution multi-exposure sequences with 4,413 images. Thirteen representative multi-exposure image fusion and stack-based high dynamic range imaging algorithms are employed to generate the contrast enhanced images for each sequence, and subjective experiments are conducted to screen the best quality one as the reference image of each scene. With the constructed dataset, a CNN can be easily trained as the SICE enhancer to improve the contrast of an under-/over-exposure image. Experimental results demonstrate the advantages of our method over existing SICE methods with a significant margin.
由于数字成像设备的光照条件差和动态范围有限,所记录的图像经常曝光不足/过度曝光且对比度低。大多数先前的单图像对比度增强(SICE)方法通过调整色调曲线来校正输入图像的对比度。然而,由于单幅图像中的信息有限,这些方法往往无法揭示图像细节。另一方面,如果我们能够从适当收集的训练数据中学习额外信息,那么SICE任务可以更好地完成。在这项工作中,我们建议使用卷积神经网络(CNN)来训练一个SICE增强器。一个关键问题是如何构建一个低对比度和高对比度图像对的训练数据集,用于端到端的CNN学习。为此,我们构建了一个大规模的多曝光图像数据集,其中包含589个精心挑选的高分辨率多曝光序列,共4413张图像。采用13种具有代表性的多曝光图像融合和基于堆栈的高动态范围成像算法为每个序列生成对比度增强图像,并进行主观实验以筛选出质量最佳的图像作为每个场景的参考图像。利用构建的数据集,可以轻松地训练一个CNN作为SICE增强器,以提高曝光不足/过度曝光图像的对比度。实验结果表明,我们的方法比现有SICE方法具有显著优势。