Lu Yucheng, Jung Seung-Won
IEEE Trans Image Process. 2022;31:2390-2404. doi: 10.1109/TIP.2022.3155948. Epub 2022 Mar 15.
Low-light imaging on mobile devices is typically challenging due to insufficient incident light coming through the relatively small aperture, resulting in low image quality. Most of the previous works on low-light imaging focus either only on a single task such as illumination adjustment, color enhancement, or noise removal; or on a joint illumination adjustment and denoising task that heavily relies on short-long exposure image pairs from specific camera models. These approaches are less practical and generalizable in real-world settings where camera-specific joint enhancement and restoration is required. In this paper, we propose a low-light imaging framework that performs joint illumination adjustment, color enhancement, and denoising to tackle this problem. Considering the difficulty in model-specific data collection and the ultra-high definition of the captured images, we design two branches: a coefficient estimation branch and a joint operation branch. The coefficient estimation branch works in a low-resolution space and predicts the coefficients for enhancement via bilateral learning, whereas the joint operation branch works in a full-resolution space and progressively performs joint enhancement and denoising. In contrast to existing methods, our framework does not need to recollect massive data when adapted to another camera model, which significantly reduces the efforts required to fine-tune our approach for practical usage. Through extensive experiments, we demonstrate its great potential in real-world low-light imaging applications.
由于通过相对较小的光圈进入的入射光不足,移动设备上的低光成像通常具有挑战性,导致图像质量较低。以前大多数关于低光成像的工作要么只专注于单一任务,如光照调整、颜色增强或去噪;要么专注于联合光照调整和去噪任务,该任务严重依赖于特定相机型号的短-长曝光图像对。在需要特定相机联合增强和恢复的实际场景中,这些方法不太实用且难以推广。在本文中,我们提出了一个低光成像框架,该框架执行联合光照调整、颜色增强和去噪来解决这个问题。考虑到特定模型数据收集的困难以及捕获图像的超高分辨率,我们设计了两个分支:系数估计分支和联合操作分支。系数估计分支在低分辨率空间中工作,并通过双边学习预测增强系数,而联合操作分支在全分辨率空间中工作,并逐步执行联合增强和去噪。与现有方法相比,我们的框架在适应另一种相机型号时无需重新收集大量数据,这显著减少了为实际应用微调我们方法所需的工作量。通过大量实验,我们证明了其在实际低光成像应用中的巨大潜力。