Finlayson Graham D
School of Computing Sciences, University of East Anglia, Norwich NR4 7TJ, UK.
Interface Focus. 2018 Aug 6;8(4):20180008. doi: 10.1098/rsfs.2018.0008. Epub 2018 Jun 15.
In computer vision, illumination is considered to be a problem that needs to be 'solved'. The colour cast due to illumination is removed to support colour-based image recognition and stable tracking (in and out of shadows), among other tasks. In this paper, I review historical and current algorithms for illumination estimation. In the classical approach, the illuminant colour is estimated by an ever more sophisticated analysis of simple image summary statistics often followed by a bias correction step. Bias correction is a function applied to the estimates made by a given illumination estimation algorithm to correct consistent errors in the estimations. Most recently, the full power, and much higher complexity, of deep learning has been deployed (where, effectively, the definition of the image statistics of interest and the type of analysis carried out are found as part of an overall optimization). In this paper, I challenge the orthodoxy of deep learning, i.e. that it is the best approach for illuminant estimation. We instead focus on the final bias correction stage found in many simple illumination estimation algorithms. There are two key insights in our method. First, we argue that the bias must be corrected in an exposure invariant way. Second, we show that this bias correction amounts to 'solving for a homography'. Homography-based illuminant estimation is shown to deliver leading illumination estimation performance (at a very small fraction of the complexity of deep learning methods).
在计算机视觉中,光照被视为一个需要“解决”的问题。为支持基于颜色的图像识别和稳定跟踪(包括阴影内外的跟踪)等任务,由光照引起的色偏会被去除。在本文中,我回顾了光照估计的历史和当前算法。在经典方法中,通过对简单图像汇总统计量进行越来越复杂的分析来估计光源颜色,通常随后会进行偏差校正步骤。偏差校正是一种应用于给定光照估计算法所做估计的函数,用于校正估计中的一致性误差。最近,深度学习的全部能力以及更高的复杂性已被应用(实际上,作为整体优化的一部分来确定感兴趣的图像统计量的定义和所进行的分析类型)。在本文中,我对深度学习的正统观念提出质疑,即它是光源估计的最佳方法。相反,我们关注许多简单光照估计算法中最终的偏差校正阶段。我们的方法有两个关键见解。首先,我们认为偏差必须以曝光不变的方式进行校正。其次,我们表明这种偏差校正相当于“求解单应性”。基于单应性的光源估计被证明能提供领先的光照估计性能(其复杂度仅为深度学习方法的极小一部分)。