Gao Shao-Bing, Zhang Ming, Li Chao-Yi, Li Yong-Jie
J Opt Soc Am A Opt Image Sci Vis. 2017 Aug 1;34(8):1448-1462. doi: 10.1364/JOSAA.34.001448.
It is an ill-posed problem to recover the true scene colors from a color biased image by discounting the effects of scene illuminant and camera spectral sensitivity (CSS) at the same time. Most color constancy (CC) models have been designed to first estimate the illuminant color, which is then removed from the color biased image to obtain an image taken under white light, without the explicit consideration of CSS effect on CC. This paper first studies the CSS effect on illuminant estimation arising in the inter-dataset-based CC (inter-CC), i.e., training a CC model on one dataset and then testing on another dataset captured by a distinct CSS. We show the clear degradation of existing CC models for inter-CC application. Then a simple way is proposed to overcome such degradation by first learning quickly a transform matrix between the two distinct CSSs (CSS-1 and CSS-2). The learned matrix is then used to convert the data (including the illuminant ground truth and the color-biased images) rendered under CSS-1 into CSS-2, and then train and apply the CC model on the color-biased images under CSS-2 without the need of burdensome acquiring of the training set under CSS-2. Extensive experiments on synthetic and real images show that our method can clearly improve the inter-CC performance for traditional CC algorithms. We suggest that, by taking the CSS effect into account, it is more likely to obtain the truly color constant images invariant to the changes of both illuminant and camera sensors.
通过同时消除场景光源和相机光谱灵敏度(CSS)的影响,从颜色偏差图像中恢复真实场景颜色是一个不适定问题。大多数颜色恒常性(CC)模型被设计为首先估计光源颜色,然后从颜色偏差图像中去除该颜色,以获得在白光下拍摄的图像,而没有明确考虑CSS对CC的影响。本文首先研究了基于跨数据集的CC(跨CC)中出现的CSS对光源估计的影响,即在一个数据集上训练CC模型,然后在由不同CSS捕获的另一个数据集上进行测试。我们展示了现有CC模型在跨CC应用中的明显退化。然后提出了一种简单的方法来克服这种退化,即首先快速学习两个不同CSS(CSS-1和CSS-2)之间的变换矩阵。然后使用学习到的矩阵将在CSS-1下渲染的数据(包括光源真值和颜色偏差图像)转换为CSS-2,然后在CSS-2下的颜色偏差图像上训练和应用CC模型,而无需繁琐地获取CSS-2下的训练集。在合成图像和真实图像上进行的大量实验表明,我们的方法可以显著提高传统CC算法的跨CC性能。我们认为,通过考虑CSS的影响,更有可能获得对光源和相机传感器变化均不变的真正颜色恒常图像。