IEEE Trans Pattern Anal Mach Intell. 2018 Sep;40(9):2081-2094. doi: 10.1109/TPAMI.2017.2753239. Epub 2017 Sep 18.
The problem of removing illuminant variations to preserve the colours of objects (colour constancy) has already been solved by the human brain using mechanisms that rely largely on centre-surround computations of local contrast. In this paper we adopt some of these biological solutions described by long known physiological findings into a simple, fully automatic, functional model (termed Adaptive Surround Modulation or ASM). In ASM, the size of a visual neuron's receptive field (RF) as well as the relationship with its surround varies according to the local contrast within the stimulus, which in turn determines the nature of the centre-surround normalisation of cortical neurons higher up in the processing chain. We modelled colour constancy by means of two overlapping asymmetric Gaussian kernels whose sizes are adapted based on the contrast of the surround pixels, resembling the change of RF size. We simulated the contrast-dependent surround modulation by weighting the contribution of each Gaussian according to the centre-surround contrast. In the end, we obtained an estimation of the illuminant from the set of the most activated RFs' outputs. Our results on three single-illuminant and one multi-illuminant benchmark datasets show that ASM is highly competitive against the state-of-the-art and it even outperforms learning-based algorithms in one case. Moreover, the robustness of our model is more tangible if we consider that our results were obtained using the same parameters for all datasets, that is, mimicking how the human visual system operates. These results suggest a dynamical adaptation mechanisms contribute to achieving higher accuracy in computational colour constancy.
去除照明变化以保留物体颜色(颜色恒常性)的问题已经被人类大脑通过主要依赖于局部对比度的中心-周围计算的机制解决了。在本文中,我们将一些已经被长期生理学发现描述的生物学解决方案采用到一个简单的、全自动的、功能模型中(称为自适应环绕调制或 ASM)。在 ASM 中,视觉神经元的感受野(RF)的大小及其与周围环境的关系根据刺激中的局部对比度而变化,这反过来又决定了处理链中更高层次的皮质神经元的中心-周围归一化的性质。我们通过两个重叠的不对称高斯核来模拟颜色恒常性,其大小根据周围像素的对比度进行调整,类似于 RF 大小的变化。我们通过根据中心-周围对比度为每个高斯加权来模拟对比度依赖的环绕调制。最后,我们从最活跃的 RF 输出集合中估计出光源。我们在三个单光源和一个多光源基准数据集上的结果表明,ASM 与最先进的方法相比具有很高的竞争力,在一种情况下甚至优于基于学习的算法。此外,如果我们考虑到我们的结果是使用所有数据集的相同参数获得的,即模拟人类视觉系统的工作方式,那么我们模型的鲁棒性就更加明显。这些结果表明,动态适应机制有助于在计算颜色恒常性中实现更高的准确性。