National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
IEEE Trans Image Process. 2012 Jan;21(1):229-40. doi: 10.1109/TIP.2011.2160271. Epub 2011 Jun 27.
The challenges in local-feature-based image matching are variations of view and illumination. Many methods have been recently proposed to address these problems by using invariant feature detectors and distinctive descriptors. However, the matching performance is still unstable and inaccurate, particularly when large variation in view or illumination occurs. In this paper, we propose a view and illumination invariant image-matching method. We iteratively estimate the relationship of the relative view and illumination of the images, transform the view of one image to the other, and normalize their illumination for accurate matching. Our method does not aim to increase the invariance of the detector but to improve the accuracy, stability, and reliability of the matching results. The performance of matching is significantly improved and is not affected by the changes of view and illumination in a valid range. The proposed method would fail when the initial view and illumination method fails, which gives us a new sight to evaluate the traditional detectors. We propose two novel indicators for detector evaluation, namely, valid angle and valid illumination, which reflect the maximum allowable change in view and illumination, respectively. Extensive experimental results show that our method improves the traditional detector significantly, even in large variations, and the two indicators are much more distinctive.
基于局部特征的图像匹配面临视角和光照变化的挑战。最近,许多方法已经被提出,通过使用不变特征检测器和独特描述符来解决这些问题。然而,匹配性能仍然不稳定和不准确,特别是当视角或光照发生较大变化时。在本文中,我们提出了一种视角和光照不变的图像匹配方法。我们迭代地估计图像的相对视角和光照关系,将一幅图像的视角转换到另一幅图像,并对其光照进行归一化,以实现准确匹配。我们的方法不是旨在增加探测器的不变性,而是提高匹配结果的准确性、稳定性和可靠性。匹配性能得到了显著提高,并且不受有效范围内视角和光照变化的影响。当初始视角和光照方法失败时,所提出的方法会失败,这为我们评估传统探测器提供了一个新的视角。我们提出了两个用于检测器评估的新指标,即有效角度和有效光照,它们分别反映了视角和光照允许的最大变化。广泛的实验结果表明,我们的方法显著提高了传统探测器的性能,即使在较大的变化下,而且这两个指标也更加明显。