Bellavia Fabio
IEEE Trans Pattern Anal Mach Intell. 2023 Feb;45(2):2445-2457. doi: 10.1109/TPAMI.2022.3161853. Epub 2023 Jan 6.
This paper investigates how to step up local image descriptor matching by exploiting matching context information. Two main contexts are identified, originated respectively from the descriptor space and from the keypoint space. The former is generally used to design the actual matching strategy while the latter to filter matches according to the local spatial consistency. On this basis, a new matching strategy and a novel local spatial filter, named respectively blob matching and Delaunay Triangulation Matching (DTM) are devised. Blob matching provides a general matching framework by merging together several strategies, including rank-based pre-filtering as well as many-to-many and symmetric matching, enabling to achieve a global improvement upon each individual strategy. DTM alternates between Delaunay triangulation contractions and expansions to figure out and adjust keypoint neighborhood consistency. Experimental evaluation shows that DTM is comparable or better than the state-of-the-art in terms of matching accuracy and robustness. Evaluation is carried out according to a new benchmark devised for analyzing the matching pipeline in terms of correct correspondences on both planar and non-planar scenes, including several state-of-the-art methods as well as the common SIFT matching approach for reference. This evaluation can be of assistance for future research in this field.
本文研究如何通过利用匹配上下文信息来加强局部图像描述符匹配。识别出了两种主要的上下文,分别源自描述符空间和关键点空间。前者通常用于设计实际的匹配策略,而后者用于根据局部空间一致性过滤匹配项。在此基础上,设计了一种新的匹配策略和一种新颖的局部空间滤波器,分别称为斑点匹配和德劳内三角剖分匹配(DTM)。斑点匹配通过合并多种策略提供了一个通用的匹配框架,包括基于秩的预过滤以及多对多和对称匹配,从而能够在每个单独策略的基础上实现全局改进。DTM在德劳内三角剖分的收缩和扩展之间交替,以找出并调整关键点邻域的一致性。实验评估表明,在匹配准确性和鲁棒性方面,DTM与现有技术相当或更优。评估是根据一个新的基准进行的,该基准旨在从平面和非平面场景上的正确对应关系方面分析匹配流程,包括几种现有技术方法以及常见的SIFT匹配方法以供参考。该评估可为该领域的未来研究提供帮助。