Isik Murat
Computer Engineering, Faculty of Engineering and Architecture, Kirsehir Ahi Evran University, Kirsehir, Turkey.
PeerJ Comput Sci. 2024 Nov 4;10:e2415. doi: 10.7717/peerj-cs.2415. eCollection 2024.
Feature detection and matching are fundamental components in computer vision, underpinning a broad spectrum of applications. This study offers a comprehensive evaluation of traditional feature detections and descriptors, analyzing methods such as Scale Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), Binary Robust Independent Elementary Features (BRIEF), Oriented FAST and Rotated BRIEF (ORB), Binary Robust Invariant Scalable Keypoints (BRISK), KAZE, Accelerated KAZE (AKAZE), Fast Retina Keypoint (FREAK), Dense and Accurate Invariant Scalable descriptor for Yale (DAISY), Features from Accelerated Segment Test (FAST), and STAR. Each feature extractor was assessed based on its architectural design and complexity, focusing on how these factors influence computational efficiency and robustness under various transformations. Utilizing the Image Matching Challenge Photo Tourism 2020 dataset, which includes over 1.5 million images, the study identifies the FAST algorithm as the most efficient detector when paired with the ORB descriptor and Brute-Force (BF) matcher, offering the fastest feature extraction and matching process. ORB is notably effective on affine-transformed and brightened images, while AKAZE excels in conditions involving blurring, fisheye distortion, image rotation, and perspective distortions. Through more than 2 million comparisons, the study highlights the feature extractors that demonstrate superior resilience across various conditions, including rotation, scaling, blurring, brightening, affine transformations, perspective distortions, fisheye distortion, and salt-and-pepper noise.
特征检测与匹配是计算机视觉的基本组成部分,支撑着广泛的应用。本研究对传统特征检测和描述符进行了全面评估,分析了诸如尺度不变特征变换(SIFT)、加速稳健特征(SURF)、二进制稳健独立基元特征(BRIEF)、定向FAST和旋转BRIEF(ORB)、二进制稳健不变可扩展关键点(BRISK)、KAZE、加速KAZE(AKAZE)、快速视网膜关键点(FREAK)、用于耶鲁的密集准确不变可扩展描述符(DAISY)、加速段测试特征(FAST)和STAR等方法。每个特征提取器都根据其架构设计和复杂度进行评估,重点关注这些因素如何在各种变换下影响计算效率和鲁棒性。利用包含超过150万张图像的2020年图像匹配挑战“照片旅游”数据集,该研究确定FAST算法与ORB描述符和暴力(BF)匹配器配合使用时是最有效的检测器,提供最快的特征提取和匹配过程。ORB在仿射变换和亮度增强的图像上特别有效,而AKAZE在涉及模糊、鱼眼失真、图像旋转和透视失真的条件下表现出色。通过超过200万次比较,该研究突出了在包括旋转、缩放、模糊、亮度增强、仿射变换、透视失真、鱼眼失真和椒盐噪声等各种条件下表现出卓越弹性的特征提取器。