Analysis and Evaluation of Keypoint Descriptors for Image Matching

Feature keypoint descriptors have become indispensable tools and have been widely utilized in a large number of computer vision applications. Many descriptors have been proposed in the literature to describe regions of interest around each keypoint and each claims distinctiveness and robustness against certain types of image distortions. Among these are the conventional floating-point descriptors and their binary competitors that require less storage capacity and perform at a fraction of the matching times compared with the floating-point descriptors. This chapter gives a brief description to the most frequently used keypoint descriptors from each category. Also, it provides a general framework to analyze and evaluate the performance of these feature keypoint descriptors, particularly when they are used for image matching under various imaging distortions such as blur, scale and illumination changes, and image rotations. Moreover, it presents a detailed explanation and analysis of the experimental results and findings where several important observations are derived from the conducted experiments.

[1]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Abdelmgeid A. Ali,et al.  An Experimental Evaluation of Binary Feature Descriptors , 2017, AISI.

[3]  Matti Pietikäinen,et al.  Robust local features for remote face recognition , 2017, Image Vis. Comput..

[4]  Ali Ismail Awad,et al.  Image Feature Detectors and Descriptors , 2016 .

[5]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[6]  Mohammed Bennamoun,et al.  A Comprehensive Performance Evaluation of 3D Local Feature Descriptors , 2015, International Journal of Computer Vision.

[7]  Oguz Altun,et al.  An evaluation of local interest regions for non-rigid object class recognition , 2012, Expert Syst. Appl..

[8]  Tal Hassner,et al.  LATCH: Learned arrangements of three patch codes , 2015, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[9]  Ali Ismail Awad,et al.  Detection and Description of Image Features: An Introduction , 2016 .

[10]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[11]  Q. M. Jonathan Wu,et al.  A comparative experimental study of image feature detectors and descriptors , 2015, Machine Vision and Applications.

[12]  Mahmoud Hassaballah,et al.  Face recognition: challenges, achievements and future directions , 2015, IET Comput. Vis..

[13]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[14]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Miroslaw Bober,et al.  Fast, Compact, and Discriminative: Evaluation of Binary Descriptors for Mobile Applications , 2017, IEEE Transactions on Multimedia.

[16]  Michael Teutsch,et al.  Evaluation of binary keypoint descriptors , 2013, 2013 IEEE International Conference on Image Processing.

[17]  Myo-Taeg Lim,et al.  MDGHM-SURF: A robust local image descriptor based on modified discrete Gaussian-Hermite moment , 2015, Pattern Recognit..

[18]  Atsuto Maki,et al.  An Evaluation of Local Feature Detectors and Descriptors for Infrared Images , 2016, ECCV Workshops.

[19]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Pengfeng Chen,et al.  LCO: A robust and efficient local descriptor for image matching , 2017 .

[21]  Tomasz Kornuta,et al.  Performance Evaluation of Binary Descriptors of Local Features , 2014, ICCVG.

[22]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[23]  Brendan McCane,et al.  Better than SIFT? , 2015, Machine Vision and Applications.

[24]  Hammam A. Alshazly,et al.  Image Features Detection, Description and Matching , 2016 .

[25]  Gye-Young Kim,et al.  Robust Estimation of Camera Homography Using Fuzzy RANSAC , 2007, ICCSA.

[26]  Loris Nanni,et al.  Handcrafted vs. non-handcrafted features for computer vision classification , 2017, Pattern Recognit..

[27]  Darius Burschka,et al.  Adaptive and Generic Corner Detection Based on the Accelerated Segment Test , 2010, ECCV.

[28]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[29]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[30]  Erkan Bostanci,et al.  Evaluation Method, Dataset Size or Dataset Content: How to Evaluate Algorithms for Image Matching? , 2016, Journal of Mathematical Imaging and Vision.

[31]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[32]  Kamel Besbes,et al.  Comparison of local descriptors for automatic remote sensing image registration , 2015, Signal Image Video Process..

[33]  Krystian Mikolajczyk,et al.  Evaluation of local detectors and descriptors for fast feature matching , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[34]  Abdelmgeid A. Ali,et al.  Ear Biometric Recognition Using Gradient-Based Feature Descriptors , 2018, AISI.

[35]  Vincent Lepetit,et al.  BRIEF: Computing a Local Binary Descriptor Very Fast , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Beatriz Otero,et al.  SURF-based mammalian species identification system , 2016, Multimedia Tools and Applications.

[37]  Jan-Michael Frahm,et al.  Comparative Evaluation of Binary Features , 2012, ECCV.

[38]  Hongxun Yao,et al.  Nested-SIFT for Efficient Image Matching and Retrieval , 2013, IEEE MultiMedia.

[39]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[40]  Xin Yang,et al.  LDB: An ultra-fast feature for scalable Augmented Reality on mobile devices , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[41]  Pietro Perona,et al.  Evaluation of Features Detectors and Descriptors based on 3D Objects , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[42]  Jing Li,et al.  A comprehensive review of current local features for computer vision , 2008, Neurocomputing.

[43]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.