Performance Characterization of Image Feature Detectors in Relation to the Scene Content Utilizing a Large Image Database

Selecting the most suitable local invariant feature detector for a particular application has rendered the task of evaluating feature detectors a critical issue in vision research. Although the literature, offers a variety of comparison works focusing on performance evaluation of image feature detectors under several types of image transformations, the influence of the scene content on the performance of local feature detectors has received little attention so far. This paper, aims to bridge this gap with a new framework for determining the type of scenes which maximize and minimize the performance of detectors in terms of repeatability rate. The results are presented for several state-of-the-art feature detectors that have been obtained using a large image database of 20482 images under JPEG compression, uniform light and blur changes with 539 different scenes captured from real-world scenarios. These results provide new insights into the behavior of feature detectors.

[1]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[2]  Klaus D. McDonald-Maier,et al.  Measuring the Coverage of Interest Point Detectors , 2011, ICIAR.

[3]  Klaus D. McDonald-Maier,et al.  Performance comparison of image feature detectors utilizing a large number of scenes , 2016, J. Electronic Imaging.

[4]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[5]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[6]  Wolfgang Förstner,et al.  Detecting interpretable and accurate scale-invariant keypoints , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[8]  Ales Leonardis,et al.  Automatic Selection of the Optimal Local Feature Detector , 2016, ICIAR.

[9]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Andrew Zisserman,et al.  An Affine Invariant Salient Region Detector , 2004, ECCV.

[11]  Dmitry B. Goldgof,et al.  An Objective Comparison Methodology of Edge Detection Algorithms Using a Structure from Motion Task , 1998, CVPR.

[12]  Wolfgang Förstner,et al.  Coding Images with Local Features , 2010, International Journal of Computer Vision.

[13]  Luc Van Gool,et al.  Content-Based Image Retrieval Based on Local Affinely Invariant Regions , 1999, VISUAL.

[14]  Klaus D. McDonald-Maier,et al.  Improved repeatability measures for evaluating performance of feature detectors , 2015, ArXiv.

[15]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[16]  H. Bischof,et al.  Evaluation of local detectors on non-planar scenes , 2004 .

[17]  David Suter,et al.  Assessing the performance of corner detectors for point feature tracking applications , 2004, Image Vis. Comput..

[18]  Ales Leonardis,et al.  A Generic Framework for Assessing the Performance Bounds of Image Feature Detectors , 2016, Remote. Sens..

[19]  Klaus D. McDonald-Maier,et al.  Rapid Online Analysis of Local Feature Detectors and Their Complementarity , 2013, Sensors.

[20]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[21]  Klaus D. McDonald-Maier,et al.  Performance characterization of image feature detectors in relation to the scene content utilizing a large image database , 2015, IWSSIP.

[22]  Henrik Aanæs,et al.  Interesting Interest Points , 2011, International Journal of Computer Vision.

[23]  Horst Bischof,et al.  A novel performance evaluation method of local detectors on non-planar scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[24]  Kevin W. Bowyer,et al.  Comparison of Edge Detectors Using an Object Recognition Task , 1999, CVPR.