Performance Analysis of Various Feature Detector and Descriptor for Real-Time Video based Face Tracking

This paper presents the performance analysis of various contemporary feature detector and descriptor pair for real time face tracking. These feature detectors/descriptors are mostly used in image matching applications. Some feature detectors/descriptors like STAR, FAST, BRIEF, FREAK, and ORB can also be used for SLAM applications due to their high performance. However using only one of these feature detectors for object tracking may not provide good accuracy due to various challenges in tracking like abrupt change in object motion, non-rigid object structure, change in appearance of object, occlusions in the scene and camera motion. But it can be combined other object tracking algorithm to improve the overall tracking accuracy. In this paper we have measured the tracking speed and accuracy of these feature detectors in real time video for face tracking using parameters like average number of detected key points, average detection time of key-point, frame per second and number of matches using OpenCV. General Terms Object tracking, Image matching.

[1]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Kurt Konolige,et al.  CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching , 2008, ECCV.

[3]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Óscar Martínez Mozos,et al.  Local descriptors for visual SLAM , 2007 .

[5]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[6]  Adam Schmidt,et al.  The Visual SLAM System for a Hexapod Robot , 2010, ICCVG.

[7]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[8]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[9]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[10]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[11]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[12]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Darius Burschka,et al.  Adaptive and Generic Corner Detection Based on the Accelerated Segment Test , 2010, ECCV.

[14]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Óscar Martínez Mozos,et al.  Interest Point Detectors for Visual SLAM , 2007, CAEPIA.