A Sparse and Inlier Based SIFT and SURF Features for Automated Face Recognition

Face Recognition (FR) is a prolific form of biometric that has spawned a myriad of inventive applications for commercial and law-enforcement scenarios and has fostered several novel research directions. In the FR process, the choice of the feature extractor governs the overall efficiency and in that regard, SIFT and SURF are two prominent feature extraction mechanisms that are frequently employed due to their robustness with respect to scale, translation, illumination and rotation. Even though the SIFT and SURF descriptors are immensely effective, they are cluttered with redundant key-points and noise, which we aim to tackle by employing the Sparse Singular Value Decomposition (SSVD) method to perform Dimensionality Reduction, and RANSAC to remove noise in the form of outliers. In this paper, we will conclusively demonstrate by utilizing extensive mathematical arguments, and by performing exhaustive experimentations over the benchmark ORL and LFPW databases, that the proposed SIFT-SSVD-RANSAC and SURF-SSVD-RANSAC methodologies are more effective than their classical counterparts, as they are capable of handling extreme variations between the matched images in terms of scale, zoom, view-point and so on. The findings proffered by this work, coupled with our other studies, form a series intended to aid developers in making prudent decisions in order to build proficient FR systems.

[1]  Amnon Shashua,et al.  Learning a Metric Embedding for Face Recognition using the Multibatch Method , 2016, NIPS.

[2]  Andrea Marchetti,et al.  Optimal RANSAC-Towards a Repeatable Algorithm for Finding the Optimal Set , 2013, J. WSCG.

[3]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[4]  Hermann Ney,et al.  SURF-Face: Face Recognition Under Viewpoint Consistency Constraints , 2009, BMVC.

[5]  Anil K. Jain,et al.  Pushing the frontiers of unconstrained face detection and recognition: IARPA Janus Benchmark A , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[7]  Jianhua Z. Huang,et al.  Biclustering via Sparse Singular Value Decomposition , 2010, Biometrics.

[8]  Jean-Michel Morel,et al.  A fully affine invariant image comparison method , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  李建勋,et al.  Robust image matching based on SIFT and delaunay triangulation , 2012 .

[10]  Jongmoo Choi,et al.  Pooling Faces: Template Based Face Recognition with Pooled Face Images , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[11]  Haifeng Huang,et al.  Modified RANSAC for Sift-Based InSAR Image Registration , 2014 .

[12]  Jiri Matas,et al.  Feature-based affine-invariant localization of faces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  TaoDacheng,et al.  Multi-Directional Multi-Level Dual-Cross Patterns for Robust Face Recognition , 2016 .

[14]  Jianfang Dou,et al.  Robust image matching based on SIFT and delaunay triangulation , 2012 .

[15]  Rohitash Chandra,et al.  Design of a Mobile Face Recognition System for Visually Impaired Persons , 2015, ArXiv.

[16]  Binod Prasad,et al.  Feature Extraction using Sparse SVD for Biometric Fusion in Multimodal Authentication , 2013 .

[17]  Li Bai,et al.  Evaluation of visual tracking in extremely low frame rate wide area motion imagery , 2011, 14th International Conference on Information Fusion.

[18]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[19]  Marios Savvides,et al.  A preliminary investigation on the sensitivity of COTS face recognition systems to forensic analyst-style face processing for occlusions , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[20]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[21]  R. Sukthankar,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[22]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[23]  Xiangyang Xu,et al.  SIFT Feature Point Matching Based on Improved RANSAC Algorithm , 2013, 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[24]  Anil K. Jain,et al.  Bridging the gap: from biometrics to forensics , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  Libor Preucil,et al.  FPGA based Speeded Up Robust Features , 2009, 2009 IEEE International Conference on Technologies for Practical Robot Applications.

[26]  Jonghyun Choi,et al.  Multi-Directional Multi-Level Dual-Cross Patterns for Robust Face Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[28]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[29]  Rama Chellappa,et al.  Facial similarity across age, disguise, illumination and pose , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[30]  Martin Sill,et al.  Robust biclustering by sparse singular value decomposition incorporating stability selection , 2011, Bioinform..

[31]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[32]  Anil K. Jain,et al.  Unconstrained face recognition: Establishing baseline human performance via crowdsourcing , 2014, IEEE International Joint Conference on Biometrics.

[33]  Wang Wei,et al.  Image Matching for Geomorphic Measurement Based on SIFT and RANSAC Methods , 2008, 2008 International Conference on Computer Science and Software Engineering.

[34]  Haidawati Nasir,et al.  Image registration for super resolution using scale invariant feature transform, belief propagation and random sampling consensus , 2010, 2010 18th European Signal Processing Conference.

[35]  Francesca Odone,et al.  SVD-matching using SIFT features , 2006, Graph. Model..

[36]  Michele Nappi,et al.  FIRME: Face and Iris Recognition for Mobile Engagement , 2014, Image Vis. Comput..