Face recognition based on the multi-scale local image structures

This paper proposes a framework of face recognition based on the multi-scale local structures of the face image. While some basic tools in this framework are inherited from the SIFT algorithm, this work investigates and contributes to all major steps in the feature extraction and image matching. New approaches to keypoint detection, partial descriptor and insignificant keypoint removal are proposed specifically for human face images, a type of non-rigid and smooth visual objects. A strategy of keypoint search for the nearest subject and a two-stage image matching scheme are developed for the face identification task. They circumvent the problem that local structures matched with those in probe disperse into many different gallery images. Although the proposed framework can work for single template per subject, a training procedure is developed for multiple samples per subject. It contains template selection, unstable keypoint removal and template synthesis to meet different requirements in face recognition applications. Each ingredient of the proposed framework is experimentally validated and compared with its counterpart in the SIFT scheme. Results show that the proposed framework outperforms SIFT and some holistic approaches to face recognition.

[1]  Jian Yang,et al.  KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Sharath Pankanti,et al.  The relation between the ROC curve and the CMC , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[3]  Gang Hua,et al.  Discriminant Embedding for Local Image Descriptors , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[5]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[6]  Xudong Jiang,et al.  Asymmetric Principal Component and Discriminant Analyses for Pattern Classification , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Cong Geng,et al.  Face recognition using sift features , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[8]  Enrico Grosso,et al.  Face Identification by SIFT-based Complete Graph Topology , 2007, 2007 IEEE Workshop on Automatic Identification Advanced Technologies.

[9]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[10]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  David G. Lowe,et al.  Local feature view clustering for 3D object recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Alex Pentland,et al.  Bayesian face recognition , 2000, Pattern Recognit..

[14]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Gang Hua,et al.  Implicit elastic matching with random projections for pose-variant face recognition , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[17]  Gang Hua,et al.  Implicit elastic matching with random projections for pose-variant face recognition , 2009, CVPR.

[18]  Dahua Lin,et al.  Recognize High Resolution Faces: From Macrocosm to Microcosm , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Christophe Rosenberger,et al.  Similarity-based matching for face authentication , 2008, 2008 19th International Conference on Pattern Recognition.

[20]  Jieping Ye,et al.  Generalized Linear Discriminant Analysis: A Unified Framework and Efficient Model Selection , 2008, IEEE Transactions on Neural Networks.

[21]  Jieping Ye,et al.  An optimization criterion for generalized discriminant analysis on undersampled problems , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Xiaogang Wang,et al.  A unified framework for subspace face recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[24]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[25]  Xudong Jiang,et al.  Linear Subspace Learning-Based Dimensionality Reduction , 2011, IEEE Signal Processing Magazine.

[26]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[27]  Xiaoou Tang,et al.  Fast Algorithm for Updating the Discriminant Vectors of Dual-Space LDA , 2009, IEEE Transactions on Information Forensics and Security.

[28]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[30]  Massimo Tistarelli,et al.  Face recognition by fusion of local and global matching scores using DS theory: An evaluation with uni-classifier and multi-classifier paradigm , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[31]  Rabab Kreidieh Ward,et al.  Discriminative SIFT features for face recognition , 2009, 2009 Canadian Conference on Electrical and Computer Engineering.

[32]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[34]  Luis Enrique Sucar,et al.  Real-time face recognition for human-robot interaction , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[35]  Cong Geng,et al.  SIFT features for face recognition , 2009, 2009 2nd IEEE International Conference on Computer Science and Information Technology.

[36]  Andrea Lagorio,et al.  On the Use of SIFT Features for Face Authentication , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[37]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[38]  Maria Asunción Vicente,et al.  Face recognition using multiple interest point detectors and SIFT descriptors , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[39]  Hakan Cevikalp,et al.  Discriminative common vectors for face recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[41]  Konstantinos N. Plataniotis,et al.  Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition , 2005, Pattern Recognit. Lett..

[42]  Zhi-Hua Zhou,et al.  Face recognition from a single image per person: A survey , 2006, Pattern Recognit..

[43]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Yin Jianqin,et al.  Human Face Feature Extraction and Recognition Base on SIFT , 2008, 2008 International Symposium on Computer Science and Computational Technology.

[45]  Massimo Tistarelli,et al.  Graph application on face for personal authentication and recognition , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[46]  Gang Hua,et al.  Discriminative Learning of Local Image Descriptors , 1990, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Yue Lu,et al.  Face Recognition Using Scale Invariant Feature Transform and Support Vector Machine , 2008, 2008 The 9th International Conference for Young Computer Scientists.

[49]  Xudong Jiang,et al.  Eigenfeature Regularization and Extraction in Face Recognition , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.