Fully automatic face recognition framework based on local and global features

Face recognition algorithms can be divided into two categories: holistic and local feature-based approaches. Holistic methods are very popular in recent years due to their good performance and high efficiency. However, they depend on careful positioning of the face images into the same canonical pose, which is not an easy task. On the contrary, some local feature-based approaches can achieve good recognition performances without additional alignment. But their computational burden is much heavier than holistic approaches. To solve these problems in holistic and local feature-based approaches, we propose a fully automatic face recognition framework based on both the local and global features. In this work, we propose to align the input face images using multi-scale local features for the holistic approach, which serves as a filter to narrow down the database for further fine matching. The computationally heavy local feature-based approach is then applied on the narrowed database. This fully automatic framework not only speeds up the local feature-based approach, but also improves the recognition accuracy comparing with the holistic and local approaches as shown in the experiments.

[1]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Mohan M. Trivedi,et al.  A Binary Tree for Probability Learning in Eye Detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[3]  Xudong Jiang,et al.  Linear Subspace Learning-Based Dimensionality Reduction , 2011, IEEE Signal Processing Magazine.

[4]  Yen-Wei Chen,et al.  A Robust Eye Detection and Tracking Technique Using Gabor Filters , 2007, Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2007).

[5]  Xudong Jiang,et al.  Fast eye localization based on pixel differences , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[6]  Shuicheng Yan,et al.  Multi-view face alignment using direct appearance models , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[7]  Erik G. Learned-Miller,et al.  Unsupervised Joint Alignment of Complex Images , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[9]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[10]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[11]  Maria Asunción Vicente,et al.  Face recognition using multiple interest point detectors and SIFT descriptors , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[12]  Hakan Cevikalp,et al.  Discriminative common vectors for face recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Gang Hua,et al.  Discriminant Embedding for Local Image Descriptors , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  Cong Geng,et al.  Face recognition based on the multi-scale local image structures , 2011, Pattern Recognit..

[15]  Kiyoung Moon,et al.  Real-Time Face Verification for Mobile Platforms , 2008, ISVC.

[16]  Luis Enrique Sucar,et al.  Real-time face recognition for human-robot interaction , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[17]  Xiaoou Tang,et al.  Fast Algorithm for Updating the Discriminant Vectors of Dual-Space LDA , 2009, IEEE Transactions on Information Forensics and Security.

[18]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Christophe Rosenberger,et al.  Similarity-based matching for face authentication , 2008, 2008 19th International Conference on Pattern Recognition.

[20]  Massimo Tistarelli,et al.  Face recognition by fusion of local and global matching scores using DS theory: An evaluation with uni-classifier and multi-classifier paradigm , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[21]  Cong Geng,et al.  SIFT features for face recognition , 2009, 2009 2nd IEEE International Conference on Computer Science and Information Technology.

[22]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[23]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[24]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[25]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[26]  Yunhui Liu,et al.  An Efficient Face Normalization Algorithm Based on Eyes Detection , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Jian Yang,et al.  KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Xudong Jiang,et al.  Eigenfeature Regularization and Extraction in Face Recognition , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Xudong Jiang,et al.  Asymmetric Principal Component and Discriminant Analyses for Pattern Classification , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Yee Whye Teh,et al.  Names and faces in the news , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[31]  Cong Geng,et al.  Face recognition using sift features , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[32]  Matti Pietikäinen,et al.  Face and Eye Detection for Person Authentication in Mobile Phones , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[33]  Ara V. Nefian,et al.  Embedded Bayesian networks for face recognition , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[34]  Daw-Tung Lin,et al.  Real-time eye detection using face-circle fitting and dark-pixel filtering , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[35]  Andrew Zisserman,et al.  Hello! My name is... Buffy'' -- Automatic Naming of Characters in TV Video , 2006, BMVC.

[36]  Timothy F. Cootes,et al.  Advances in active appearance models , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[37]  Jieping Ye,et al.  An optimization criterion for generalized discriminant analysis on undersampled problems , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Xiaogang Wang,et al.  A unified framework for subspace face recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Young Shik Moon,et al.  An Effective Method for Eye Detection Based on Texture Information , 2007, 2007 International Conference on Convergence Information Technology (ICCIT 2007).

[40]  Harry Shum,et al.  A Bayesian mixture model for multi-view face alignment , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  Xudong Jiang,et al.  A fast and accurate cascade subspace face/eye detector on mobile devices , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[42]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Wesley De Neve,et al.  Collaborative Face Recognition for Improved Face Annotation in Personal Photo Collections Shared on Online Social Networks , 2011, IEEE Transactions on Multimedia.

[44]  Shree K. Nayar,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Describable Visual Attributes for Face Verification and Image Search , 2022 .

[45]  Tiziana D'Orazio,et al.  An algorithm for real time eye detection in face images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[46]  LindebergTony Feature Detection with Automatic Scale Selection , 1998 .

[47]  Yi Zhou,et al.  Bayesian tangent shape model: estimating shape and pose parameters via Bayesian inference , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[48]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[49]  Erica Klarreich,et al.  Hello, my name is… , 2014, CACM.

[50]  Jun Luo,et al.  Person-Specific SIFT Features for Face Recognition , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[51]  Hedvig Kjellström,et al.  IEEE International Conference on Automatic Face and Gesture Recognition , 2013 .

[52]  Andrea Lagorio,et al.  On the Use of SIFT Features for Face Authentication , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[53]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[54]  Shyan-Ming Yuan,et al.  Next Generation Notification System Integrating Instant Messengers and Web Service , 2007, 2007 International Conference on Convergence Information Technology (ICCIT 2007).

[55]  Jianfeng Ren,et al.  Eye detection based on rank order filter , 2009, 2009 7th International Conference on Information, Communications and Signal Processing (ICICS).

[56]  Gang Hua,et al.  Discriminative Learning of Local Image Descriptors , 1990, IEEE Transactions on Pattern Analysis and Machine Intelligence.