2D Face Recognition

An overview of selected topics in face recognition is first presented in this chapter. The BioSecure 2D-face Benchmarking Framework is also described, composed of open-source software, publicly available databases and protocols. Three methods for 2D-face recognition, exploiting multiscale analysis, are presented. The first method exploits anisotropic smoothing, combined Gabor features and Linear Discriminant Analysis (LDA). The second approach is based on subject-specific face verification via Shape-Driven Gabor Jets (SDGJ), while the third combines Scale Invariant Feature Transform (SIFT) descriptors with graph matching.

[1]  Enrico Grosso,et al.  Face Identification by SIFT-based Complete Graph Topology , 2007, 2007 IEEE Workshop on Automatic Identification Advanced Technologies.

[2]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[3]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[4]  Oscar Déniz-Suárez,et al.  An Incremental Learning Algorithm for Face Recognition , 2002, Biometric Authentication.

[5]  Rogério Schmidt Feris,et al.  Hierarchical wavelet networks for facial feature localization , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[6]  Jean-Philippe Thiran,et al.  The BANCA Database and Evaluation Protocol , 2003, AVBPA.

[7]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[8]  Jun Zhang,et al.  Pace recognition: eigenface, elastic matching, and neural nets , 1997, Proc. IEEE.

[9]  Anastasios Tefas,et al.  Using Support Vector Machines to Enhance the Performance of Elastic Graph Matching for Frontal Face Authentication , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Takeshi Shakunaga,et al.  Integration of eigentemplate and structure matching for automatic facial feature detection , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[11]  Fabrizio Smeraldi,et al.  Retinal vision applied to facial features detection and face authentication , 2002, Pattern Recognit. Lett..

[12]  Volkan Atalay,et al.  Projection based method for segmentation of human face and its evaluation , 2002, Pattern Recognit. Lett..

[13]  Konstantinos N. Plataniotis,et al.  Face recognition using kernel direct discriminant analysis algorithms , 2003, IEEE Trans. Neural Networks.

[14]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  P. Yip,et al.  Discrete Cosine Transform: Algorithms, Advantages, Applications , 1990 .

[16]  Beat Fasel.  Multiscale Facial Expression Recognition Using Convolutional Neural Networks , 2002, ICVGIP.

[17]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[18]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Shiguang Shan,et al.  Face relighting for face recognition under generic illumination , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  Gulzar A. Khuwaja,et al.  An Adaptive Combined Classifier System for Invariant Face Recognition , 2002, Digit. Signal Process..

[21]  Simon M. Lucas,et al.  Continuous n-tuple classifier and its application to real-time face recognition , 1998 .

[22]  Luc Vandendorpe,et al.  Face authentication test on the BANCA database , 2004, ICPR 2004.

[23]  Fabio Roli,et al.  Multiple classifier systems : Third International Workshop, MCS 2002, Cagliari, Italy, June 24-26, 2002 : proceedings , 2002 .

[24]  Anastasios Tefas,et al.  Morphological elastic graph matching applied to frontal face authentication under optimal and real conditions , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[25]  Gunnar Rätsch,et al.  Invariant Feature Extraction and Classification in Kernel Spaces , 1999, NIPS.

[26]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[27]  Se-Young Oh,et al.  Automatic Extraction of Eye and Mouth Fields from a Face Image Using Eigenfeatures and Ensemble Networks , 2004, Applied Intelligence.

[28]  Yee-Hong Yang,et al.  Face recognition approach based on rank correlation of Gabor-filtered images , 2002, Pattern Recognit..

[29]  David J. Kriegman,et al.  Video-based face recognition using probabilistic appearance manifolds , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[30]  Anastasios Tefas,et al.  Face verification using elastic graph matching based on morphological signal decomposition , 2002, Signal Process..

[31]  Juyang Weng,et al.  An incremental learning method for face recognition under continuous video stream , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[32]  Timothy F. Cootes,et al.  A Multi-Stage Approach to Facial Feature Detection , 2004, BMVC.

[33]  Ian R. Fasel,et al.  A Comparison of Face Detection Algorithms , 2002, ICANN.

[34]  Frank Y. Shih,et al.  Automatic extraction of head and face boundaries and facial features , 2004, Inf. Sci..

[35]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[36]  Thomas Serre,et al.  Categorization by Learning and Combining Object Parts , 2001, NIPS.

[37]  Rama Chellappa,et al.  Probabilistic recognition of human faces from video , 2002, Proceedings. International Conference on Image Processing.

[38]  Paola Campadelli,et al.  A face recognition system based on automatically determined facial fiducial points , 2006, Pattern Recognit..

[39]  Jianping Fan,et al.  Towards facial feature extraction and verification for omni-face detection in video/images , 2002, Proceedings. International Conference on Image Processing.

[40]  Christoph von der Malsburg,et al.  Recognizing Faces by Dynamic Link Matching , 1996, NeuroImage.

[41]  Alice J. O'Toole,et al.  FRVT 2006 and ICE 2006 large-scale results , 2007 .

[42]  Hamid Krim,et al.  Facial feature extraction using topological methods , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[43]  Daniel González-Jiménez,et al.  Shape-Driven Gabor Jets for Face Description and Authentication , 2007, IEEE Transactions on Information Forensics and Security.

[44]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[45]  Maja Pantic,et al.  Fully automatic facial feature point detection using Gabor feature based boosted classifiers , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[46]  Shaogang Gong,et al.  Video-based online face recognition using identity surfaces , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[47]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[48]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[49]  Wen Gao,et al.  Face Recognition Under Varying Lighting Based on Derivates of Log Image , 2004, SINOBIOMETRICS.

[50]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[51]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Trevor Darrell,et al.  Face Recognition from Long-Term Observations , 2002, ECCV.

[53]  Sheng-De Wang,et al.  Fingerprint feature extraction using Gabor filters , 1999 .

[54]  Yves Grandvalet,et al.  Adaptive Scaling for Feature Selection in SVMs , 2002, NIPS.

[55]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Roberto Cipolla,et al.  Face Recognition from Face Motion Manifolds using Robust Kernel Resistor-Average Distance , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[57]  Hiroshi Murase,et al.  Unsupervised recognition of multi-view face sequences based on pairwise clustering with attraction and repulsion , 2003, Comput. Vis. Image Underst..

[58]  Joachim Denzler,et al.  Robust facial feature localization by coupled features , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[59]  Ioannis Pavlidis,et al.  Infrared and visible image fusion for face recognition , 2004, SPIE Defense + Commercial Sensing.

[60]  Bülent Sankur,et al.  Robust facial landmarking for registration , 2007, Ann. des Télécommunications.

[61]  Joachim M. Buhmann,et al.  Feature selection for support vector machines , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[62]  Jean-Philippe Thiran,et al.  Independent Component Analysis and Support Vector Machine for Face Feature Extraction , 2003, AVBPA.

[63]  Anil K. Jain,et al.  39 Dimensionality and sample size considerations in pattern recognition practice , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[64]  Patrick J. Flynn,et al.  Preliminary Face Recognition Grand Challenge Results , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[65]  Takeo Kanade,et al.  Evaluation of Gabor-wavelet-based facial action unit recognition in image sequences of increasing complexity , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[66]  Kin-Man Lam,et al.  An efficient algorithm for human face detection and facial feature extraction under different conditions , 2001 .

[67]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Rama Chellappa,et al.  Probabilistic identity characterization for face recognition , 2004, CVPR 2004.

[69]  Martin D. Levine,et al.  Face Recognition Using the Discrete Cosine Transform , 2001, International Journal of Computer Vision.

[70]  Pong C. Yuen,et al.  Robust facial feature point detection under nonlinear illuminations , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[71]  James L. Crowley,et al.  Facial features detection robust to pose, illumination and identity , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[72]  P. Jonathon Phillips,et al.  Evaluation Methods in Face Recognition , 2011, Handbook of Face Recognition.

[73]  John Daugman.  How iris recognition works , 2004 .

[74]  Shaogang Gong,et al.  Support vector regression and classification based multi-view face detection and recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[75]  Anil K. Jain,et al.  Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[76]  Rolf P. Würtz,et al.  Object Recognition Robust Under Translations, Deformations, and Changes in Background , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[77]  Dimitris N. Metaxas,et al.  A Hierarchical Framework For High Resolution Facial Expression Tracking , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[78]  Matthew Turk,et al.  A Random Walk through Eigenspace , 2001 .

[79]  Mohan M. Trivedi,et al.  Streaming face recognition using multicamera video arrays , 2002, Object recognition supported by user interaction for service robots.

[80]  Hilary Buxton,et al.  Towards unconstrained face recognition from image sequences , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[81]  Zehang Sun,et al.  Object detection using feature subset selection , 2004, Pattern Recognit..

[82]  Josef Kittler,et al.  Modelling and segmentation of lip area in face images , 2002 .

[83]  Joan Serrat,et al.  Evaluation of Methods for Ridge and Valley Detection , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[84]  Hiroshi Murase,et al.  Unsupervised face recognition from image sequences , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[85]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[86]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[87]  Norbert Krüger,et al.  An Algorithm for the Learning of Weights in Discrimination Functions Using a Priori Constraints , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[88]  Song Zhang,et al.  High-resolution, real-time 3D absolute coordinate measurement based on a phase-shifting method. , 2006, Optics express.

[89]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[90]  LinLin Shen,et al.  Gabor feature based face recognition using kernel methods , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[91]  Ralph Gross,et al.  An Image Preprocessing Algorithm for Illumination Invariant Face Recognition , 2003, AVBPA.

[92]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[93]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[94]  Rainer Herpers,et al.  Edge and keypoint detection in facial regions , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[95]  Chris Boehnen,et al.  A Fast Multi-Modal Approach to Facial Feature Detection , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[96]  Kostas Karpouzis,et al.  Robust Feature Detection for Facial Expression Recognition , 2007, EURASIP J. Image Video Process..

[97]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[98]  Shaogang Gong,et al.  Modelling faces dynamically across views and over time , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[99]  Eam Khwang Teoh,et al.  Bayesian shape model for facial feature extraction and recognition , 2003, Pattern Recognit..

[100]  Chengjun Liu,et al.  Independent component analysis of Gabor features for face recognition , 2003, IEEE Trans. Neural Networks.

[101]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[102]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[103]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[104]  Lei Zhang,et al.  3D shape constraint for facial feature localization using probabilistic-like output , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[105]  Hong Wei,et al.  Face Verification Using GaborWavelets and AdaBoost , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[106]  Patrick J. Flynn,et al.  An evaluation of multimodal 2D+3D face biometrics , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[107]  Ioannis Pitas,et al.  A Fully Automatic Approach to Facial Feature Detection and Tracking , 1997, AVBPA.

[108]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[109]  Chengjun Liu,et al.  Gabor-based kernel PCA with fractional power polynomial models for face recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[110]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[111]  Juyang Weng,et al.  Using Discriminant Eigenfeatures for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[112]  Simon M. Lucas,et al.  Sequence recognition with scanning N-tuple ensembles , 2004, ICPR 2004.

[113]  Ioannis Pitas,et al.  ICA and Gabor representation for facial expression recognition , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[114]  Anastasios Tefas,et al.  Frontal Face Authentication Using Discriminating Grids with Morphological Feature Vectors , 2000, IEEE Trans. Multim..

[115]  Weiwei Zhang,et al.  Illumination modeling and normalization for face recognition , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[116]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[117]  Konstantinos N. Plataniotis,et al.  Face recognition using LDA-based algorithms , 2003, IEEE Trans. Neural Networks.

[118]  Tsuhan Chen,et al.  Video-based face recognition using adaptive hidden Markov models , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[119]  Chengjun Liu,et al.  Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[120]  G. Cottrell,et al.  EMPATH: A Neural Network that Categorizes Facial Expressions , 2002, Journal of Cognitive Neuroscience.

[121]  Laurenz Wiskott.  Phantom Faces for Face Analysis , 1997, CAIP.