Robust face recognition against expressions and partial occlusions

Facial features under variant-expressions and partial occlusions could have degrading effect on overall face recognition performance. As a solution, we suggest that the contribution of these features on final classification should be determined. In order to represent facial features’ contribution according to their variations, we propose a feature selection process that describes facial features as local independent component analysis (ICA) features. These local features are acquired using locally lateral subspace (LLS) strategy. Then, through linear discriminant analysis (LDA) we investigate the intraclass and interclass representation of each local ICA feature and express each feature’s contribution via a weighting process. Using these weights, we define the contribution of each feature at local classifier level. In order to recognize faces under single sample constraint, we implement LLS strategy on locally linear embedding (LLE) along with the proposed feature selection. Additionally, we highlight the efficiency of the implementation of LLS strategy. The overall accuracy achieved by our approach on datasets with different facial expressions and partial occlusions such as AR, JAFFE, FERET and CK+ is 90.70%. We present together in this paper survey results on face recognition performance and physiological feature selection performed by human subjects.

[1]  Barbara Caputo,et al.  Recognition with local features: the kernel recipe , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[3]  Yong-Zhong Lu,et al.  A novel face recognition algorithm for distinguishing faces with various angles , 2008, Int. J. Autom. Comput..

[4]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[6]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[7]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[8]  A. Young,et al.  Configurational Information in Face Perception , 1987, Perception.

[9]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[10]  Mingyu Lu,et al.  Double-layer bayesian classifier ensembles based on frequent itemsets , 2012, Int. J. Autom. Comput..

[11]  Daijin Kim,et al.  Face recognition using the embedded HMM with second-order block-specific observations , 2003, Pattern Recognit..

[12]  J. Tanaka,et al.  Features and their configuration in face recognition , 1997, Memory & cognition.

[13]  Ruiping Wang,et al.  Manifold Discriminant Analysis , 2009, CVPR.

[14]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[15]  A. Young,et al.  Face perception after brain injury. Selective impairments affecting identity and expression. , 1993, Brain : a journal of neurology.

[16]  Jean-Yves Baudouin,et al.  When the smile is a cue to familiarity , 2000, Memory.

[17]  C. Wallraven,et al.  Processing of facial identity and expression: a psychophysical, physiological, and computational perspective. , 2006, Progress in brain research.

[18]  Weilin Huang,et al.  Nonlinear Dimensionality Reduction for Face Recognition , 2009, IDEAL.

[19]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[20]  J Kurucz,et al.  Prosopo‐Affective Agnosia as a Symptom of Cerebral Organic Disease , 1979, Journal of the American Geriatrics Society.

[21]  Zhi-Hua Zhou,et al.  Face Recognition Under Occlusions and Variant Expressions With Partial Similarity , 2009, IEEE Transactions on Information Forensics and Security.

[22]  A. Damasio,et al.  Intact recognition of facial expression, gender, and age in patients with impaired recognition of face identity , 1988, Neurology.

[23]  P. Sinha,et al.  The Role of Eyebrows in Face Recognition , 2003, Perception.

[24]  S. Schweinberger,et al.  Expression Influences the Recognition of Familiar Faces , 2004, Perception.

[25]  R. Dolan,et al.  fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. , 2004, Journal of neurophysiology.

[26]  Aleix M. Martínez,et al.  Recognizing expression variant faces from a single sample image per class , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[27]  A. Martínez,et al.  The AR face databasae , 1998 .

[28]  Wen Gao,et al.  Hierarchical Ensemble of Global and Local Classifiers for Face Recognition , 2009, IEEE Trans. Image Process..

[29]  Young-Seuk Park,et al.  Self-Organizing Map , 2008 .

[30]  Lan Wang,et al.  Face recognition based on PCA image reconstruction and LDA , 2013 .

[31]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[32]  Tomaso A. Poggio,et al.  Face recognition: component-based versus global approaches , 2003, Comput. Vis. Image Underst..

[33]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Wen Gao,et al.  Manifold-Manifold Distance with application to face recognition based on image set , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[37]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[38]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Pawan Sinha,et al.  Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About , 2006, Proceedings of the IEEE.

[40]  Andrew R. Webb,et al.  Statistical Pattern Recognition , 1999 .

[41]  Aleix M. Martinez.  Matching expression variant faces , 2003, Vision Research.

[42]  T. Poggio,et al.  Recognition and Structure from one 2D Model View: Observations on Prototypes, Object Classes and Symmetries , 1992 .

[43]  Javier Ruiz-del-Solar,et al.  Recognition of Faces in Unconstrained Environments: A Comparative Study , 2009, EURASIP J. Adv. Signal Process..

[44]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[45]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[47]  Sang Uk Lee,et al.  Face recognition using face-ARG matching , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Zhi-Hua Zhou,et al.  Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft k-NN ensemble , 2005, IEEE Transactions on Neural Networks.

[49]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[50]  A. Young,et al.  Understanding the recognition of facial identity and facial expression , 2005, Nature Reviews Neuroscience.

[51]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[52]  David Zhang,et al.  Combination of two novel LDA-based methods for face recognition , 2007, Neurocomputing.

[53]  Xiao-Mei Xu,et al.  An optimization criterion for generalized marginal Fisher analysis on undersampled problems , 2011, Int. J. Autom. Comput..

[54]  A. Johnston,et al.  Categorizing sex and identity from the biological motion of faces , 2001, Current Biology.

[55]  Takeo Kanade,et al.  Multi-subregion based probabilistic approach toward pose-invariant face recognition , 2003, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).

[56]  Gang Wang,et al.  Discriminative multi-manifold analysis for face recognition from a single training sample per person , 2011, 2011 International Conference on Computer Vision.

[57]  Jun Guo,et al.  Extended SRC: Undersampled Face Recognition via Intraclass Variant Dictionary , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[58]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[59]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  A. Young,et al.  In the Eye of the Beholder: The Science of Face Perception , 1998 .

[61]  H. Ellis,et al.  Identification of Familiar and Unfamiliar Faces from Internal and External Features: Some Implications for Theories of Face Recognition , 1979, Perception.

[62]  Aleix M. Mart ´ õnez.  Recognizing Expression Variant Faces from a Single Sample Image per Class , 2003 .

[63]  Ramón Alberto Mollineda,et al.  The Role of Face Parts in Gender Recognition , 2008, ICIAR.

[64]  A. Young,et al.  Understanding face recognition. , 1986, British journal of psychology.

[65]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[66]  Hyun-Chul Kim,et al.  Face recognition using LDA mixture model , 2003, Pattern Recognit. Lett..

[67]  Daphna Weinshall,et al.  Classification with Nonmetric Distances: Image Retrieval and Class Representation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[69]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[70]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[71]  Zhi-Hua Zhou,et al.  Face recognition from a single image per person: A survey , 2006, Pattern Recognit..

[72]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[73]  Jeanny Hérault,et al.  Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets , 1997, IEEE Trans. Neural Networks.