Subface hidden Markov models coupled with a universal occlusion model for partially occluded face recognition

In this study, a novel face recognition framework based on the grammatical face models has been proposed to tackle partial occlusion problem. The grammatical face model represents a face by five isolated ‘subface’, forehead, eyes, nose, mouth and chin models in cooperation with ‘occlusion’ models. With the creations of ‘subface’ and ‘occlusion’ models, the authors then define a facial grammar to manipulate ‘subface’ and ‘occlusion’ models for constructing various composite face models structurally. Furthermore, the authors also introduce a universal ‘occlusion’ model, which could handle general occlusions to improve the robustness and flexibility of grammatical face models. The proposed face recognition system could overcome two problems. One is to resolve the problem of face recognition with partial occlusions; the other is to overcome a challenge of training face models from occluded face images only. Experimental results carried out on AR facial database reveal that the proposed approach outperforms the state-of-the-art methods.

[1]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[2]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Hisham Othman,et al.  A Separable Low Complexity 2D HMM with Application to Face Recognition , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Samy Bengio,et al.  User authentication via adapted statistical models of face images , 2006, IEEE Transactions on Signal Processing.

[5]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Qian Chen,et al.  Image enhancement based on equal area dualistic sub-image histogram equalization method , 1999, IEEE Trans. Consumer Electron..

[7]  Kazuhiro Hotta.  Robust face recognition under partial occlusion based on support vector machine with local Gaussian summation kernel , 2008, Image Vis. Comput..

[8]  Zhi-Hua Zhou,et al.  Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft k-NN ensemble , 2005, IEEE Transactions on Neural Networks.

[9]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[10]  David Zhang,et al.  A face and palmprint recognition approach based on discriminant DCT feature extraction , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Sébastien Marcel,et al.  Local binary patterns as an image preprocessing for face authentication , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[12]  Aleix M. Martínez,et al.  A weighted probabilistic approach to face recognition from multiple images and video sequences , 2006, Image Vis. Comput..

[13]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[14]  Zhi-Hua Zhou,et al.  Face Recognition Under Occlusions and Variant Expressions With Partial Similarity , 2009, IEEE Transactions on Information Forensics and Security.

[15]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[16]  Chih-Pin Liao,et al.  Maximum Confidence Hidden Markov Modeling for Face Recognition , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Hongjun Jia,et al.  Support Vector Machines in face recognition with occlusions , 2009, CVPR.

[18]  Sharath Pankanti,et al.  BIOMETRIC IDENTIFICATION , 2000 .

[19]  Ralph Gross,et al.  An Image Preprocessing Algorithm for Illumination Invariant Face Recognition , 2003, AVBPA.

[20]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[21]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[22]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[23]  Douglas A. Reynolds,et al.  Speaker identification and verification using Gaussian mixture speaker models , 1995, Speech Commun..

[24]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Hossein Mobahi,et al.  Face recognition with contiguous occlusion using markov random fields , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Steve J. Young,et al.  HMM-based architecture for face identification , 1994, Image Vis. Comput..

[27]  Jar-Ferr Yang,et al.  Robust Face Recognition under Different Facial Expressions, Illumination Variations and Partial Occlusions , 2011, MMM.

[28]  Jie Lin,et al.  Robust face recognition with partial occlusion, illumination variation and limited training data by optimal feature selection , 2011 .

[29]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Hermann Ney,et al.  Dynamic programming speech recognition using a context-free grammar , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[31]  Ara V. Nefian,et al.  Embedded Bayesian networks for face recognition , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[32]  Sanja Fidler,et al.  Combining reconstructive and discriminative subspace methods for robust classification and regression by subsampling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Jay Earley,et al.  An efficient context-free parsing algorithm , 1970, Commun. ACM.