A survey: face recognition techniques under partial occlusion

Systems that rely on Face Recognition (FR) biometric have gained great importance ever since terrorist threats imposed weakness among the implemented security systems. Other biometrics i.e., fingerprints or iris recognition is not trustworthy in such situations whereas FR is considered as a fine compromise. This survey illustrates different FR practices that laid foundations on the issue of partial occlusion dilemma where faces are disguised to cheat the security system. Occlusion refers to facade of the face image which can be due to sunglasses, hair or wrapping of facial image by scarf or other accessories. Efforts on FR in controlled settings have been in the picture for past several years; however identification under uncontrolled conditions like illumination, expression and partial occlusion is quite a matter of concern. Based on literature a classification is made in this paper to solve the recognition of face in the presence of partial occlusion. These methods are named as part based methods that make use of Principal Component Analysis (PCA), Linear Discriminate Analysis (LDA), Non-negative Matrix Factorization (NMF), Local Non-negative Matrix Factorization (LNMF), Independent Component Analysis (ICA) and other variations. Feature based and fractal based methods consider features around eyes, nose or mouth region to be used in the recognition phase of algorithms. Furthermore the paper details the experiments and databases used by an assortment of authors to handle the problem of occlusion and the results obtained after performing diverse set of analysis. Lastly, a comparison of various techniques is shown in tabular format to give a precise overview of what different authors have already projected in this particular field.

[1]  Yi-Ping Hung,et al.  Distinctive Personal Traits for Face Recognition Under Occlusion , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[2]  Michele Nappi,et al.  FARO: FAce Recognition Against Occlusions and Expression Variations , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[3]  David Beymer,et al.  A real-time computer vision system for vehicle tracking and traffic surveillance , 1998 .

[4]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Mudassar Raza,et al.  Data Reductionality Technique for Face Recognition , 2011 .

[6]  Aleix M. Martínez,et al.  Face recognition with occlusions in the training and testing sets , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[7]  Simon C. K. Shiu,et al.  Gabor feature based robust representation and classification for face recognition with Gabor occlusion dictionary , 2013, Pattern Recognit..

[8]  Kaleem Siddiqi,et al.  Removal of Partial Occlusion from Single Images , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Mineichi Kudo,et al.  Robust human pose estimation from corrupted images with partial occlusions and noise pollutions , 2011, 2011 IEEE International Conference on Granular Computing.

[10]  Shuicheng Yan,et al.  Misalignment-Robust Face Recognition , 2008, IEEE Transactions on Image Processing.

[11]  Majid Ahmadi,et al.  Illumination invariant feature extraction and mutual-information-based local matching for face recognition under illumination variation and occlusion , 2011, Pattern Recognit..

[12]  Masahide Kaneko,et al.  Block-Based Bag of Words for Robust Face Recognition under Variant Conditions of Facial Expression, Illumination, and Partial Occlusion , 2011, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[13]  Vytautas Perlibakas,et al.  Distance measures for PCA-based face recognition , 2004, Pattern Recognit. Lett..

[14]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[15]  Aleix M. Martínez,et al.  Recognition of partially occluded and/or imprecisely localized faces using a probabilistic approach , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[16]  Georgy L. Gimel'farb,et al.  Robust Face Matching Under Large Occlusions , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[17]  Hongjun Jia,et al.  Support Vector Machines in face recognition with occlusions , 2009, CVPR.

[18]  Ming-Hsuan Yang,et al.  Kernel Eigenfaces vs. Kernel Fisherfaces: Face recognition using kernel methods , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[19]  I.B. Ciocoiu Occluded face recognition using parts-based representation methods , 2005, Proceedings of the 2005 European Conference on Circuit Theory and Design, 2005..

[20]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[21]  Guodong Guo,et al.  Face recognition by support vector machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[22]  Ming-Hsuan Yang,et al.  Face Recognition Using Kernel Methods , 2001, NIPS.

[23]  R. Tibshirani,et al.  Flexible Discriminant Analysis by Optimal Scoring , 1994 .

[24]  Qionghai Dai,et al.  Partially occluded face completion and recognition , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[25]  Hossein Mobahi,et al.  Face recognition with contiguous occlusion using markov random fields , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[26]  Jie Lin,et al.  Robust face recognition with partially occluded images based on a single or a small number of training samples , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Xu Zhan-min Novel incremental principal component analysis and its application for face recognition , 2008 .

[28]  Sang Uk Lee,et al.  Occlusion Invariant Face Recognition Using Two-Dimensional PCA , 2006, VISIGRAPP.

[29]  Gozde Bozdagi Akar,et al.  OCCLUDED FACE RECOGNITION BY USING GABOR FEATURES , 2002 .

[30]  Pong C. Yuen,et al.  Incremental Linear Discriminant Analysis for Face Recognition , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Massimiliano Pontil,et al.  Support Vector Machines for 3D Object Recognition , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Jian Huang,et al.  Kernel machine-based one-parameter regularized Fisher discriminant method for face recognition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[34]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[35]  V. Vasudevan,et al.  Face Recognition System with various Expression and Occlusion based on a Novel Block Matching Algorithm and PCA , 2012 .

[36]  Wen Gao,et al.  Local Gabor Binary Patterns Based on Kullback–Leibler Divergence for Partially Occluded Face Recognition , 2007, IEEE Signal Processing Letters.

[37]  Kenneth Rose,et al.  A probabilistic model of face mapping with local transformations and its application to person recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  M. Sharif,et al.  Face Recognition Based on Facial Features , 2012 .

[39]  Vijayan K. Asari,et al.  Facial Recognition Using Multisensor Images Based on Localized Kernel Eigen Spaces , 2009, IEEE Transactions on Image Processing.

[40]  Haitao Zhao,et al.  A novel incremental principal component analysis and its application for face recognition , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[41]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[42]  K. Hotta View-invariant face detection method based on local PCA cells , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[43]  Hanqing Lu,et al.  Occlusion Robust Face Recognition with Dynamic Similarity Features , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[44]  M. Sharif,et al.  Illumination normalization preprocessing for face recognition , 2010, 2010 The 2nd Conference on Environmental Science and Information Application Technology.

[45]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[46]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[47]  Muhammad Sharif,et al.  Single Image Face Recognition Using Laplacian of Gaussian and Discrete Cosine Transforms , 2012, Int. Arab J. Inf. Technol..

[48]  Zhiwei Zhu,et al.  Robust Pose Invariant Facial Feature Detection and Tracking in Real-Time , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[49]  M.T. Rahman,et al.  Face recognition using Gabor Filters , 2008, 2008 11th International Conference on Computer and Information Technology.

[50]  Roberto Brunelli,et al.  Face Recognition: Features Versus Templates , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Simon Dobrisek,et al.  Confidence Weighted Subspace Projection Techniques for Robust Face Recognition in the Presence of Partial Occlusions , 2010, 2010 20th International Conference on Pattern Recognition.

[52]  Thomas Sikora,et al.  More robust face recognition by considering occlusion information , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[53]  Jie Lin,et al.  A probabilistic union approach to robust face recognition with partial distortion and occlusion , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[54]  F. Tarres,et al.  A novel method for face recognition under partial occlusion or facial expression variations , 2005, 47th International Symposium ELMAR, 2005..

[55]  Jongsun Kim,et al.  Effective representation using ICA for face recognition robust to local distortion and partial occlusion , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Kazuhiro Hotta Robust face recognition under partial occlusion based on support vector machine with local Gaussian summation kernel , 2008, Image Vis. Comput..

[57]  Önsen Toygar,et al.  Illumination Invariant Face Recognition under Various Facial Expressions and Occlusions , 2008, ICISP.

[58]  Zhi-Hua Zhou,et al.  Face Recognition Under Occlusions and Variant Expressions With Partial Similarity , 2009, IEEE Transactions on Information Forensics and Security.

[59]  Andrea F. Abate,et al.  Occluded Face Recognition by Means of the IFS , 2005, ICIAR.

[60]  M. Sharif,et al.  3D FACE RECOGNITION USING HORIZONTAL AND VERTICAL MARKED STRIPS , 2011 .

[61]  Zhi-Hua Zhou,et al.  Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft k-NN ensemble , 2005, IEEE Transactions on Neural Networks.

[62]  Sang Uk Lee,et al.  Occlusion invariant face recognition using selective local non-negative matrix factorization basis images , 2008, Image Vis. Comput..

[63]  M. Sharif,et al.  Face Recognition for Disguised Variations Using Gabor Feature Extraction , 2011 .

[64]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[65]  Muhammad Sharif,et al.  USING NOSE HEURISTICS FOR EFFICIENT FACE RECOGNITION , 2011 .

[66]  Nazean Binti Jomhari,et al.  The International Arab Journal of Information Technology , 2011 .

[67]  Takio Kurita,et al.  Recognition and detection of occluded faces by a neural network classifier with recursive data reconstruction , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[68]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Jian Liu,et al.  Active Appearance Models Fitting with Occlusion , 2007, EMMCVPR.

[70]  Kazuhiro Hotta,et al.  A View-Invariant Face Detection Method Based on Local PCA Cells , 2004, J. Adv. Comput. Intell. Intell. Informatics.

[71]  Jun Li,et al.  Learning Non-Metric Partial Similarity Based on Maximal Margin Criterion , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[72]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[73]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[74]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.