Recognizing faces prone to occlusions and common variations using optimal face subgraphs

An intuitive graph optimization face recognition approach called Harmony Search Oriented-EBGM (HSO-EBGM) inspired by the classical Elastic Bunch Graph Matching (EBGM) graphical model is proposed in this contribution. In the proposed HSO-EBGM, a recent evolutionary approach called harmony search optimization is tailored to automatically determine optimal facial landmarks. A novel notion of face subgraphs have been formulated with the aid of these automated landmarks that maximizes the similarity entailed by the subgraphs. For experimental evaluation, two sets of de facto databases (i.e., AR and Face Recognition Grand Challenge (FRGC) ver2.0) are used to validate and analyze the behavior of the proposed HSO-EBGM in terms of number of subgraphs, varying occlusion sizes, face images under controlled/ideal conditions, realistic partial occlusions, expression variations and varying illumination conditions. For a number of experiments, results justify that the HSO-EBGM shows improved recognition performance when compared to recent state-of-the-art face recognition approaches.

[1]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[2]  K. Lee,et al.  A new structural optimization method based on the harmony search algorithm , 2004 .

[3]  Qionghai Dai,et al.  Graph Laplace for Occluded Face Completion and Recognition , 2011, IEEE Transactions on Image Processing.

[4]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[5]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[6]  Karim Faez,et al.  Face recognition using adaptively weighted patch PZM array from a single exemplar image per person , 2008, Pattern Recognit..

[7]  M MartínezAleix.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002 .

[8]  Kalaiarasi Sonai Muthu,et al.  Face recognition with Symmetric Local Graph Structure (SLGS) , 2014, Expert Syst. Appl..

[9]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Abdenour Hadid,et al.  Improving the recognition of faces occluded by facial accessories , 2011, Face and Gesture 2011.

[11]  Zong Woo Geem,et al.  Novel derivative of harmony search algorithm for discrete design variables , 2008, Appl. Math. Comput..

[12]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[13]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010, 1007.3753.

[14]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Mohammed Azmi Al-Betar,et al.  A harmony search algorithm for university course timetabling , 2010, Annals of Operations Research.

[16]  Iyad Abu Doush,et al.  Face Recognition Using Harmony Search-Based Selected Features , 2012 .

[17]  Weiping Chen,et al.  Face Recognition Using Ensemble String Matching , 2013, IEEE Transactions on Image Processing.

[18]  Mohammed A. Awadallah,et al.  Novel selection schemes for harmony search , 2012, Appl. Math. Comput..

[19]  Chang-Tsun Li,et al.  Dynamic Image-to-Class Warping for Occluded Face Recognition , 2014, IEEE Transactions on Information Forensics and Security.

[20]  K. G. Subramanian,et al.  Recognizing occluded faces by exploiting psychophysically inspired similarity maps , 2013, Pattern Recognit. Lett..

[21]  Muhammad Sharif,et al.  A survey: face recognition techniques under partial occlusion , 2014, Int. Arab J. Inf. Technol..

[22]  Vipin Kumar,et al.  Face Recognition using Line Edge Map , 2014 .

[23]  Rainer Stiefelhagen,et al.  Why Is Facial Occlusion a Challenging Problem? , 2009, ICB.

[24]  Zong Woo Geem,et al.  A survey on applications of the harmony search algorithm , 2013, Eng. Appl. Artif. Intell..

[25]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[26]  Dao-Qing Dai,et al.  Structured Sparse Error Coding for Face Recognition With Occlusion , 2013, IEEE Transactions on Image Processing.

[27]  Jianqiang Gao,et al.  Median null(Sw)-based method for face feature recognition , 2013, Appl. Math. Comput..

[28]  Pawan Sinha,et al.  Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About , 2006, Proceedings of the IEEE.

[29]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010 .

[30]  Zhou Zhihu,et al.  Partially occluded face recognition using subface hidden Markov models , 2012, 2012 7th International Conference on Computing and Convergence Technology (ICCCT).

[31]  Mohammed Azmi Al-Betar,et al.  University Course Timetabling Using a Hybrid Harmony Search Metaheuristic Algorithm , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[32]  Kien A. Hua,et al.  Face recognition from a single registered image for conference socializing , 2015, Expert Syst. Appl..

[33]  Dinesh Kumar,et al.  Harmony Search Algorithm for Feature Selection in Face Recognition , 2011 .

[34]  H. Yan,et al.  Face recognition based on Gabor wavelet transform and modular 2DPCA , 2015 .

[35]  Karim Faez,et al.  Recognizing faces using Adaptively Weighted Sub-Gabor Array from a single sample image per enrolled subject , 2010, Image Vis. Comput..

[36]  Mohammed Azmi Al-Betar,et al.  Edge preserving image enhancement via harmony search algorithm , 2012, 2012 4th Conference on Data Mining and Optimization (DMO).

[37]  Jacek M. Zurada,et al.  Occluded Face Recognition Using Correntropy-Based Nonnegative Matrix Factorization , 2012, 2012 11th International Conference on Machine Learning and Applications.

[38]  Chokri Ben Amar,et al.  Sparse multi-stage regularized feature learning for robust face recognition , 2015, Expert Syst. Appl..

[39]  Rosni Abdullah,et al.  A hybrid harmony search algorithm for ab initio protein tertiary structure prediction , 2012, Network Modeling Analysis in Health Informatics and Bioinformatics.

[40]  Zong Woo Geem,et al.  Optimal Scheduling of Multiple Dam System Using Harmony Search Algorithm , 2007, IWANN.

[41]  A. Martínez,et al.  The AR face databasae , 1998 .

[42]  Alaa Eleyan,et al.  Gabor wavelet transform based facial expression recognition using PCA and LBP , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[43]  Iyad Abu Doush,et al.  Memetic techniques for examination timetabling , 2014, Ann. Oper. Res..

[44]  Mandava Rajeswari,et al.  The variants of the harmony search algorithm: an overview , 2011, Artificial Intelligence Review.

[45]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Yongsheng Gao,et al.  Face Recognition Using Line Edge Map , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Saman K. Halgamuge,et al.  Face Recognition by Extending Elastic Bunch Graph Matching with Particle Swarm Optimization , 2009, J. Multim..