Enhanced Human Face Recognition Using LBPH Descriptor, Multi-KNN, and Back-Propagation Neural Network

Face recognition has become a fascinating field for researchers. The motivation behind the enormous interest in the topic is the need to improve the accuracy of many real-time applications. The complexity of the human face and the changes due to different effects make it more challenging to design as well as implement a powerful computational system for human face recognition. In this paper, we presented an enhanced approach to improve human face recognition using a back-propagation neural network (BPNN) and features extraction based on the correlation between the training images. A key contribution of this paper is the generation of a new set called the T-Dataset from the original training data set, which is used to train the BPNN. We generated the T-Dataset using the correlation between the training images without using a common technique of image density. The correlated T-Dataset provides a high distinction layer between the training images, which helps the BPNN to converge faster and achieve better accuracy. Data and features reduction are essential in the face recognition process, and researchers have recently focused on the modern neural network. Therefore, we used a local binary pattern histogram descriptor to prove that there is potential improvement even using traditional methods. We applied five distance measurement algorithms and then combined them to obtain the T-Dataset, which we fed into the BPNN. We achieved higher face recognition accuracy with less computational cost compared with the current approach by using reduced image features. We test the proposed framework on two small data sets, the YALE and AT&T data sets, as the ground truth. We achieved tremendous accuracy. Furthermore, we evaluate our method on one of the state-of-the-art benchmark data sets, Labeled Faces in the Wild (LFW), where we produce a competitive face recognition performance.

[1]  Yuichi Matsumoto,et al.  Shrink boost for selecting multi-LBP histogram features in object detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Hisham Othman,et al.  A Separable Low Complexity 2D HMM with Application to Face Recognition , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Wei Ge,et al.  Face description and identification using histogram sequence of local binary pattern , 2015, 2015 Seventh International Conference on Advanced Computational Intelligence (ICACI).

[4]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[5]  Konstantinos N. Plataniotis,et al.  Face recognition using LDA-based algorithms , 2003, IEEE Trans. Neural Networks.

[6]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[7]  Václav Hlavác,et al.  Efficient MRF Deformation Model for Non-Rigid Image Matching , 2007, CVPR.

[8]  Derwin Suhartono,et al.  Face recognition using Gabor Wavelet and Non-negative Matrix Factorization , 2015, 2015 SAI Intelligent Systems Conference (IntelliSys).

[9]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[10]  Bruce A. Draper,et al.  Recognizing faces with PCA and ICA , 2003, Comput. Vis. Image Underst..

[11]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[12]  Jiri Matas,et al.  Extended Set of Local Binary Patterns for Rapid Object Detection , 2010 .

[13]  Brian C. Lovell,et al.  Multi-Region Probabilistic Histograms for Robust and Scalable Identity Inference , 2009, ICB.

[14]  Meng Joo Er,et al.  High-speed face recognition based on discrete cosine transform and RBF neural networks , 2005, IEEE Transactions on Neural Networks.

[15]  Rashid Ali,et al.  Automatic Face Recognition System by Combining Four Individual Algorithms , 2011, 2011 International Conference on Computational Intelligence and Communication Networks.

[16]  Yaniv Taigman,et al.  Descriptor Based Methods in the Wild , 2008 .

[17]  Norsuzila Ya'acob,et al.  Differences of image classification techniques for land use and land cover classification , 2015, 2015 IEEE 11th International Colloquium on Signal Processing & Its Applications (CSPA).

[18]  Qian Du,et al.  Remote Sensing Image Scene Classification Using Multi-Scale Completed Local Binary Patterns and Fisher Vectors , 2016, Remote. Sens..

[20]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ting Chen,et al.  A Novel Texture Feature Description Method Based on the Generalized Gabor Direction Pattern and Weighted Discrepancy Measurement Model , 2016, Symmetry.

[22]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Min Chen,et al.  Facial expression recognition in dynamic sequences: An integrated approach , 2014, Pattern Recognit..

[24]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[25]  Wen Gao,et al.  Histogram of Gabor Phase Patterns (HGPP): A Novel Object Representation Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[26]  Jianxin Wu,et al.  mCENTRIST: A Multi-Channel Feature Generation Mechanism for Scene Categorization , 2014, IEEE Transactions on Image Processing.

[27]  Chokri Ben Amar,et al.  Face recognition based on perceived facial images and multilayer perceptron neural network using constructive training algorithm , 2014, IET Comput. Vis..

[28]  Shunfang Wang,et al.  A New Feature Extraction Method Based on the Information Fusion of Entropy Matrix and Covariance Matrix and Its Application in Face Recognition , 2015, Entropy.

[29]  Pod Hyb Extended Set of Local Binary Patterns for Rapid Object Detection , 2010 .

[30]  Josef Kittler,et al.  Efficient processing of MRFs for unconstrained-pose face recognition , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[31]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[32]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[33]  Wen Gao,et al.  Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[34]  Daoqiang Zhang,et al.  Diagonal principal component analysis for face recognition , 2006, Pattern Recognit..

[35]  M. P. Rajath Kumar,et al.  Artificial neural networks for face recognition using PCA and BPNN , 2015, TENCON 2015 - 2015 IEEE Region 10 Conference.

[36]  Gang Hua,et al.  Eigen-PEP for Video Face Recognition , 2014, ACCV.

[37]  Jian-Huang Lai,et al.  GA-fisher: a new LDA-based face recognition algorithm with selection of principal components , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Chokri Ben Amar,et al.  A Survey of 2D Face Recognition Techniques , 2016, Comput..

[39]  Gang Zhang,et al.  Image Intelligent Detection Based on the Gabor Wavelet and the Neural Network , 2016, Symmetry.

[40]  Issam Dagher,et al.  Face recognition using IPCA-ICA algorithm , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Sung Bum Pan,et al.  LDA-based face recognition using multiple distance training face images with low user cooperation , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[42]  Ming-Hsuan Yang,et al.  Kernel Eigenfaces vs. Kernel Fisherfaces: Face recognition using kernel methods , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[43]  Nicolas Pinto,et al.  How far can you get with a modern face recognition test set using only simple features? , 2009, CVPR.

[44]  Chunling Fan,et al.  Research of face recognition based on wavelet transform and principal component analysis , 2012, 2012 8th International Conference on Natural Computation.

[45]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[46]  M. Arif Wani,et al.  Performance Comparison of Major Classical Face Recognition Techniques , 2014, 2014 13th International Conference on Machine Learning and Applications.

[47]  S. Himavathi,et al.  Performance comparison of cascade and feed forward neural network for face recognition system , 2012, ICSE 2012.

[48]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Q. M. Jonathan Wu,et al.  Curvelet based face recognition via dimension reduction , 2009, Signal Process..

[50]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[51]  Shiqing Zhang,et al.  Facial Expression Recognition Based on Local Binary Patterns and Kernel Discriminant Isomap , 2011, Sensors.

[52]  R. Bhaskaran,et al.  Supervised Classification Performance of Multispectral Images , 2010, ArXiv.

[53]  Ammad Ali,et al.  Face Recognition with Local Binary Patterns , 2012 .

[54]  Yongwha Chung,et al.  SVM-based face verification with feature set of small size , 2002 .

[55]  Maria L. Rizzo,et al.  Measuring and testing dependence by correlation of distances , 2007, 0803.4101.

[56]  Ausif Mahmood,et al.  Performance improvement for 2-D face recognition using multi-classifier and BPN , 2016, 2016 IEEE Long Island Systems, Applications and Technology Conference (LISAT).

[57]  Q. M. Jonathan Wu,et al.  Human face recognition based on multidimensional PCA and extreme learning machine , 2011, Pattern Recognit..

[58]  Frédéric Jurie,et al.  Learning Visual Similarity Measures for Comparing Never Seen Objects , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.