Histogram-Based CRC for 3D-Aided Pose-Invariant Face Recognition

Traditional Collaborative Representation-based Classification algorithms for face recognition (CRC) usually suffer from data uncertainty, especially if it includes various poses and illuminations. To address this issue, in this paper, we design a new CRC method using histogram statistical measurement (H-CRC) combined with a 3D morphable model (3DMM) for pose-invariant face classification. First, we fit a 3DMM to raw images in the dictionary to reconstruct the 3D shapes and textures. The fitting results are used to render numerous virtual samples of 2D images that are frontalized from arbitrary poses. In contrast to other distance-based evaluation algorithms for collaborative (or sparse) representation-based methods, the histogram information of all the generated 2D face images is subsequently exploited. Second, we use a histogram-based metric learning to evaluate the most similar neighbours of the test sample, which aims to obtain ideal result for pose-invariant face recognition using the designed histogram-based 3DMM model and online pruning strategy, forming a unified 3D-aided CRC framework. The proposed method achieves desirable classification results that are conducted on a set of well-known face databases, including ORL, Georgia Tech, FERET, FRGC, PIE and LFW.

[1]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Jun Guo,et al.  Extended SRC: Undersampled Face Recognition via Intraclass Variant Dictionary , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Luc Van Gool,et al.  Latent Dictionary Learning for Sparse Representation Based Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  William J. Christmas,et al.  Gaussian mixture 3D morphable face model , 2018, Pattern Recognit..

[5]  Jian Yang,et al.  A New Discriminative Sparse Representation Method for Robust Face Recognition via $l_{2}$ Regularization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[6]  YanShuicheng,et al.  Learning with l1-graph for image analysis , 2010 .

[7]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[8]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Hui Li,et al.  A novel kernel collaborative representation approach for image classification , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[11]  Yong Wang,et al.  Incremental complete LDA for face recognition , 2012, Pattern Recognit..

[12]  David Zhang,et al.  Relaxed collaborative representation for pattern classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Du-Sik Park,et al.  Rotating your face using multi-task deep neural network , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Karthikeyan Natesan Ramamurthy,et al.  Multiple Kernel Sparse Representations for Supervised and Unsupervised Learning , 2013, IEEE Transactions on Image Processing.

[15]  Jian Yang,et al.  Sample diversity, representation effectiveness and robust dictionary learning for face recognition , 2017, Inf. Sci..

[16]  Sang-Woong Lee,et al.  Robust face recognition via hierarchical collaborative representation , 2018, Inf. Sci..

[17]  Xiaogang Wang,et al.  Multi-View Perceptron: a Deep Model for Learning Face Identity and View Representations , 2014, NIPS.

[18]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[20]  Yu Zhang,et al.  Brain extraction based on locally linear representation-based classification , 2014, NeuroImage.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Alan L. Yuille,et al.  Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples , 2016, IEEE Transactions on Image Processing.

[23]  Xiaoning Song,et al.  Half-Face Dictionary Integration for Representation-Based Classification , 2017, IEEE Transactions on Cybernetics.

[24]  Jing-Yu Yang,et al.  Progressive sparse representation-based classification using local discrete cosine transform evaluation for image recognition , 2015, J. Electronic Imaging.

[25]  Xiaoyang Tan,et al.  Pattern Recognition , 2016, Communications in Computer and Information Science.

[26]  Jun Zhang,et al.  Improved sparse representation with low-rank representation for robust face recognition , 2016, Neurocomputing.

[27]  Shuicheng Yan,et al.  Learning With $\ell ^{1}$-Graph for Image Analysis , 2010, IEEE Transactions on Image Processing.

[28]  Yu Cheng,et al.  An improved collaborative representation based classification with regularized least square (CRC-RLS) method for robust face recognition , 2016, Neurocomputing.

[29]  Allen Y. Yang,et al.  Fast ℓ1-minimization algorithms and an application in robust face recognition: A review , 2010, 2010 IEEE International Conference on Image Processing.

[30]  Jing Wang,et al.  Robust Face Recognition via Adaptive Sparse Representation , 2014, IEEE Transactions on Cybernetics.

[31]  David Zhang,et al.  Collaborative Representation based Classification for Face Recognition , 2012, ArXiv.

[32]  Simon C. K. Shiu,et al.  Multi-scale Patch Based Collaborative Representation for Face Recognition with Margin Distribution Optimization , 2012, ECCV.

[33]  Jian Yang,et al.  Regularized Robust Coding for Face Recognition , 2012, IEEE Transactions on Image Processing.

[34]  Yu Chen,et al.  Supervised orthogonal discriminant subspace projects learning for face recognition , 2014, Neural Networks.

[35]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  David Zhang,et al.  A Survey of Sparse Representation: Algorithms and Applications , 2015, IEEE Access.

[37]  Jing-Yu Yang,et al.  Parity symmetrical collaborative representation-based classification for face recognition , 2017, Int. J. Mach. Learn. Cybern..

[38]  Jian Yang,et al.  A Survey of Dictionary Learning Algorithms for Face Recognition , 2017, IEEE Access.

[39]  J. Yao,et al.  2,3-Di(2-pyridyl)-5-phenylpyrazine: a NN-CNN-type bridging ligand for dinuclear transition-metal complexes. , 2013, Chemistry, an Asian journal.

[40]  Yanqing Guo,et al.  Synthesis linear classifier based analysis dictionary learning for pattern classification , 2017, Neurocomputing.

[41]  Bob Zhang,et al.  Multiple representations and sparse representation for image classification , 2015, Pattern Recognit. Lett..

[42]  Xiaojun Wu,et al.  Dynamic dictionary optimization for sparse-representation-based face classification using local difference images , 2017, Inf. Sci..

[43]  Guillermo Sapiro,et al.  Sparse representations for image classification: learning discriminative and reconstructive non-parametric dictionaries , 2008 .

[44]  Chi-Ho Chan,et al.  Face Recognition Using a Unified 3D Morphable Model , 2016, ECCV.

[45]  A. Vijayalakshmi,et al.  Deep learning approach to detect malaria from microscopic images , 2019, Multimedia Tools and Applications.

[46]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[48]  Josef Kittler,et al.  Dictionary Integration Using 3D Morphable Face Models for Pose-Invariant Collaborative-Representation-Based Classification , 2016, IEEE Transactions on Information Forensics and Security.

[49]  Xiaogang Wang,et al.  Deep Learning Identity-Preserving Face Space , 2013, 2013 IEEE International Conference on Computer Vision.

[50]  Lei Zhang,et al.  Gabor Feature Based Sparse Representation for Face Recognition with Gabor Occlusion Dictionary , 2010, ECCV.

[51]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[52]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[53]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010, 1007.3753.

[54]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[55]  Tao Huang,et al.  A novel classification method for palmprint recognition based on reconstruction error and normalized distance , 2012, Applied Intelligence.

[56]  Jian Yang,et al.  Approximately symmetrical face images for image preprocessing in face recognition and sparse representation based classification , 2016, Pattern Recognit..