Sparse multi-stage regularized feature learning for robust face recognition

A new feature-extraction approach for efficient FR based on directional features.An augmented multi-stage or multi-regularization convex optimization.Results on various face databases demonstrate the effectiveness of our approach.The approach presents a trade-off between recognition and computational complexity.Three protocol experimental are tested among them the SSPP. The major limitation in current facial recognition systems is that they do not perform very well in uncontrolled environments, that is, when faces present variations in pose, illumination, facial expressions and environment. This is a serious obstacle in applications such as law enforcement and surveillance systems. To address this limitation, in this paper we introduce an improved approach to ensure robust face recognition, that relies on two innovative ideas. First, we apply a new multiscale directional framework, called Shearlet Network (SN), to extract facial features. The advantage of this approach comes from the highly sparse representation properties of the shearlet framework that is especially designed to robustly extract the fundamental geometric content of an image. Second, we apply a refinement of the Multi-Task Sparse Learning (MTSL) framework to exploit the relationships among multiple shared tasks generated by changing the regularization parameter during the recognition stage. We provide extensive numerical tests to show that our Sparse Multi-Regularized Shearlet Network (SMRSN) algorithm performs very competitively when compared against different state-of-the-art methods on different experimental protocols, including face recognition in uncontrolled conditions and single-sample-per-person.

[1]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[2]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  J. Zidek,et al.  Adaptive Multivariate Ridge Regression , 1980 .

[4]  J. Friedman Regularized Discriminant Analysis , 1989 .

[5]  Tsunehiro Aibara,et al.  Construction of a Distributed Associative Memory on the Basis of Bayes Discriminant Rule , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[7]  David Zhang,et al.  Bimodal biometrics based on a representation and recognition approach , 2011 .

[8]  Lei Zhang,et al.  Metaface learning for sparse representation based face recognition , 2010, 2010 IEEE International Conference on Image Processing.

[9]  Hamid Krim,et al.  A Shearlet Approach to Edge Analysis and Detection , 2009, IEEE Transactions on Image Processing.

[10]  Xudong Jiang,et al.  Eigenfeature Regularization and Extraction in Face Recognition , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[12]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Sebastian Thrun,et al.  Learning to Learn , 1998, Springer US.

[14]  Xiaogang Wang,et al.  Boosted multi-task learning for face verification with applications to web image and video search , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Shaoyan Zhang,et al.  Face recognition with support vector machine , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[16]  Jieping Ye,et al.  Multi-stage multi-task feature learning , 2012, J. Mach. Learn. Res..

[17]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[18]  Demetrio Labate,et al.  Optimally Sparse Multidimensional Representation Using Shearlets , 2007, SIAM J. Math. Anal..

[19]  David Zhang,et al.  Relaxed collaborative representation for pattern classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Simon C. K. Shiu,et al.  Multi-scale Patch Based Collaborative Representation for Face Recognition with Margin Distribution Optimization , 2012, ECCV.

[21]  Chokri Ben Amar,et al.  ShearFace: Efficient Extraction of Anisotropic Features for Face Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[22]  Vishal M. Patel,et al.  Directional Multiscale Processing of Images Using Wavelets with Composite Dilations , 2012, Journal of Mathematical Imaging and Vision.

[23]  Jian Yang,et al.  Regularized Robust Coding for Face Recognition , 2012, IEEE Transactions on Image Processing.

[24]  Tong Zhang Multi-stage Convex Relaxation for Feature Selection , 2011, 1106.0565.

[25]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Chokri Ben Amar,et al.  Shearlet Network-based Sparse Coding Augmented by Facial Texture Features for Face Recognition , 2013, ICIAP.

[27]  M. Bertero,et al.  Ill-posed problems in early vision , 1988, Proc. IEEE.

[28]  Jonghyun Choi,et al.  Face Identification Using Large Feature Sets , 2012, IEEE Transactions on Image Processing.

[29]  RegressionLeo Breiman,et al.  Predicting Multivariate Responses in MultipleLinear , 2013 .

[30]  Chokri Ben Amar,et al.  Regularized Shearlet Network for face recognition using single sample per person , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Wang-Q Lim,et al.  Sparse multidimensional representation using shearlets , 2005, SPIE Optics + Photonics.

[32]  Tal Hassner,et al.  Similarity Scores Based on Background Samples , 2009, ACCV.

[33]  M. Bertero Regularization methods for linear inverse problems , 1986 .

[34]  Chokri Ben Amar,et al.  Beta wavelets. Synthesis and application to lossy image compression , 2005, Adv. Eng. Softw..

[35]  A. Martínez,et al.  The AR face databasae , 1998 .

[36]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[37]  Jian Yang,et al.  Robust sparse coding for face recognition , 2011, CVPR 2011.

[38]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[39]  Martin Vetterli,et al.  Data Compression and Harmonic Analysis , 1998, IEEE Trans. Inf. Theory.

[40]  C. Thomaz,et al.  A new ranking method for principal components analysis and its application to face image analysis , 2010, Image Vis. Comput..

[41]  Xiaogang Wang,et al.  Boosted multi-task learning for face verification with applications to web image and video search , 2009, CVPR.

[42]  Tong Zhang,et al.  Analysis of Multi-stage Convex Relaxation for Sparse Regularization , 2010, J. Mach. Learn. Res..

[43]  Konstantinos N. Plataniotis,et al.  Regularized discriminant analysis for the small sample size problem in face recognition , 2003, Pattern Recognit. Lett..

[44]  Rich Caruana,et al.  Multitask Learning , 1997, Machine Learning.

[45]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[46]  Chokri Ben Amar,et al.  Fast and efficient 3D face recognition using wavelet networks , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[47]  Francesca Odone,et al.  A Regularized Framework for Feature Selection in Face Detection and Authentication , 2009, International Journal of Computer Vision.

[48]  Hakan Cevikalp,et al.  New clustering algorithms for the support vector machine based hierarchical classification , 2010, Pattern Recognit. Lett..

[49]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[50]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[51]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[52]  J. Friedman,et al.  Predicting Multivariate Responses in Multiple Linear Regression , 1997 .

[53]  Glenn R. Easley,et al.  Critically Sampled Wavelets With Composite Dilations , 2012, IEEE Transactions on Image Processing.