Local sparsity preserving projection and its application to biometric recognition

Dimensionality reduction techniques based on sparse representation have drawn great attentions recently and they are successfully applied to biometric recognition. In this paper, a new unsupervised dimensionality reduction method called Local Sparsity Preserving Projection (LSPP) is proposed. Unlike the traditional dimensionality reduction methods based on sparse representation which only preserve the sparse reconstructive relationship, LSPP preserves sparsity and locality characteristics of the data simultaneously. In LSPP, a training sample could be more possibly represented by training samples from the same class and a more accurate sparse reconstructive weight matrix is obtained. Thus, LSPP has more powerful discriminative ability than traditional dimensionality reduction methods. As kernel extension of LSPP, Kernel Local Sparsity Preserving Projection (KLSPP) which is more effective for nonlinear data is also presented. In the experiments on several biometric databases, the proposed methods obtain higher recognition rates and verification rates and are computationally more efficient than the traditional dimensionality reduction methods based on sparse representation.

[1]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[2]  David Zhang,et al.  Quadratic Projection Based Feature Extraction with Its Application to Biometric Recognition , 2016, Pattern Recognit..

[3]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[4]  Nicolas Le Roux,et al.  Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering , 2003, NIPS.

[5]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[6]  Michael Elad,et al.  Learning Multiscale Sparse Representations for Image and Video Restoration , 2007, Multiscale Model. Simul..

[7]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[8]  Zhong Jin,et al.  Kernel sparse representation based classification , 2012, Neurocomputing.

[9]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[10]  M. Grgic,et al.  A survey of biometric recognition methods , 2004, Proceedings. Elmar-2004. 46th International Symposium on Electronics in Marine.

[11]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[12]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[13]  Trevor J. Hastie,et al.  Sparse Discriminant Analysis , 2011, Technometrics.

[14]  Hwann-Tzong Chen,et al.  Local discriminant embedding and its variants , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  张振跃,et al.  Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space Alignment , 2004 .

[16]  David Zhang,et al.  Face and palmprint pixel level fusion and Kernel DCV-RBF classifier for small sample biometric recognition , 2007, Pattern Recognit..

[17]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Ping Yan,et al.  Biometric Recognition Using 3D Ear Shape , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Lei Zhang,et al.  A multi-manifold discriminant analysis method for image feature extraction , 2011, Pattern Recognit..

[20]  D. Donoho.  For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[21]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  De-Shuang Huang,et al.  Optimized projections for sparse representation based classification , 2013, Neurocomputing.

[23]  Zhong Jin,et al.  Face recognition using discriminant sparsity neighborhood preserving embedding , 2012, Knowl. Based Syst..

[24]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  David Zhang,et al.  Study on novel Curvature Features for 3D fingerprint recognition , 2015, Neurocomputing.

[26]  René Vidal,et al.  Sparse subspace clustering , 2009, CVPR.

[27]  Qiang Zhang,et al.  Maximum margin sparse representation discriminative mapping with application to face recognition , 2013 .

[28]  Haitao Yu,et al.  Graph Regularized Sparsity Discriminant Analysis for face recognition , 2016, Neurocomputing.

[29]  LinLin Shen,et al.  Fpcode: an Efficient Approach for Multi-Modal Biometrics , 2011, Int. J. Pattern Recognit. Artif. Intell..

[30]  Jian Yang,et al.  Multilinear Sparse Principal Component Analysis , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[31]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[32]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[33]  Zhenhua Guo,et al.  Face recognition by sparse discriminant analysis via joint L2, 1-norm minimization , 2014, Pattern Recognit..

[34]  Jiawei Han,et al.  Isometric Projection , 2007, AAAI.

[35]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[36]  Anil K. Jain.  Technology: Biometric recognition , 2007, Nature.

[37]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[38]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[39]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[40]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Issa Traoré,et al.  Biometric Recognition Based on Free-Text Keystroke Dynamics , 2014, IEEE Transactions on Cybernetics.

[42]  Shuicheng Yan,et al.  Learning With $\ell ^{1}$-Graph for Image Analysis , 2010, IEEE Transactions on Image Processing.

[43]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[44]  Qian Du,et al.  Sparse Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Jian Yang,et al.  LPP solution schemes for use with face recognition , 2010, Pattern Recognit..

[46]  Wei Jia,et al.  Discriminant sparse neighborhood preserving embedding for face recognition , 2012, Pattern Recognit..

[47]  Ming Li,et al.  Feature extraction using two-dimensional maximum embedding difference , 2014, Inf. Sci..

[48]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Jian Yang,et al.  Approximate Orthogonal Sparse Embedding for Dimensionality Reduction , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[50]  Jian Yang,et al.  Sparse Representation Classifier Steered Discriminative Projection With Applications to Face Recognition , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[51]  Yang Wankou.  Kernel Sparsity Preserving Projections and Its Application to Biometrics , 2013 .

[52]  Xiaoyang Tan,et al.  Pattern Recognition , 2016, Communications in Computer and Information Science.

[53]  Edoardo Amaldi,et al.  On the Approximability of Minimizing Nonzero Variables or Unsatisfied Relations in Linear Systems , 1998, Theor. Comput. Sci..

[54]  Deli Zhao,et al.  Linear local tangent space alignment and application to face recognition , 2007, Neurocomputing.