Supervised Sparsity Preserving Projections for Face Recognition

Recently feature extraction methods have commonly been used as a principled approach to understand the intrinsic structure hidden in high-dimensional data. In this paper, a novel supervised learning method, called Supervised Sparsity Preserving Projections (SSPP), is proposed. SSPP attempts to preserve the sparse representation structure of the data when identifying an efficient discriminant subspace. First, SSPP creates a concatenated dictionary by class-wise PCA decompositions and learns the sparse representation structure of each sample under the constructed dictionary using the least squares method. Second, by maximizing the ratio of non-local scatter to local scatter, a Laplacian discriminant function is 816 Y. Ren, Y. Chen, X. Yue defined to characterize the separability of the samples in the different sub-manifolds. Then, to achieve improved recognition results, SSPP integrates the learned sparse representation structure as a regular term into the Laplacian discriminant function. Finally, the proposed method is converted into a generalized eigenvalue problem. The extensive and promising experimental results on several popular face databases validate the feasibility and effectiveness of the proposed approach.

[1]  John Shawe-Taylor,et al.  MahNMF: Manhattan Non-negative Matrix Factorization , 2012, ArXiv.

[2]  Daniel Rueckert,et al.  Segmentation of MR images via discriminative dictionary learning and sparse coding: Application to hippocampus labeling , 2013, NeuroImage.

[3]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[4]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[5]  Paul M. Thompson,et al.  Segmentation of High Angular Resolution Diffusion MRI Using Sparse Riemannian Manifold Clustering , 2014, IEEE Transactions on Medical Imaging.

[6]  Shie Mannor,et al.  Time Series Analysis Using Geometric Template Matching , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Eamonn J. Keogh,et al.  Experimental comparison of representation methods and distance measures for time series data , 2010, Data Mining and Knowledge Discovery.

[9]  Xiao Li,et al.  Machine Learning Paradigms for Speech Recognition: An Overview , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[10]  Guangming Shi,et al.  Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation , 2016, IEEE Transactions on Image Processing.

[11]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[12]  Kai Liu,et al.  Kernel-based sparse representation for gesture recognition , 2013, Pattern Recognit..

[13]  Jiang-She Zhang,et al.  Discriminative learning by sparse representation for classification , 2011, Neurocomputing.

[14]  Xiaoyang Tan,et al.  Sparsity preserving discriminant analysis for single training image face recognition , 2010, Pattern Recognit. Lett..

[15]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[16]  Lin Xiong,et al.  Sparse regularization discriminant analysis for face recognition , 2014, Neurocomputing.

[17]  Ivan Laptev,et al.  Efficient Feature Extraction, Encoding, and Classification for Action Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[19]  Shengping Zhang,et al.  Robust visual tracking based on online learning sparse representation , 2013, Neurocomputing.

[20]  Jian Yang,et al.  Sparse tensor discriminant analysis , 2013, IEEE Transactions on Image Processing.

[21]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[22]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[23]  Bart De Moor,et al.  Subspace Identification for Linear Systems: Theory ― Implementation ― Applications , 2011 .

[24]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[25]  Tanaya Guha,et al.  Learning Sparse Representations for Human Action Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[27]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[28]  Sudeep Sarkar,et al.  Rate-Invariant Analysis of Trajectories on Riemannian Manifolds with Application in Visual Speech Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Daniel W. A. Buchan,et al.  A large-scale evaluation of computational protein function prediction , 2013, Nature Methods.

[30]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[31]  Yaozong Gao,et al.  Integration of sparse multi-modality representation and anatomical constraint for isointense infant brain MR image segmentation , 2014, NeuroImage.

[32]  Yiguang Chen,et al.  Single-Image Super-Resolution Reconstruction via Learned Geometric Dictionaries and Clustered Sparse Coding , 2012, IEEE Transactions on Image Processing.

[33]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[34]  J. Friedman Regularized Discriminant Analysis , 1989 .

[35]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[36]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[37]  Lin Sun,et al.  DL-SFA: Deeply-Learned Slow Feature Analysis for Action Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Joshua B. Tenenbaum,et al.  Mapping a Manifold of Perceptual Observations , 1997, NIPS.

[39]  Jian Yang,et al.  KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Zhong Jin,et al.  Face recognition using discriminant sparsity neighborhood preserving embedding , 2012, Knowl. Based Syst..

[41]  Youfu Li,et al.  Learning Local Appearances With Sparse Representation for Robust and Fast Visual Tracking , 2015, IEEE Transactions on Cybernetics.

[42]  Zhang Guoyin,et al.  Supervised Laplacian Discriminant Analysis for Small Sample Size Problem with Its Application to Face Recognition , 2012 .

[43]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[44]  Xiaoyang Tan,et al.  Pattern Recognition , 2016, Communications in Computer and Information Science.

[45]  C J Taylor,et al.  Anatomical statistical models and their role in feature extraction. , 2004, The British journal of radiology.

[46]  Zhiwen Yu,et al.  Protein Function Prediction with Incomplete Annotations , 2014, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[47]  Stefanos Zafeiriou,et al.  Merging SVMs with Linear Discriminant Analysis: A Combined Model , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.