Two-dimensional discriminant analysis based on Schatten p-norm for image feature extraction

A Schatten p-norm-based 2DDA (2DDA-SP) method is proposed.An iterative algorithm is derived to solve the optimization problem of 2DDA-SP.2DDA-SP is effective for extracting discriminative features and robust to outliers.2DDA-SP is effective and robust for image feature extraction. A Schatten p-norm-based two-dimensional principal component analysis (2DPCA-SP) method was proposed for image feature extraction in our previous work. As an unsupervised method, 2DPCA-SP ignores the label information of training samples, which is essential to classification tasks. In this paper, we propose a novel Schatten p-norm-based two-dimensional discriminant analysis (2DDA-SP) method for image feature extraction, which learns an optimal projection matrix by maximizing the difference of Schatten p-norm-based between-class dispersion and Schatten p-norm-based within-class dispersion in low-dimensional feature space. By using both the Schatten p-norm metric and the label information of training samples, 2DDA-SP not only can efficiently extract discriminative features, but is also robust to outliers. We also propose an efficient iterative algorithm to solve the optimization problem of 2DDA-SP with 0

[1]  Jian Yang,et al.  Nuclear Norm-Based 2-DPCA for Extracting Features From Images , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jiashu Zhang,et al.  Linear Discriminant Analysis Based on L1-Norm Maximization , 2013, IEEE Transactions on Image Processing.

[4]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Nojun Kwak,et al.  Principal Component Analysis by $L_{p}$ -Norm Maximization , 2014, IEEE Transactions on Cybernetics.

[6]  Ming Shao,et al.  Discriminative metric: Schatten norm vs. vector norm , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[7]  Xiaoyang Tan,et al.  Pattern Recognition , 2016, Communications in Computer and Information Science.

[8]  Bin Luo,et al.  2D-LPP: A two-dimensional extension of locality preserving projections , 2007, Neurocomputing.

[9]  Yuan-Hai Shao,et al.  Robust L1-norm two-dimensional linear discriminant analysis , 2015, Neural Networks.

[10]  Feiping Nie,et al.  Low-Rank Matrix Recovery via Efficient Schatten p-Norm Minimization , 2012, AAAI.

[11]  Wankou Yang,et al.  Two-directional maximum scatter difference discriminant analysis for face recognition , 2008, Neurocomputing.

[12]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[14]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[15]  Tao Jiang,et al.  Efficient and robust feature extraction by maximum margin criterion , 2003, IEEE Transactions on Neural Networks.

[16]  Nojun Kwak,et al.  Generalization of linear discriminant analysis using Lp-norm , 2013, Pattern Recognit. Lett..

[17]  Feiping Nie,et al.  Robust Principal Component Analysis with Non-Greedy l1-Norm Maximization , 2011, IJCAI.

[18]  Michael J. Black,et al.  On the unification of line processes , 1996 .

[19]  Zhongfei Zhang,et al.  Linear discriminant analysis using rotational invariant L1 norm , 2010, Neurocomputing.

[20]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[21]  Feiping Nie,et al.  Robust Matrix Completion via Joint Schatten p-Norm and lp-Norm Minimization , 2012, 2012 IEEE 12th International Conference on Data Mining.

[22]  Jian Yang,et al.  Schatten p-Norm Based Matrix Regression Model for Image Classification , 2014, CCPR.

[23]  Alan L. Yuille,et al.  Robust principal component analysis by self-organizing rules based on statistical physics approach , 1995, IEEE Trans. Neural Networks.

[24]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[25]  Takeo Kanade,et al.  Robust L/sub 1/ norm factorization in the presence of outliers and missing data by alternative convex programming , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Nojun Kwak,et al.  Principal Component Analysis Based on L1-Norm Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Xuelong Li,et al.  L1-Norm-Based 2DPCA , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Ming Li,et al.  2D-LDA: A statistical linear discriminant analysis for image matrix , 2005, Pattern Recognit. Lett..

[29]  Hongyuan Zha,et al.  {\it R}$_{\mbox{1}}$-PCA: rotational invariant {\it L}$_{\mbox{1}}$-norm principal component analysis for robust subspace factorization , 2006, ICML 2006.

[30]  Fan Zhang,et al.  Two-dimensional principal component analysis based on Schatten p-norm for image feature extraction , 2015, J. Vis. Commun. Image Represent..