Advanced Variations of Two-Dimensional Principal Component Analysis for Face Recognition

The two-dimensional principal component analysis (2DPCA) has become one of the most powerful tools of artificial intelligent algorithms. In this paper, we review 2DPCA and its variations, and propose a general ridge regression model to extract features from both row and column directions. To enhance the generalization ability of extracted features, a novel relaxed 2DPCA (R2DPCA) is proposed with a new ridge regression model. R2DPCA generates a weighting vector with utilizing the label information, and maximizes a relaxed criterion with applying an optimal algorithm to get the essential features. The R2DPCA-based approaches for face recognition and image reconstruction are also proposed and the selected principle components are weighted to enhance the role of main components. Numerical experiments on well-known standard databases indicate that R2DPCA has high generalization ability and can achieve a higher recognition rate than the state-of-the-art methods, including in the deep learning methods such as CNNs, DBNs, and DNNs.

[1]  Youfu Li,et al.  Feature extraction based on Lp-norm generalized principal component analysis , 2013, Pattern Recognit. Lett..

[2]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[3]  Nojun Kwak,et al.  Principal Component Analysis by $L_{p}$ -Norm Maximization , 2014, IEEE Transactions on Cybernetics.

[4]  Xiao-Jun Wu,et al.  2DPCANet: a deep leaning network for face recognition , 2017, Multimedia Tools and Applications.

[5]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[6]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[7]  De-Shuang Huang,et al.  Locally linear discriminant embedding: An efficient method for face recognition , 2008, Pattern Recognit..

[8]  Rasmus Berg Palm,et al.  Prediction as a candidate for learning deep hierarchical models of data , 2012 .

[9]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[10]  Jian Yang,et al.  Uncorrelated Projection Discriminant Analysis And Its Application To Face Image Feature Extraction , 2003, Int. J. Pattern Recognit. Artif. Intell..

[11]  Haesun Park,et al.  Generalizing discriminant analysis using the generalized singular value decomposition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Pengfei Shi,et al.  A note on two-dimensional linear discriminant analysis , 2008, Pattern Recognit. Lett..

[13]  Jieping Ye,et al.  Characterization of a Family of Algorithms for Generalized Discriminant Analysis on Undersampled Problems , 2005, J. Mach. Learn. Res..

[14]  Ming Li,et al.  2D-LDA: A statistical linear discriminant analysis for image matrix , 2005, Pattern Recognit. Lett..

[15]  Jian Huang,et al.  Kernel machine-based one-parameter regularized Fisher discriminant method for face recognition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  De-Shuang Huang,et al.  Human face recognition based on multi-features using neural networks committee , 2004, Pattern Recognit. Lett..

[17]  Michael K. Ng,et al.  Lanczos method for large-scale quaternion singular value decomposition , 2018, Numerical Algorithms.

[18]  M. Omair Ahmad,et al.  Two-dimensional FLD for face recognition , 2005, Pattern Recognit..

[19]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[20]  Chris H. Q. Ding,et al.  R1-PCA: rotational invariant L1-norm principal component analysis for robust subspace factorization , 2006, ICML.

[21]  Fang Chen,et al.  ${R}_1$ -2-DPCA and Face Recognition , 2019, IEEE Transactions on Cybernetics.

[22]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[23]  Michael I. Jordan,et al.  A Direct Formulation for Sparse Pca Using Semidefinite Programming , 2004, SIAM Rev..

[24]  R. Tibshirani,et al.  A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis. , 2009, Biostatistics.

[25]  Jian Yang,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Xuelong Li,et al.  L1-Norm-Based 2DPCA , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Zhigang Jia,et al.  A structure-preserving Jacobi algorithm for quaternion Hermitian eigenvalue problems , 2017, Comput. Math. Appl..

[28]  Charu C. Aggarwal,et al.  Neural Networks and Deep Learning , 2018, Springer International Publishing.

[29]  Zhigang Jia,et al.  A New Structure-Preserving Method for Recognition of Color Face Images , 2017 .

[30]  Yong Chen,et al.  A new real structure-preserving quaternion QR algorithm , 2017, J. Comput. Appl. Math..

[31]  Hervé Glotin,et al.  Cooperative Sparse Representation in Two Opposite Directions for Semi-Supervised Image Annotation , 2012, IEEE Transactions on Image Processing.

[32]  Jing Wang,et al.  Generalized 2-D Principal Component Analysis by Lp-Norm for Image Analysis , 2016, IEEE Transactions on Cybernetics.

[33]  De-Shuang Huang,et al.  A novel full structure optimization algorithm for radial basis probabilistic neural networks , 2006, Neurocomputing.

[34]  Li Shang,et al.  Palmprint recognition using FastICA algorithm and radial basis probabilistic neural network , 2006, Neurocomputing.

[35]  Daoqiang Zhang,et al.  (2D)2PCA: Two-directional two-dimensional PCA for efficient face representation and recognition , 2005, Neurocomputing.

[36]  Zhigang Jia,et al.  Sample-Relaxed Two-Dimensional Color Principal Component Analysis for Face Recognition and Image Reconstruction , 2018, ArXiv.

[37]  Takeo Kanade,et al.  Robust L/sub 1/ norm factorization in the presence of outliers and missing data by alternative convex programming , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Dong Uk Cho,et al.  (2D)2 DLDA for Efficient Face Recognition , 2006, PSIVT.

[39]  Lester W. Mackey,et al.  Deflation Methods for Sparse PCA , 2008, NIPS.

[40]  Deyu Meng,et al.  Improve robustness of sparse PCA by L1-norm maximization , 2012, Pattern Recognit..

[41]  Nojun Kwak,et al.  Principal Component Analysis Based on L1-Norm Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Josef Kittler,et al.  L1-2D2PCANet: a deep learning network for face recognition , 2018, J. Electronic Imaging.

[43]  Zhigang Jia,et al.  Improved Two-Dimensional Quaternion Principal Component Analysis , 2019, IEEE Access.

[44]  Michael K. Ng,et al.  Color Image Restoration by Saturation-Value Total Variation , 2019, SIAM J. Imaging Sci..

[45]  Musheng Wei,et al.  A new structure-preserving method for quaternion Hermitian eigenvalue problems , 2013, J. Comput. Appl. Math..

[46]  Li Zhao,et al.  Theoretical analysis of illumination in PCA-based vision systems , 1999, Pattern Recognit..

[47]  Zhigang Jia,et al.  Color Two-Dimensional Principal Component Analysis for Face Recognition Based on Quaternion Model , 2017, ICIC.

[48]  Jieping Ye,et al.  A two-stage linear discriminant analysis via QR-decomposition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Xiaofeng Wang,et al.  An efficient local Chan-Vese model for image segmentation , 2010, Pattern Recognit..

[51]  Alex Pentland,et al.  Looking at People: Sensing for Ubiquitous and Wearable Computing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Yuttapong Rangsanseri,et al.  Face recognition using 2DLDA algorithm , 2005, Proceedings of the Eighth International Symposium on Signal Processing and Its Applications, 2005..

[53]  Jianhua Z. Huang,et al.  Sparse principal component analysis via regularized low rank matrix approximation , 2008 .

[54]  Jing Wang,et al.  2DPCA with L1-norm for simultaneously robust and sparse modelling , 2013, Neural Networks.

[55]  Michael K. Ng,et al.  Robust quaternion matrix completion with applications to image inpainting , 2019, Numer. Linear Algebra Appl..