Robust Image Feature Extraction via Approximate Orthogonal Low-Rank Embedding

Feature extraction (FE) plays an important role in machine learning. In order to handle the “dimensionality disaster” problem, the usual approach is to transform the original sample into a low-dimensional target space, in which the FE task is performed. However, the data in reality will always be corrupted by various noises or interfered by outliers, making the task of feature extraction extremely challenging. Thence, we propose a novel image FE method via approximate orthogonal low-rank embedding (AOLRE), which adopts an orthogonal matrix to reserve the major energy of the samples, and the introduction of the $\ell _{2,1}$ -norm makes the features more compact, differentiated and interpretable. In addition, the weighted Schatten ${p}$ -norm is adopted in this model for fully exploring the effects of different ranks while approaching the original hypothesis of low rank. Meanwhile, as a robust measure, the correntropy is applied in AOLRE. This can effectively suppress the adverse influences of contaminated data and enhance the robustness of the algorithm. Finally, the introduction of the classification loss item allows our model to effectively fit the supervised scene. Five common datasets are used to evaluate the performance of AOLRE. The results show that the recognition accuracy and robustness of AOLRE are significantly better than those of several advanced FE algorithms, and the improvement rate ranges from 2% to 15%.

[1]  Jian Yang,et al.  Approximate Orthogonal Sparse Embedding for Dimensionality Reduction , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[2]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Anne Humeau-Heurtier,et al.  Texture Feature Extraction Methods: A Survey , 2019, IEEE Access.

[4]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[5]  Wai Keung Wong,et al.  Approximate Low-Rank Projection Learning for Feature Extraction , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[7]  David Zhang,et al.  A Multiple Maximum Scatter Difference Discriminant Criterion for Facial Feature Extraction , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Jie Zhang,et al.  Structure-Constrained Low-Rank Representation , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Jian Yang,et al.  BDPCA plus LDA: a novel fast feature extraction technique for face recognition , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Zhang Yi,et al.  Connections Between Nuclear-Norm and Frobenius-Norm-Based Representations , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[11]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[12]  Yan Liu,et al.  Weighted Schatten $p$ -Norm Minimization for Image Denoising and Background Subtraction , 2015, IEEE Transactions on Image Processing.

[13]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[14]  Jiashu Zhang,et al.  Discriminant Locality Preserving Projections Based on L1-Norm Maximization , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[18]  Wai Keung Wong,et al.  Low-Rank Embedding for Robust Image Feature Extraction , 2017, IEEE Transactions on Image Processing.

[19]  Mila Nikolova,et al.  Analysis of Half-Quadratic Minimization Methods for Signal and Image Recovery , 2005, SIAM J. Sci. Comput..

[20]  Wei-Yun Yau,et al.  Structured AutoEncoders for Subspace Clustering , 2018, IEEE Transactions on Image Processing.

[21]  M. Iqbal Saripan,et al.  A New Hybrid form of Krawtchouk and Tchebichef Polynomials: Design and Application , 2018, Journal of Mathematical Imaging and Vision.

[22]  Adrian E. Raftery,et al.  Model-Based Clustering, Discriminant Analysis, and Density Estimation , 2002 .

[23]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[24]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[26]  Zhi-Quan Luo,et al.  Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems , 2014, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Jonathan J. Hull,et al.  A Database for Handwritten Text Recognition Research , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization with Application to Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Basheer Alwaely,et al.  Graph Spectral Domain Feature Learning With Application to in-Air Hand-Drawn Number and Shape Recognition , 2019, IEEE Access.

[30]  Larry S. Davis,et al.  Learning Structured Low-Rank Representations for Image Classification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[32]  Lipeng Gao,et al.  Fusion Image Based Radar Signal Feature Extraction and Modulation Recognition , 2019, IEEE Access.

[33]  Handong Zhao,et al.  Learning Fast Low-Rank Projection for Image Classification , 2016, IEEE Transactions on Image Processing.

[34]  W. Wong,et al.  Supervised optimal locality preserving projection , 2012, Pattern Recognit..

[35]  Jinhui Tang,et al.  Constructing a Nonnegative Low-Rank and Sparse Graph With Data-Adaptive Features , 2014, IEEE Transactions on Image Processing.

[36]  Ivica Kopriva,et al.  𝓁0-Motivated Low-Rank Sparse Subspace Clustering , 2018, ArXiv.

[37]  Sadiq H. Abdulhussain,et al.  On the computational aspects of Charlier polynomials , 2020 .

[38]  Yanwei Pang,et al.  Learning Regularized LDA by Clustering , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Hanqing Lu,et al.  Improving kernel Fisher discriminant analysis for face recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Yousef Saad,et al.  Orthogonal Neighborhood Preserving Projections: A Projection-Based Dimensionality Reduction Technique , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Zhang Yi,et al.  Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering , 2012, IEEE Transactions on Cybernetics.

[42]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[43]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[45]  Sadiq H. Abdulhussain,et al.  On Computational Aspects of Krawtchouk Polynomials for High Orders , 2020, J. Imaging.

[46]  Shuicheng Yan,et al.  Latent Low-Rank Representation for subspace segmentation and feature extraction , 2011, 2011 International Conference on Computer Vision.

[47]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[49]  Wei Chen,et al.  Robust subspace clustering based on non-convex low-rank approximation and adaptive kernel , 2020, Inf. Sci..

[50]  Lu Liu,et al.  Exact minimum rank approximation via Schatten p-norm minimization , 2014, J. Comput. Appl. Math..

[51]  Yun Fu,et al.  Learning Balanced and Unbalanced Graphs via Low-Rank Coding , 2015, IEEE Transactions on Knowledge and Data Engineering.

[52]  Zhenwen Ren,et al.  Robust low-rank kernel multi-view subspace clustering based on the Schatten p-norm and correntropy , 2019, Inf. Sci..

[53]  Haesun Park,et al.  A parallel algorithm for the unbalanced orthogonal Procrustes problem , 1991, Parallel Comput..

[54]  Lei Feng,et al.  Human Motion Segmentation via Robust Kernel Sparse Subspace Clustering , 2018, IEEE Transactions on Image Processing.