Low-Rank Latent Pattern Approximation With Applications to Robust Image Classification

This paper develops a novel method to address the structural noise in samples for image classification. Recently, regression-related classification methods have shown promising results when facing the pixelwise noise. However, they become weak in coping with the structural noise due to ignoring of relationships between pixels of noise image. Meanwhile, most of them need to implement the iterative process for computing representation coefficients, which leads to the high time consumption. To overcome these problems, we exploit a latent pattern model called low-rank latent pattern approximation (LLPA) to reconstruct the test image having structural noise. The rank function is applied to characterize the structure of the reconstruction residual between test image and the corresponding latent pattern. Simultaneously, the error between the latent pattern and the reference image is constrained by Frobenius norm to prevent overfitting. LLPA involves a closed-form solution by the virtue of a singular value thresholding operator. The provided theoretic analysis demonstrates that LLPA indeed removes the structural noise during classification task. Additionally, LLPA is further extended to the form of matrix regression by connecting multiple training samples, and alternating direction of multipliers method with Gaussian back substitution algorithm is used to solve the extended LLPA. Experimental results on several popular data sets validate that the proposed methods are more robust to image classification with occlusion and illumination changes, as compared to some existing state-of-the-art reconstruction-based methods and one deep neural network-based method.

[1]  Yuichiro Anzai,et al.  Pattern Recognition and Machine Learning , 1992, Springer US.

[2]  Zhi-Hua Zhou,et al.  Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft k-NN ensemble , 2005, IEEE Transactions on Neural Networks.

[3]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Yi Ma,et al.  Robust and Practical Face Recognition via Structured Sparsity , 2012, ECCV.

[5]  Rainer Stiefelhagen,et al.  Why Is Facial Occlusion a Challenging Problem? , 2009, ICB.

[6]  Changsheng Xu,et al.  Inductive Robust Principal Component Analysis , 2012, IEEE Transactions on Image Processing.

[7]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[8]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[10]  Shengcai Liao,et al.  Partial Face Recognition: Alignment-Free Approach , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[14]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[15]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Mohammed Bennamoun,et al.  Robust Regression for Face Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[17]  Jian Yang,et al.  Weighted sparse coding regularized nonconvex matrix regression for robust face recognition , 2017, Inf. Sci..

[18]  Li Zhang,et al.  Joint Low-Rank and Sparse Principal Feature Coding for Enhanced Robust Representation and Visual Classification , 2016, IEEE Transactions on Image Processing.

[19]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[20]  Shengcai Liao,et al.  Partial Face Recognition: Alignment-Free Approach , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[22]  David Zhang,et al.  Online Palmprint Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[24]  Stefanos Zafeiriou,et al.  Euler Principal Component Analysis , 2013, International Journal of Computer Vision.

[25]  Shuicheng Yan,et al.  Bilinear low-rank coding framework and extension for robust image recovery and feature representation , 2015, Knowl. Based Syst..

[26]  Kaleem Siddiqi,et al.  Removal of Partial Occlusion from Single Images , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Ran He,et al.  A Regularized Correntropy Framework for Robust Pattern Recognition , 2011, Neural Computation.

[28]  Chang-Tsun Li,et al.  Fixation and Saccade Based Face Recognition from Single Image per Person with Various Occlusions and Expressions , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[29]  Jian Yang,et al.  Robust sparse coding for face recognition , 2011, CVPR 2011.

[30]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[31]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[32]  Dao-Qing Dai,et al.  Structured Sparse Error Coding for Face Recognition With Occlusion , 2013, IEEE Transactions on Image Processing.

[33]  Qionghai Dai,et al.  Graph Laplace for Occluded Face Completion and Recognition , 2011, IEEE Transactions on Image Processing.

[34]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[35]  Feiping Nie,et al.  Robust Principal Component Analysis with Non-Greedy l1-Norm Maximization , 2011, IJCAI.

[36]  Chang-Tsun Li,et al.  Dynamic Image-to-Class Warping for Occluded Face Recognition , 2014, IEEE Transactions on Information Forensics and Security.

[37]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[38]  Shuicheng Yan,et al.  Similarity preserving low-rank representation for enhanced data representation and effective subspace learning , 2014, Neural Networks.

[39]  Ghassan Hamarneh,et al.  N-Sift: N-Dimensional Scale Invariant Feature Transform for Matching Medical Images , 2007, ISBI.

[40]  Jian Yang,et al.  Discriminative histograms of local dominant orientation (D-HLDO) for biometric image feature extraction , 2013, Pattern Recognit..

[41]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Zhi-Hua Zhou,et al.  Face Recognition Under Occlusions and Variant Expressions With Partial Similarity , 2009, IEEE Transactions on Information Forensics and Security.

[43]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Yin Wang,et al.  Self Scaled Regularized Robust Regression , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Ying Tai,et al.  Nuclear Norm Based Matrix Regression with Applications to Face Recognition with Occlusion and Illumination Changes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Z LiStan,et al.  Dynamic Image-to-Class Warping for Occluded Face Recognition , 2014 .

[47]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[48]  Bingsheng He,et al.  Linearized Alternating Direction Method with Gaussian Back Substitution for Separable Convex Programming , 2011 .

[49]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Shree K. Nayar,et al.  Attribute and simile classifiers for face verification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[51]  Shuicheng Yan,et al.  Latent Low-Rank Representation for subspace segmentation and feature extraction , 2011, 2011 International Conference on Computer Vision.

[52]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Jian Yang,et al.  Local Structure-Based Image Decomposition for Feature Extraction With Applications to Face Recognition , 2013, IEEE Transactions on Image Processing.

[54]  A. Martínez,et al.  The AR face databasae , 1998 .

[55]  Bingsheng He,et al.  The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent , 2014, Mathematical Programming.