Spatial regularization in subspace learning for face recognition: implicit vs. explicit

In applying traditional statistical method to face recognition, each original face image is often vectorized as a vector. But such a vectorization not only leads to high-dimensionality, thus small sample size (SSS) problem, but also loses the original spatial relationship between image pixels. It has been proved that spatial regularization (SR) is an effective means to compensate the loss of such relationship and at the same time, and mitigate SSS problem by explicitly imposing spatial constraints. However, SR still suffers from two main problems: one is high computational cost due to high dimensionality and the other is the selection of the key regularization factors controlling the spatial regularization and thus learning performance. Accordingly, in this paper, we provide a new idea, coined as implicit spatial regularization (ISR), to avoid losing the spatial relationship between image pixels and deal with SSS problem simultaneously for face recognition. Different from explicit spatial regularization (ESR), which introduces directly spatial regularization term and is based on vector representation, the proposed ISR constrains spatial smoothness within each small image region by reshaping image and then executing 2D-based feature extraction methods. Specifically, we follow the same assumption as made in SSSL (a typical ESR method) that a small image region around an image pixel is smooth, and reshape each original image into a new matrix whose each column corresponds to a vectorized small image region, and then we extract features from the newly-formed matrix using any off-the-shelf 2D-based method which can take the relationship between pixels in the same row or column into account, such that the original spatial relationship within the neighboring region can be greatly retained. Since ISR does not impose constraint items, compared with ESR, ISR not only avoids the selection of the troublesome regularization parameter, but also greatly reduces computational cost. Experimental results on four face databases show that the proposed ISR can achieve competitive performance as SSSL but with lower computational cost.

[1]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[2]  Wei Jia,et al.  Discriminant sparse neighborhood preserving embedding for face recognition , 2012, Pattern Recognit..

[3]  Stephen Lin,et al.  Element Rearrangement for Tensor-Based Subspace Learning , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  David Zhang,et al.  Spatially Smooth Subspace Face Recognition Using LOG and DOG Penalties , 2009, ISNN.

[5]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[6]  Jieping Ye,et al.  Two-Dimensional Linear Discriminant Analysis , 2004, NIPS.

[7]  Jean Hennebert,et al.  Content-Based Image Retrieval with LIRe and SURF on a Smartphone-Based Product Image Database , 2014, MCPR.

[8]  Jiawei Han,et al.  Subspace Learning Based on Tensor Analysis , 2005 .

[9]  Stephen Lin,et al.  Marginal Fisher Analysis and Its Variants for Human Gait Recognition and Content- Based Image Retrieval , 2007, IEEE Transactions on Image Processing.

[10]  R. Chellappa Introduction of New Editor-in-Chief , 2005 .

[11]  Deng Cai,et al.  Tensor Subspace Analysis , 2005, NIPS.

[12]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[13]  Quan Hong,et al.  Sub-pattern Canonical Correlation Analysis with Application in Face Recognition: Sub-pattern Canonical Correlation Analysis with Application in Face Recognition , 2008 .

[14]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Mansoor Zolghadri Jahromi,et al.  Block-wise two-directional 2DPCA with ensemble learning for face recognition , 2013, Neurocomputing.

[16]  Hwann-Tzong Chen,et al.  Local discriminant embedding and its variants , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Chiou-Shann Fuh,et al.  Learning effective image metrics from few pairwise examples , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[18]  Andrew Beng Jin Teoh,et al.  Locality Regularization Embedding for face verification , 2015, Pattern Recognit..

[19]  Dewen Hu,et al.  Comment on: "Two-dimensional locality preserving projections (2DLPP) with its application to palmprint recognition" , 2008, Pattern Recognit..

[20]  Ming Li,et al.  2D-LDA: A statistical linear discriminant analysis for image matrix , 2005, Pattern Recognit. Lett..

[21]  Hanspeter Pfister,et al.  Trainable Convolution Filters and Their Application to Face Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[23]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[24]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[25]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[26]  Zilan Hu,et al.  Comment on: "Two-dimensional locality preserving projections (2DLPP) with its application to palmprint recognition" , 2008, Pattern Recognit..

[27]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[28]  Xinlei Chen,et al.  Spatially correlated nonnegative matrix factorization , 2014, Neurocomputing.

[29]  Jieping Ye,et al.  Generalized Low Rank Approximations of Matrices , 2004, Machine Learning.

[30]  Xindong Wu,et al.  3-D Object Retrieval With Hausdorff Distance Learning , 2014, IEEE Transactions on Industrial Electronics.

[31]  Daoqiang Zhang,et al.  Feature extraction approaches based on matrix pattern: MatPCA and MatFLDA , 2005, Pattern Recognit. Lett..

[32]  Yuxiao Hu,et al.  Learning a Spatially Smooth Subspace for Face Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Xiaoou Tang,et al.  Tensor linear Laplacian discrimination (TLLD) for feature extraction , 2009, Pattern Recognit..

[34]  Pavel Pudil,et al.  Introduction to Statistical Pattern Recognition , 2006 .

[35]  Hong Quan Sub-pattern Canonical Correlation Analysis with Application in Face Recognition , 2008 .

[36]  Feiping Nie,et al.  Learning an Orthogonal and Smooth Subspace for Image Classification , 2009, IEEE Signal Processing Letters.