Sparse factorial code representation using independent component analysis for face recognition

This paper presents a new face recognition method based on Independent Component Analysis (ICA), named Sparse Factorial Code Representation (SFCR). The SFCR employs the architecture II of ICA (ICAII) to achieve sparse facial codes, which seeks for a representation that generates encoding coefficients with the statistically independent property, i.e., factorial coding. In ICAII the coefficients of training samples are ‘natural’ sparse, but coefficients for test samples are not as sparse as that of training samples according to comprehensive experimental results. We believe that the generating process of the latter is contaminated by projection matrixes of the training samples which do not contain any information about the test samples, which makes the coefficients encoding non-consistency. As a result, the small values in the non-sparse encoding coefficients of a test sample, which are caused by noise and usually influence the representation of independent components, will increase the probability of misclassification in the recognition of facial patterns. To ensure the sparsity of the coefficients of test samples and encoding consistency, l1 -norm optimization based sparse constraint technology is employed in SFCR. The SFCR is evaluated on several public available datasets such as AR, ORL, Extended-Yale B, FERET, and LFW databases. The experimental results demonstrate the good performance of our method.

[1]  Bruce A. Draper,et al.  Recognizing faces with PCA and ICA , 2003, Comput. Vis. Image Underst..

[2]  Zhigang Luo,et al.  Two-Dimensional Euler PCA for Face Recognition , 2015, MMM.

[3]  Jian-Xun Mi,et al.  A Comparative Study of Two Independent Component Analysis Using Reference Signal Methods , 2012, ICIC.

[4]  David Zhang,et al.  Collaborative Representation based Classification for Face Recognition , 2012, ArXiv.

[5]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[6]  Jian Yang,et al.  Is ICA significantly better than PCA for face recognition? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[8]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[9]  Jian Yang,et al.  A Two-Phase Test Sample Sparse Representation Method for Use With Face Recognition , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Seungjin Choi,et al.  Factorial Code Representation of Faces for Recognition , 2000, Biologically Motivated Computer Vision.

[11]  Fatma Zohra Chelali,et al.  Linear discriminant analysis for face recognition , 2009, 2009 International Conference on Multimedia Computing and Systems.

[12]  Chengjun Liu,et al.  Learning the face space-representation and recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  Michael Elad,et al.  Double Sparsity: Learning Sparse Dictionaries for Sparse Signal Approximation , 2010, IEEE Transactions on Signal Processing.

[14]  Huaguang Zhang,et al.  Motif discoveries in unaligned molecular sequences using self-organizing neural networks , 2006, IEEE Trans. Neural Networks.

[15]  P O Hoyer,et al.  Independent component analysis applied to feature extraction from colour and stereo images , 2000, Network.

[16]  Chengjun Liu,et al.  Independent component analysis of Gabor features for face recognition , 2003, IEEE Trans. Neural Networks.

[17]  Hossein Mobahi,et al.  Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[19]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[20]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[21]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[23]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[25]  Tiziana D'Orazio,et al.  Face Recognition by Kernel Independent Component Analysis , 2005, IEA/AIE.

[26]  Witold Pedrycz,et al.  Face Recognition Using an Enhanced Independent Component Analysis Approach , 2007, IEEE Transactions on Neural Networks.

[27]  Tieniu Tan,et al.  Half-Quadratic-Based Iterative Minimization for Robust Sparse Representation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  John Wright,et al.  Computation and Relaxation of Conditions for Equivalence between ` 1 and ` 0 Minimization ∗ , 2007 .

[29]  Hamid Soltanian-Zadeh,et al.  Face recognition: A Sparse Representation-based Classification using Independent Component Analysis , 2012, 6th International Symposium on Telecommunications (IST).

[30]  Allen Y. Yang,et al.  Fast ℓ1-minimization algorithms and an application in robust face recognition: A review , 2010, 2010 IEEE International Conference on Image Processing.

[31]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[32]  Jian-Xun Mi,et al.  A Novel Algorithm for Independent Component Analysis with Reference and Methods for Its Applications , 2014, PloS one.

[33]  Jian Yang,et al.  Kernel ICA: An alternative formulation and its application to face recognition , 2005, Pattern Recognit..

[34]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Jian-Huang Lai,et al.  Face representation using independent component analysis , 2002, Pattern Recognit..

[36]  Larry S. Davis,et al.  Label Consistent K-SVD: Learning a Discriminative Dictionary for Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Likun Huang,et al.  Face recognition based on image sets , 2014 .

[38]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Ji-Huan He Homotopy perturbation technique , 1999 .

[40]  Lei Zhang,et al.  Metaface learning for sparse representation based face recognition , 2010, 2010 IEEE International Conference on Image Processing.

[41]  Haibo He,et al.  Learning Race from Face: A Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Juwei Lu,et al.  Face recognition using feature optimization and /spl nu/-support vector learning , 2001, Neural Networks for Signal Processing XI: Proceedings of the 2001 IEEE Signal Processing Society Workshop (IEEE Cat. No.01TH8584).

[43]  Soo-Young Lee,et al.  Discriminant Independent Component Analysis , 2011, IEEE Trans. Neural Networks.

[44]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[45]  Bülent Sankur,et al.  Feature selection in the independent component subspace for face recognition , 2004, Pattern Recognit. Lett..

[46]  Stan Z. Li,et al.  Learning multiview face subspaces and facial pose estimation using independent component analysis , 2005, IEEE Transactions on Image Processing.

[47]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[48]  Xudong Jiang,et al.  Sparse and Dense Hybrid Representation via Dictionary Decomposition for Face Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[50]  Jian Yang,et al.  Regularized Robust Coding for Face Recognition , 2012, IEEE Transactions on Image Processing.

[51]  Peng Zhao,et al.  On Model Selection Consistency of Lasso , 2006, J. Mach. Learn. Res..

[52]  Yong Xu,et al.  A comparative study and improvement of two ICA using reference signal methods , 2014, Neurocomputing.

[53]  Erkki Oja,et al.  Efficient Variant of Algorithm FastICA for Independent Component Analysis Attaining the CramÉr-Rao Lower Bound , 2006, IEEE Transactions on Neural Networks.

[54]  David Zhang,et al.  Sequential row-column independent component analysis for face recognition , 2009, Neurocomputing.

[55]  Ehud Rivlin,et al.  On the Equivalence of the LC-KSVD and the D-KSVD Algorithms. , 2017, IEEE transactions on pattern analysis and machine intelligence.

[56]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Jian Sun,et al.  Product Sparse Coding , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[58]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[59]  Donghui Wang,et al.  A classification-oriented dictionary learning model: Explicitly learning the particularity and commonality across categories , 2014, Pattern Recognit..

[60]  H. Wechsler,et al.  Comparative Assessment of Independent Component Analysis (ICA) for Face Recognition , 1999 .

[61]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[62]  Allen Y. Yang,et al.  Single-Sample Face Recognition with Image Corruption and Misalignment via Sparse Illumination Transfer , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[63]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  A. Martínez,et al.  The AR face databasae , 1998 .

[65]  Jongsun Kim,et al.  Effective representation using ICA for face recognition robust to local distortion and partial occlusion , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Yannick Deville,et al.  Extension of EFICA algorithm for blind separation of piecewise stationary non Gaussian sources , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[68]  Pawan Sinha,et al.  Face Recognition by Humans: Nineteen Results All Computer Vision Researchers Should Know About , 2006, Proceedings of the IEEE.

[69]  Mubarak Shah,et al.  Face Recognition in Movie Trailers via Mean Sequence Sparse Representation-Based Classification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[70]  P. Tichavský,et al.  Efficient variant of algorithm fastica for independent component analysis attaining the cramer-RAO lower bound , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[71]  Vytautas Perlibakas,et al.  Distance measures for PCA-based face recognition , 2004, Pattern Recognit. Lett..

[72]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[73]  Yaakov Tsaig,et al.  Fast Solution of $\ell _{1}$ -Norm Minimization Problems When the Solution May Be Sparse , 2008, IEEE Transactions on Information Theory.