A fast approach for dimensionality reduction with image data

An important objective in image analysis is dimensionality reduction. The most often used data-exploratory technique with this objective is principal component analysis, which performs a singular value decomposition on a data matrix of vectorized images. When considering an array data or tensor instead of a matrix, the high-order generalization of PCA for computing principal components offers multiple ways to decompose tensors orthogonally. As an alternative, we propose a new method based on the projection of the images as matrices and show that it leads to a better reconstruction of images than previous approaches.

[1]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Jian Yang,et al.  From image vector to matrix: a straightforward image projection technique - IMPCA vs. PCA , 2002, Pattern Recognit..

[3]  Demetri Terzopoulos,et al.  Multilinear Analysis of Image Ensembles: TensorFaces , 2002, ECCV.

[4]  L. Tucker,et al.  Some mathematical notes on three-mode factor analysis , 1966, Psychometrika.

[5]  J. Leeuw,et al.  Principal component analysis of three-mode data by means of alternating least squares algorithms , 1980 .

[6]  B. Everitt,et al.  Three-Mode Principal Component Analysis. , 1986 .

[7]  H. Bierens,et al.  Non-linear regression with discrete explanatory variables, with an application to the earnings function , 1988 .

[8]  R. Christensen Linear Models for Multivariate, Time Series, and Spatial Data , 1997 .

[9]  P. Schönemann,et al.  Fitting one matrix to another under choice of a central dilation and a rigid motion , 1970 .

[10]  D. Burdick An introduction to tensor products with applications to multiway data analysis , 1995 .

[11]  Marian Stewart Bartlett,et al.  Independent components of face images : A representation for face recognition , 1997 .

[12]  H. Abdi,et al.  Principal Component and Neural Network Analyses of Face Images: What Can Be Generalized in Gender Classification? , 1997, Journal of mathematical psychology.

[13]  J. Gower Generalized procrustes analysis , 1975 .

[14]  Juyang Weng,et al.  Using Discriminant Eigenfeatures for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  N. L. Johnson,et al.  Multivariate Analysis , 1958, Nature.

[16]  Marcus J. Nadenau,et al.  Localization and Shape Normalization for Face Recognition , 1997 .

[17]  H. Neudecker,et al.  An approach ton-mode components analysis , 1986 .

[18]  Pieter M. Kroonenberg,et al.  Gram-Schmidt versus Bauer-Rutishauser in alternating least-squares algorithms for three-mode principal component analysis , 1989 .

[19]  C. Goodall Procrustes methods in the statistical analysis of shape , 1991 .

[20]  Jianxin Wu,et al.  Face recognition with one training image per person , 2002, Pattern Recognit. Lett..

[21]  Pieter M. Kroonenberg,et al.  Three-mode principal component analysis : theory and applications , 1983 .

[22]  Rasmus Bro,et al.  Improving the speed of multi-way algorithms:: Part I. Tucker3 , 1998 .

[23]  Manfred Deistler,et al.  Linear Models for Multivariate Time Series , 2006 .

[24]  Amnon Shashua,et al.  Linear image coding for regression and classification using the tensor-rank principle , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[25]  Paul J. Gemperline,et al.  Eliminating complex eigenvectors and eigenvalues in multiway analyses using the direct trilinear decomposition method , 1993 .

[26]  Forrest W. Young,et al.  Component models for three-way data: An alternating least squares algorithm with optimal scaling features , 1980 .

[27]  H. Bierens,et al.  Nonlineair regression with discrete explanatory variables , 1988 .

[28]  Tamara G. Kolda,et al.  Orthogonal Tensor Decompositions , 2000, SIAM J. Matrix Anal. Appl..

[29]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.