Multilinear (Tensor) Image Synthesis, Analysis, and Recognition

Linear algebra, the algebra of vectors and matrices, has traditionally been a veritable workhorse in image processing. Linear algebraic methods such as principal components analysis (PCA) and its refinement known as independent components analysis (ICA) model single-factor linear variation in image formation or the linear combination of multiple sources. In this exploratory signal processing article, we review a novel, multilinear (tensor) algebraic framework for image processing, particularly for the synthesis, analysis, and recognition of images. In particular, we will discuss multilinear generalizations of PCA and ICA and present new applications of these tensorial methods to image-based rendering and the analysis and recognition of facial image ensembles.

[1]  J. Leeuw,et al.  Principal component analysis of three-mode data by means of alternating least squares algorithms , 1980 .

[2]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[3]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[4]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[5]  Joos Vandewalle,et al.  On the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors , 2000, SIAM J. Matrix Anal. Appl..

[6]  Demetri Terzopoulos,et al.  Multilinear image analysis for facial recognition , 2002, Object recognition supported by user interaction for service robots.

[7]  E. Oja,et al.  Independent Component Analysis , 2001 .

[8]  M. Alex O. Vasilescu,et al.  TensorTextures: multilinear image-based rendering , 2004, SIGGRAPH 2004.

[9]  Demetri Terzopoulos,et al.  Multilinear independent components analysis , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).