Subspace Regression : Predicting a Subspace from One Sample

Subspace methods have been extensively used to solve a variety of problems in computer vision including object detection, recognition, and tracking. Typically, subspaces are learned from a training set that contains different configurations of a particular object (e.g., variations on shape or appearance). However, in some situations it is not possible to have access to data with multiple configurations of an object. For instance, consider the problem of predicting a person-specific subspace of the pose variation from only a frontal face image, by learning a mapping between frontal images and the corresponding pose subspaces in training samples. We refer to this problem as subspace regression. Subspace regression is a challenging problem for two main reasons: (i) it involves a mapping between high-dimensional spaces, (ii) it is unclear how to parameterize the mapping between one sample and a subspace. We propose four methods to learn a mapping from one sample to a subspace: Individual Mapping on Images, Direct Mapping to Subspaces, Regression on Subspaces, and Direct Subspace Alignment. We show the validity of our approaches to build a person-specific face subspace of pose or illumination, and its applications to face tracking and recognition.

[1]  S. Zamir,et al.  Lower Rank Approximation of Matrices by Least Squares With Any Choice of Weights , 1979 .

[2]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[3]  Petre Stoica,et al.  Maximum likelihood parameter and rank estimation in reduced-rank multivariate linear regressions , 1996, IEEE Trans. Signal Process..

[4]  Michael J. Black,et al.  Dynamic coupled component analysis , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[6]  Horst Bischof,et al.  Illumination insensitive recognition using eigenspaces , 2004, Comput. Vis. Image Underst..

[7]  Michael J. Black,et al.  Eigentracking: Robust matching and tracking of objects using view - based representation , 1998 .

[8]  Liwei Wang,et al.  Intrapersonal subspace analysis with application to adaptive Bayesian face recognition , 2005, Pattern Recognit..

[9]  Tamás D. Gedeon,et al.  Learning-based Face Synthesis for Pose-Robust Recognition from Single Image , 2009, BMVC.

[10]  Sam T. Roweis,et al.  EM Algorithms for PCA and SPCA , 1997, NIPS.

[11]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[12]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[14]  Michael J. Black,et al.  A Framework for Robust Subspace Learning , 2003, International Journal of Computer Vision.

[15]  T. W. Anderson Estimating Linear Restrictions on Regression Coefficients for Multivariate Normal Distributions , 1951 .

[16]  Jonathan Warrell,et al.  Tied Factor Analysis for Face Recognition across Large Pose Differences , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[18]  Henry Schneiderman,et al.  Face View Synthesis Across Large Angles , 2005, AMFG.

[19]  Samy Bengio,et al.  On transforming statistical models for non-frontal face verification , 2006, Pattern Recognit..

[20]  P. Jonathon Phillips,et al.  Face recognition based on frontal views generated from non-frontal images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[22]  Juha Karhunen,et al.  Principal component neural networks — Theory and applications , 1998, Pattern Analysis and Applications.

[23]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[24]  G. Wahba,et al.  Some results on Tchebycheffian spline functions , 1971 .

[25]  Louis L. Scharf,et al.  The SVD and reduced rank signal processing , 1991, Signal Process..

[26]  C. O'Connor An introduction to multivariate statistical analysis: 2nd edn. by T. W. Anderson. 675 pp. Wiley, New York (1984) , 1987 .

[27]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[28]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[29]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[30]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.