Multi-manifold modeling for head pose estimation

In this paper, we study the identity-independent head pose estimation problem, in order to handle the appearance variations, we consider the pose data lying on multiple manifolds. We present a novel manifold clustering method to construct multiple manifolds each of which characterizes the underlying subspace of some subjects. We first construct a set of n-simplexes of subjects by using the similarity of pose images. Then, we present a supervised method to obtain a low-dimensional manifold embedding for each n-simplex. Finally, we propose the K-manifold clustering method, integrating manifold embedding and clustering, to make each learned manifold with unique geometric structure. The experimental results on a standard database demonstrate that our method is robust to variations of identities and achieves high pose estimation accuracy.

[1]  Sethuraman Panchanathan,et al.  Biased Manifold Embedding: A Framework for Person-Independent Head Pose Estimation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Robert D. Nowak,et al.  Multi-Manifold Semi-Supervised Learning , 2009, AISTATS.

[3]  Guangliang Chen,et al.  Spectral Curvature Clustering (SCC) , 2009, International Journal of Computer Vision.

[4]  Ruigang Yang,et al.  Illumination and Person-Insensitive Head Pose Estimation Using Distance Metric Learning , 2008, ECCV.

[5]  Yun Fu,et al.  Graph embedded analysis for head pose estimation , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[6]  Nasir M. Rajpoot,et al.  Unsupervised Learning of Shape Manifolds , 2007, BMVC.

[7]  Allen Y. Yang,et al.  Estimation of Subspace Arrangements with Applications in Modeling and Segmenting Mixed Data , 2008, SIAM Rev..

[8]  Robert Pless,et al.  Manifold clustering , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  Hongtao Lu,et al.  Smooth Multi-Manifold Embedding for Robust Identity-Independent Head Pose Estimation , 2009, CAIP.

[10]  R. Ho Algebraic Topology , 2022 .

[11]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Sethuraman Panchanathan,et al.  A methodology for evaluating robustness of face recognition algorithms with respect to variations in pose angle and illumination angle , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[13]  Shuicheng Yan,et al.  Synchronized Submanifold Embedding for Person-Independent Pose Estimation and Beyond , 2009, IEEE Transactions on Image Processing.

[14]  Robert M. Haralick,et al.  Nonlinear Manifold Clustering By Dimensionality , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  Theo Gevers,et al.  Robustifying eye center localization by head pose cues , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.