3D head pose estimation using support vector machines and physics-based deformable surfaces

This paper presents a novel approach for estimating 3D head pose in single-view video sequences. Following initialization by a face detector, a tracking technique that utilizes a 3D deformable surface model to approximate the image intensity is used to track the face in the video sequence. Head pose estimation is performed by using a feature vector which is a by-product of the equations that govern the deformation of the surface model used in the tracking. The afore-mentioned vector is used for training support vector machines (SVM) in order to estimate the 3D head pose. The proposed method was applied to IDIAP head pose estimation database. The obtained results show that the proposed method can achieve an accuracy of 82% if angles are estimated in 10deg increments and 75% if angle are estimated in 5deg increments.

[1]  I. Pitas,et al.  Reconstruction of serially acquired slices using physics-based modeling , 2003, IEEE Transactions on Information Technology in Biomedicine.

[2]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[3]  Jean-Marc Odobez,et al.  Evaluation of Multiple Cue Head Pose Estimation Algorithms in Natural Environements , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[4]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[5]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[6]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[7]  Alex Pentland,et al.  A Bayesian similarity measure for direct image matching , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[8]  Lisa M. Brown,et al.  Comparative study of coarse head pose estimation , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[9]  Ioannis Pitas,et al.  Feature-based tracking using 3D physics-based deformable surfaces , 2005, 2005 13th European Signal Processing Conference.

[10]  Nicholas Ayache,et al.  Frequency-Based Nonrigid Motion Analysis: Application to Four Dimensional Medical Images , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[12]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .