Real-Time Head Pose Estimation on Mobile Platforms

Many computer vision applications such as augmented reality require head pose estimation. As far as the real-time implementation of head pose estimation on relatively resource limited mobile platforms is concerned, it is required to satisfy real-time constraints while maintaining reasonable head pose estimation accuracy. The introduced head pose estimation approach in this paper is an attempt to meet this objective. The approach consists of the following components: Viola-Jones face detection, color-based face tracking using an online calibration procedure, and head pose estimation using Hu moment features and Fisher linear discriminant. Experimental results running on an actual mobile device are reported exhibiting both the realtime and accuracy aspects of the developed approach.

[1]  Mohan M. Trivedi.  Human movement capture and analysis in intelligent environments , 2003, Machine Vision and Applications.

[2]  Nasser Kehtarnavaz,et al.  Real-time implementation of robust face detection on mobile platforms , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Pengfei Zhao,et al.  Cascade AdaBoost Classifiers with Stage Features Optimization for Cellular Phone Embedded Face Detection System , 2005, ICNC.

[4]  T. Kobayashi,et al.  A conversation robot using head gesture recognition as para-linguistic information , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[5]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[8]  Jianfeng Ren,et al.  Real-time optimization of Viola -Jones face detection for mobile platforms , 2008, 2008 IEEE Dallas Circuits and Systems Workshop: System-on-Chip - Design, Applications, Integration, and Software.

[9]  Simon Baker.  Real-time non-rigid driver head tracking for driver mental state estimation , 2004 .

[10]  R. Sivaramakrishna,et al.  Hu's moment invariants: how invariant are they under skew and perspective transformations? , 1997, IEEE WESCANEX 97 Communications, Power and Computing. Conference Proceedings.