Fast and Accurate Face Orientation Measurement in Low-resolution Images on Embedded Hardware

In numerous applications it is important to collect information about the gaze orientation or head-angle of a person. Examples are measuring the alertness of a car driver to see if he is still awake, or the attentiveness of people crossing a street to see if they noticed the cars driving by. In our own application we want to apply cinematographic rules (e.g. the rule of thirds where a face should be positioned left or right in the frame depending on the gaze direction) on images taken from an Unmanned Aerial Vehicle (UAV). For this an accurate estimation of the angle of the head is needed. These applications should run on embedded hardware so that they can be easily attached to e.g. a car or a UAV. This implies that the head angle detection algorithm should run in real-time on minimal hardware. Therefore we developed an approach that runs in real-time on embedded hardware while achieving excellent accuracy. We demonstrated these approaches on both a publicly available face dataset and our own dataset recorded from a UAV.

[1]  Eike Rehder,et al.  Head detection and orientation estimation for pedestrian safety , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[2]  Toon Goedemé,et al.  Autonomous Lecture Recording with a PTZ Camera While Complying with Cinematographic Rules , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[3]  Luc Van Gool,et al.  Real time 3D head pose estimation: Recent achievements and future challenges , 2012, 2012 5th International Symposium on Communications, Control and Signal Processing.

[4]  Luc Van Gool,et al.  Real time head pose estimation with random regression forests , 2011, CVPR 2011.

[5]  Yi Jiang,et al.  Supervised locality discriminant manifold learning for head pose estimation , 2014, Knowl. Based Syst..

[6]  Yanlei Gu,et al.  Estimation of Pedestrian Pose and Orientation Using on-Board Camera with Histograms of Oriented Gradients Features , 2014, International Journal of Intelligent Transportation Systems Research.

[7]  Takehisa Yairi,et al.  Human Head Pose Estimation and Its Application in Unmanned Aerial Vehicle Control , 2015 .

[8]  J. Crowley,et al.  Estimating Face orientation from Robust Detection of Salient Facial Structures , 2004 .

[9]  Mohan M. Trivedi,et al.  Continuous Head Movement Estimator for Driver Assistance: Issues, Algorithms, and On-Road Evaluations , 2014, IEEE Transactions on Intelligent Transportation Systems.

[10]  Thomas P. Karnowski,et al.  Baseline face detection, head pose estimation, and coarse direction detection for facial data in the SHRP2 naturalistic driving study , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Ian D. Reid,et al.  Colour Invariant Head Pose Classification in Low Resolution Video , 2008, BMVC.

[13]  Rainer Stiefelhagen,et al.  Video-based pedestrian head pose estimation for risk assessment , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[14]  Nicole Vincent,et al.  Adaptive Haar-Like Features for Head Pose Estimation , 2014, ICIAR.

[15]  David Ndzi,et al.  Head Pose Estimation for Car Drivers , 2014 .

[16]  Tim K. Marks,et al.  Real-time head pose estimation and facial feature localization using a depth sensor and triangular surface patch features , 2022 .

[17]  Ian D. Reid,et al.  Guiding Visual Surveillance by Tracking Human Attention , 2009, BMVC.

[18]  Seong G. Kong,et al.  Visual Analysis of Eye State and Head Pose for Driver Alertness Monitoring , 2013, IEEE Transactions on Intelligent Transportation Systems.

[19]  Jiwen Lu,et al.  Ordinary Preserving Manifold Analysis for Human Age and Head Pose Estimation , 2013, IEEE Transactions on Human-Machine Systems.