Estimation of Driver Head Yaw Angle Using a Generic Geometric Model

Head yaw angle is an important indicator of a driver's distraction. Forward collision warning systems incorporate head yaw angle estimators for detecting driver's head-off-road glances. This paper presents a generic geometric model for head yaw estimation. The generic model is customized into 12 different models. The performance of the cylindrical and ellipsoidal models is improved by introducing nose projection and truncation. The yaw estimation problem is formulated using a single variable. This formulation provides better visualization of the cylindrical and ellipsoidal models. It is shown that the ellipsoidal model in literature is indeed a cylindrical model with nose projection. We have also proved that, under the ellipsoidal/cylindrical framework, the estimated yaw angle is independent of shifting the center of rotation along depth. Four previous works are shown as the customization of the proposed generic model. The performance of the proposed models are evaluated using four standard head pose datasets and an ADAS dataset. The proposed nose-projected truncated ellipsoidal model outperforms the state-of-the-art geometric models. Further, we have studied the impact of model parameters and inaccurate facial feature localization through simulation experiments.

[1]  Vincent Lepetit,et al.  3-D Head Tracking via Invariant Keypoint Learning , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Mohan M. Trivedi,et al.  Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness , 2010, IEEE Transactions on Intelligent Transportation Systems.

[3]  Jian-Gang Wang,et al.  EM enhancement of 3D head pose estimated by point at infinity , 2007, Image Vis. Comput..

[4]  Nicu Sebe,et al.  Combining Head Pose and Eye Location Information for Gaze Estimation , 2012, IEEE Transactions on Image Processing.

[5]  Hee-seung Choi,et al.  Single-view-based 3D facial reconstruction method robust against pose variations , 2015, Pattern Recognit..

[6]  J. Crowley,et al.  Estimating Face orientation from Robust Detection of Salient Facial Structures , 2004 .

[7]  Wenbin Li,et al.  Multi-manifold modeling for head pose estimation , 2010, 2010 IEEE International Conference on Image Processing.

[8]  Ioannis Pitas,et al.  Facial feature extraction and pose determination , 2000, Pattern Recognit..

[9]  Shiguang Shan,et al.  CovGa: A novel descriptor based on symmetry of regions for head pose estimation , 2014, Neurocomputing.

[10]  Hongbo Liu,et al.  Automatic Calibration Method for Driver's Head Orientation in Natural Driving Environment , 2013, IEEE Transactions on Intelligent Transportation Systems.

[11]  Andreas Riener,et al.  Head-Pose-Based Attention Recognition on Large Public Displays , 2014, IEEE Computer Graphics and Applications.

[12]  Chiraz BenAbdelkader.  Robust Head Pose Estimation Using Supervised Manifold Learning , 2010, ECCV.

[13]  Larry S. Davis,et al.  On partial least squares in head pose estimation: How to simultaneously deal with misalignment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Keiichi Uchimura,et al.  Driver Inattention Monitoring System for Intelligent Vehicles: A Review , 2009, IEEE Transactions on Intelligent Transportation Systems.

[15]  Shuicheng Yan,et al.  Regression From Uncertain Labels and Its Applications to Soft Biometrics , 2008, IEEE Transactions on Information Forensics and Security.

[16]  Bingpeng Ma,et al.  VoD: A novel image representation for head yaw estimation , 2015, Neurocomputing.

[17]  C. V. Jawahar,et al.  Near real-time face parsing , 2013, 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[18]  Daijin Kim,et al.  Robust head tracking using 3D ellipsoidal head model in particle filter , 2008, Pattern Recognit..

[19]  Hyun Seung Yang,et al.  Head pose estimation using image abstraction and local directional quaternary patterns for multiclass classification , 2014, Pattern Recognit. Lett..

[20]  Ying Wu,et al.  Locality Versus Globality: Query-Driven Localized Linear Models for Facial Image Computing , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Rainer Stiefelhagen,et al.  Neural Network-Based Head Pose Estimation and Multi-view Fusion , 2006, CLEAR.

[22]  Takeo Kanade,et al.  Pose Robust Face Tracking by Combining Active Appearance Models and Cylinder Head Models , 2007, International Journal of Computer Vision.

[23]  Marco La Cascia,et al.  Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Sethuraman Panchanathan,et al.  Person-Independent Head Pose Estimation Using Biased Manifold Embedding , 2008, EURASIP J. Adv. Signal Process..

[25]  Kang Ryoung Park,et al.  Real-Time Gaze Estimator Based on Driver's Head Orientation for Forward Collision Warning System , 2011, IEEE Transactions on Intelligent Transportation Systems.

[26]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Takahiro Okabe,et al.  Appearance-based head pose estimation with scene-specific adaptation , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[28]  Wen Gao,et al.  The CAS-PEAL Large-Scale Chinese Face Database and Baseline Evaluations , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[29]  Yukinori Yamada,et al.  Development of a New Pre-crash Safety System , 2006 .

[30]  Fei Su,et al.  Robust head pose estimation via Convex Regularized Sparse Regression , 2011, 2011 18th IEEE International Conference on Image Processing.

[31]  Wen Gao,et al.  Head Yaw Estimation From Asymmetry of Facial Appearance , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Kostas Karpouzis,et al.  Visual Focus of Attention in Non-calibrated Environments using Gaze Estimation , 2014, International Journal of Computer Vision.

[33]  Bingpeng Ma,et al.  Head Pose Estimation Using Simple Local Gabor Binary Pattern , 2011, CCBR.

[34]  Yi Jiang,et al.  Supervised locality discriminant manifold learning for head pose estimation , 2014, Knowl. Based Syst..

[35]  Rama Chellappa,et al.  Automatic head pose estimation using randomly projected dense SIFT descriptors , 2012, 2012 19th IEEE International Conference on Image Processing.

[36]  Ioan Marius Bilasco,et al.  Head pose estimation based on face symmetry analysis , 2015, Signal Image Video Process..

[37]  Vijayan K. Asari,et al.  A Two-Layer Framework for Piecewise Linear Manifold-Based Head Pose Estimation , 2012, International Journal of Computer Vision.

[38]  Yuxiao Hu,et al.  Head Pose Estimation in Seminar Room Using Multi View Face Detectors , 2006, CLEAR.

[39]  Xiaoqing Ding,et al.  Person-independent head pose estimation based on random forest regression , 2010, 2010 IEEE International Conference on Image Processing.

[40]  Yong Liu,et al.  Supervised sparse manifold regression for head pose estimation in 3D space , 2015, Signal Process..

[41]  Chao Wang,et al.  Robust head pose estimation via supervised manifold learning , 2014, Neural Networks.

[42]  Takahiro Okabe,et al.  Head direction estimation from low resolution images with scene adaptation , 2013, Comput. Vis. Image Underst..

[43]  Weiwei Guo,et al.  Tensor Learning for Regression , 2012, IEEE Transactions on Image Processing.

[44]  Kamal Bijlani,et al.  Yaw Estimation Using Cylindrical and Ellipsoidal Face Models , 2014, IEEE Transactions on Intelligent Transportation Systems.

[45]  Seong G. Kong,et al.  Visual Analysis of Eye State and Head Pose for Driver Alertness Monitoring , 2013, IEEE Transactions on Intelligent Transportation Systems.

[46]  Javier R. Movellan,et al.  Monocular head pose estimation using generalized adaptive view-based appearance model , 2010, Image Vis. Comput..

[47]  Shuicheng Yan,et al.  Synchronized Submanifold Embedding for Person-Independent Pose Estimation and Beyond , 2009, IEEE Transactions on Image Processing.

[48]  Noelia Hernández,et al.  Gaze Fixation System for the Evaluation of Driver Distractions Induced by IVIS , 2012, IEEE Transactions on Intelligent Transportation Systems.

[49]  Ruigang Yang,et al.  Illumination and Person-Insensitive Head Pose Estimation Using Distance Metric Learning , 2008, ECCV.

[50]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Yun Fu,et al.  Human Age Estimation With Regression on Discriminative Aging Manifold , 2008, IEEE Transactions on Multimedia.

[52]  Pedro Jiménez,et al.  RSMAT: Robust simultaneous modeling and tracking , 2010, Pattern Recognit. Lett..

[53]  Jiwen Lu,et al.  Ordinary Preserving Manifold Analysis for Human Age and Head Pose Estimation , 2013, IEEE Transactions on Human-Machine Systems.

[54]  Jorge Batista,et al.  A Real-Time Driver Visual Attention Monitoring System , 2005, IbPRIA.

[55]  Mark S. Nixon,et al.  On Using Gait to Enhance Frontal Face Extraction , 2012, IEEE Transactions on Information Forensics and Security.

[56]  Qiang Ji,et al.  3D Face pose estimation and tracking from a monocular camera , 2002, Image Vis. Comput..