Head pose estimation by regression algorithm

Abstract Head pose estimation is a very in-depth topic in the context of biometric recognition, especially in video surveillance, because the rotation of the head can affect the recognition of some features of the face. Being able to recognize in advance the pose of the head in pitch, yaw and roll enable frontalization or the extraction of a frame in which a face is frontal in order to allow a more accurate recognition. In this work the Web-Shaped Model algorithm is used for a coding of the pose of the face and then we apply regression algorithms to predict the pose of the face. The proposed approach stimulates the sensitivity of the regression methods to identify the head pose estimation. The goals is to predict the value of the dependent variable for the three angular values, for which some information relating to the explanatory variables is available, in order to estimate the effect on the dependent variable. The presented method is tested on some of the most well-known datasets for the head pose estimation as Biwi, AFLW2000 and Pointing’04 and compared with the various state of the art methods that use these datasets.

[1]  Radu Horaud,et al.  Robust Head-Pose Estimation Based on Partially-Latent Mixture of Linear Regressions , 2016, IEEE Transactions on Image Processing.

[2]  Andrea F. Abate,et al.  Near Real-Time Three Axis Head Pose Estimation Without Training , 2019, IEEE Access.

[3]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[4]  Hong Liu,et al.  Online person orientation estimation based on classifier update , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[5]  Yung-Yu Chuang,et al.  FSA-Net: Learning Fine-Grained Structure Aggregation for Head Pose Estimation From a Single Image , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  M. Pontil,et al.  Machine Learning for Cultural Heritage: A Survey , 2020, Pattern Recognit. Lett..

[7]  James M. Rehg,et al.  Fine-Grained Head Pose Estimation Without Keypoints , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Donghoon Lee,et al.  Fast and Accurate Head Pose Estimation via Random Projection Forests , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Rama Chellappa,et al.  KEPLER: Keypoint and Pose Estimation of Unconstrained Faces by Learning Efficient H-CNN Regressors , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[10]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[11]  Michael E. Tipping.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[12]  Luc Van Gool,et al.  Random Forests for Real Time 3D Face Analysis , 2012, International Journal of Computer Vision.

[13]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[14]  Peng Wang,et al.  Appearance based pedestrians' head pose and body orientation estimation using deep learning , 2018, Neurocomputing.

[15]  Wei Liang,et al.  A deep Coarse-to-Fine network for head pose estimation from synthetic data , 2019, Pattern Recognit..

[16]  Seong G. Kong,et al.  Head Pose Estimation From a 2D Face Image Using 3D Face Morphing With Depth Parameters , 2015, IEEE Transactions on Image Processing.

[17]  Michael J. Jones,et al.  Real-time 3D head pose and facial landmark estimation from depth images using triangular surface patch features , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Doina Precup,et al.  Probabilistic Temporal Head Pose Estimation Using a Hierarchical Graphical Model , 2014, ECCV.

[20]  Radu Horaud,et al.  Head pose estimation via probabilistic high-dimensional regression , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[21]  Michele Nappi,et al.  Measuring sample distortions in face recognition , 2010, MiFor '10.

[22]  James L. Crowley,et al.  Head Pose Estimation on Low Resolution Images , 2006, CLEAR.

[23]  Sheng Wan,et al.  QuatNet: Quaternion-Based Head Pose Estimation With Multiregression Loss , 2019, IEEE Transactions on Multimedia.

[24]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[26]  Michele Nappi,et al.  Web-Shaped Model for Head Pose Estimation: An Approach for Best Exemplar Selection , 2020, IEEE Transactions on Image Processing.

[27]  Zhe L. Lin,et al.  Nonparametric Context Modeling of Local Appearance for Pose- and Expression-Robust Facial Landmark Localization , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  In-So Kweon,et al.  Real-time head pose estimation using multi-task deep neural network , 2018, Robotics Auton. Syst..

[29]  Takahiro Okabe,et al.  Appearance-based head pose estimation with scene-specific adaptation , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[30]  Xiaoming Liu,et al.  Face Alignment in Full Pose Range: A 3D Total Solution , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Horst Bischof,et al.  Annotated Facial Landmarks in the Wild: A large-scale, real-world database for facial landmark localization , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[32]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[33]  Michal Kawulok,et al.  Head Pose Estimation Relying on Appearance-Based Nose Region Analysis , 2014, ICCVG.

[34]  H. Abdi.  Partial Least Square Regression PLS-Regression , 2007 .

[35]  Rama Chellappa,et al.  HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.