Fast and Reliable Facial Landmarks Localization in Non Frontal Images

The goal of this paper is to introduce a pipeline able to precisely and rapidly localize a set of facial landmarks on a face image. The proposed method is also able to estimate the pose of the face portrayed on the image independently from its orientation and it is robust to partial occlusions. This method is based on an optimized version of Part Mixture Model, it is able to fit a facial landmarks configuration to faces dealing with out-of-plane rotations and is suitable for real time processing. Moreover, the proposed method also uses a double scale approach to speed up the pose estimation phase and a posteriori configuration regularization based on Principal Component Analysis (PCA).

[1]  Li-Jia Li,et al.  Multi-view Face Detection Using Deep Convolutional Neural Networks , 2015, ICMR.

[2]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[3]  Yi Yang,et al.  Articulated pose estimation with flexible mixtures-of-parts , 2011, CVPR 2011.

[4]  Michael C. Burl,et al.  Finding Faces in Cluttered Scenes Using Labeled Random Graph Matching. , 1995, ICCV 1995.

[5]  David J. Kriegman,et al.  Localizing parts of faces using a consensus of exemplars , 2011, CVPR.

[6]  Se-Young Oh,et al.  Automatic Extraction of Eye and Mouth Fields from a Face Image Using Eigenfeatures and Ensemble Networks , 2004, Applied Intelligence.

[7]  Stephen Milborrow.  The MUCT Landmarked Face Database , 2010 .

[8]  David A. Forsyth,et al.  Detecting, localizing and recovering kinematics of textured animals , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  J. Crowley,et al.  Estimating Face orientation from Robust Detection of Salient Facial Structures , 2004 .

[10]  Junjie Yan,et al.  Real-time high performance deformable model for face detection in the wild , 2013, 2013 International Conference on Biometrics (ICB).

[11]  Jian Sun,et al.  Face Alignment by Explicit Shape Regression , 2012, International Journal of Computer Vision.

[12]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[13]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[16]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.