Facial landmark configuration for improved detection

In this paper, we present two methods to improve the performance of landmark detection algorithms that are designed to detect individual landmarks. We focus on the landmark configuration module that takes the output of the individual landmark detectors and searches for a configuration of optimal landmark locations based on appropriate shape constraints. We design two configuration search approaches: (i) a multivariate conditional Gaussian-based model, and (ii) a MRF-based formulation with higher-order potentials. We evaluated the performance of our proposed methods using several state-of-the-art detectors, and consistently obtained improved performance.

[1]  Ioannis A. Kakadiaris,et al.  Markov Random Field-based fitting of a subdivision-based geometric atlas , 2011, 2011 International Conference on Computer Vision.

[2]  David A. McAllester,et al.  Cascade object detection with deformable part models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[4]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[5]  Vladimir Kolmogorov,et al.  Optimizing Binary MRFs via Extended Roof Duality , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Albert Ali Salah,et al.  3D Facial Feature Localization for Registration , 2006, MRCS.

[7]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[8]  David J. Kriegman,et al.  Localizing parts of faces using a consensus of exemplars , 2011, CVPR.

[9]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Thomas Vetter,et al.  Optimal landmark detection using shape models and branch and bound , 2011, 2011 International Conference on Computer Vision.

[11]  M. Burl,et al.  Face Localization via Shape Statistics , 1995 .

[12]  David J. Kriegman,et al.  Localizing Parts of Faces Using a Consensus of Exemplars , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ioannis A. Kakadiaris,et al.  Facial component-landmark detection , 2011, Face and Gesture 2011.

[14]  Bruce A. Draper,et al.  An introduction to the good, the bad, & the ugly face recognition challenge problem , 2011, Face and Gesture 2011.

[15]  Nikos Paragios,et al.  3D Knowledge-Based Segmentation Using Pose-Invariant Higher-Order Graphs , 2010, MICCAI.

[16]  Maja Pantic,et al.  Facial point detection using boosted regression and graph models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Ioannis A. Kakadiaris,et al.  Accurate Landmarking of Three-Dimensional Facial Data in the Presence of Facial Expressions and Occlusions Using a Three-Dimensional Statistical Facial Feature Model , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Andrew Owens,et al.  Discrete-continuous optimization for large-scale structure from motion , 2011, CVPR 2011.

[19]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[20]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[21]  Timothy F. Cootes,et al.  A Multi-Stage Approach to Facial Feature Detection , 2004, BMVC.

[22]  William J. Christmas,et al.  Facial feature localization using graph matching with higher order statistical shape priors and global optimization , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[23]  Timothy F. Cootes,et al.  Combining Local and Global Shape Models for Deformable Object Matching , 2009, BMVC.

[24]  Ioannis A. Kakadiaris,et al.  Facial landmark detection in uncontrolled conditions , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[25]  Richard Bowden,et al.  Detection and Tracking of Humans by Probabilistic Body Part Assembly , 2005, BMVC.

[26]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[27]  Hiroshi Ishikawa,et al.  Transformation of General Binary MRF Minimization to the First-Order Case , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.