Adaptive facial feature extraction

We present a method which is able to adapt from a generic facial representation to a person-specific model of a face. It is referred to as Adaptive Constrained Polynomial Trees (ACPT). Especially in vehicle driving scenarios, special assumptions can be made. A generic facial representation which is able to handle many different persons can be specialized to the current driver to cope with his/her individual face and his/her individual facial features. This leads to a more robust extraction of specified points in the face like nose tip or mouth corners. The proposed method is trained on the LFPW and tested on the FGnet “talking face” dataset. It can be shown, that the presented adaptive model is able to outperform the presented generic facial representation approach. These promising results can be used for further analysis of the driver.

[1]  Simon Lucey,et al.  Face alignment through subspace constrained mean-shifts , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  J. Kruskal.  On the shortest spanning subtree of a graph and the traveling salesman problem , 1956 .

[3]  Stefanos Zafeiriou,et al.  300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[4]  Keiichi Uchimura,et al.  Driver inattention monitoring system for intelligent vehicles: A review , 2009 .

[5]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Richard Bishop,et al.  Intelligent Vehicle Technology and Trends , 2005 .

[7]  Wanqing Li,et al.  Real-Time Facial Feature Point Extraction , 2007, PCM.

[8]  Stefanos Zafeiriou,et al.  A Semi-automatic Methodology for Facial Landmark Annotation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[9]  Daniel P. Huttenlocher,et al.  Pictorial Structures for Object Recognition , 2004, International Journal of Computer Vision.

[10]  Jürgen Schürmann,et al.  Pattern classification , 2008 .

[11]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[12]  F. Lindner,et al.  Robust recognition of traffic signals , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[13]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Timothy F. Cootes,et al.  Feature Detection and Tracking with Constrained Local Models , 2006, BMVC.

[15]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[16]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  David J. Kriegman,et al.  Localizing parts of faces using a consensus of exemplars , 2011, CVPR.