Finite element modeling of facial deformation in videos for computing strain pattern

We present a finite element modeling based approach to compute strain patterns caused by facial deformation during expressions in videos. A sparse motion field computed through a robust optical flow method drives the FE model. While the geometry of the model is generic, the material constants associated with an individualpsilas facial skin are learned at a coarse level sufficient for accurate strain map computation. Experimental results using the computational strategy presented in this paper emphasize the uniqueness and stability of strain maps across adverse data conditions (shadow lighting and face camouflage) making it a promising feature for image analysis tasks that can benefit from such auxiliary information.

[1]  Klaus Mueller,et al.  Dynamic Approach for Face Recognition Using Digital Image Skin Correlation , 2005, AVBPA.

[2]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Evgeny Gladilin,et al.  Biomechanical Modeling of Soft Tissue and Facial Expressions for Craniofacial Surgery Planning , 2003 .

[5]  Jörgen Ahlberg,et al.  CANDIDE-3 - An Updated Parameterised Face , 2001 .

[6]  Dmitry B. Goldgof,et al.  Elastic face - an anatomy-based biometrics beyond visible cue , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[7]  Markus H. Gross,et al.  Simulating facial surgery using finite element models , 1996, SIGGRAPH.

[8]  Dmitry B. Goldgof,et al.  Facial Strain Pattern as a Soft Forensic Evidence , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[9]  Niels da Vitoria Lobo,et al.  Age Classification from Facial Images , 1999, Comput. Vis. Image Underst..

[10]  Mubarak Shah,et al.  Estimation of rigid and non-rigid facial motion using anatomical face model , 2002, Object recognition supported by user interaction for service robots.

[11]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[12]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Thomas Vetter,et al.  Registration of expressions data using a 3D morphable model , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[14]  Li Zhang,et al.  Spacetime faces: high resolution capture for modeling and animation , 2004, SIGGRAPH 2004.

[15]  Yu Zhang,et al.  Efficient Modeling of An Anatomy‐Based Face and Fast 3D Facial Expression Synthesis , 2003, Comput. Graph. Forum.