Generating Facial Expressions Using an Anatomically Accurate Biomechanical Model

This paper presents a computational framework for modelling the biomechanics of human facial expressions. A detailed high-order (Cubic-Hermite) finite element model of the human head was constructed using anatomical data segmented from magnetic resonance images. The model includes a superficial soft-tissue continuum consisting of skin, the subcutaneous layer and the superficial Musculo-Aponeurotic system. Embedded within this continuum mesh, are 20 pairs of facial muscles which drive facial expressions. These muscles were treated as transversely-isotropic and their anatomical geometries and fibre orientations were accurately depicted. In order to capture the relative composition of muscles and fat, material heterogeneity was also introduced into the model. Complex contact interactions between the lips, eyelids, and between superficial soft tissue continuum and deep rigid skeletal bones were also computed. In addition, this paper investigates the impact of incorporating material heterogeneity and contact interactions, which are often neglected in similar studies. Four facial expressions were simulated using the developed model and the results were compared with surface data obtained from a 3D structured-light scanner. Predicted expressions showed good agreement with the experimental data.

[1]  Ragip Ozdemir,et al.  Anatomicohistologic study of the retaining ligaments of the face and use in face lift: retaining ligament correction and SMAS plication. , 2002, Plastic and reconstructive surgery.

[2]  Francesco Mazzoleni,et al.  Histotopographic Study of the Fibroadipose Connective Cheek System , 2009, Cells Tissues Organs.

[3]  Kumar Mithraratne,et al.  Modelling facial expressions: A framework for simulating nonlinear soft tissue deformations using embedded 3D muscles , 2013 .

[4]  T. Laursen.  Computational Contact and Impact Mechanics: Fundamentals of Modeling Interfacial Phenomena in Nonlinear Finite Element Analysis , 2002 .

[5]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[6]  Sophia Mã ¶ ller,et al.  Biomechanics — Mechanical properties of living tissue , 1982 .

[7]  Mark Sagar.  Facial performance capture and expressive translation for King Kong , 2006, SIGGRAPH '06.

[8]  A J Pullan,et al.  Anatomically Based Modelling of the Human Skull and Jaw , 2005, Cells Tissues Organs.

[9]  Tamaki Ura,et al.  A perioral dynamic model for investigating human speech articulation , 2011 .

[10]  Bernice B. Capusten.  Basic Atlas of Sectional Anatomy with Correlated Imaging. 3rd ed , 1998 .

[11]  M. Puso,et al.  A 3D contact smoothing method using Gregory patches , 2002 .

[12]  S. Delp,et al.  A 3D model of muscle reveals the causes of nonuniform strains in the biceps brachii. , 2005, Journal of biomechanics.

[13]  G. M. Roberts,et al.  Basic Atlas of Sectional Anatomy: With Correlated Imaging , 1998 .

[14]  T. J. Baker,et al.  The Relationship of the Superficial and Deep Facial Fascias: Relevance to Rhytidectomy and Aging , 1992, Plastic and reconstructive surgery.

[15]  William D Meek,et al.  Atlas of the Visible Human Male: Reverse Engineering of the Human Body , 1997, The Journal of the American Osteopathic Association.

[16]  John Middleton,et al.  Finite element modelling of maxillofacial surgery and facial expressions—a preliminary study , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[17]  Lutz-Peter Nolte,et al.  Anatomically-Driven Soft-Tissue Simulation Strategy for Cranio-Maxillofacial Surgery Using Facial Muscle Template Model , 2010, MICCAI.

[18]  S. Standring.  Gray's Anatomy: The Anatomical Basis of Clinical Practice , 2015 .

[19]  Tribikram Kundu,et al.  Introductory Finite Element Method , 2001 .

[20]  A. J. Pullan,et al.  Geometric modeling of the human torso using cubic hermite elements , 2007, Annals of Biomedical Engineering.

[21]  F. Charleux,et al.  In vivo characterization of the mechanical properties of human skin derived from MRI and indentation techniques , 2007, Computer methods in biomechanics and biomedical engineering.

[22]  P. Perrier,et al.  Shaping by stiffening: a modeling study for lips. , 2011, Motor control.

[23]  J. Oden.  Finite Elements of Nonlinear Continua , 1971 .

[24]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[25]  R. Reeves.  Anatomy: A regional atlas of the human body , 2007 .

[26]  Yu Zhang,et al.  PR OO Anatomy-based face reconstruction for animation using multi-layer deformation , 2004 .

[27]  G G Barbarino,et al.  Development and validation of a three-dimensional finite element model of the face. , 2009, Journal of biomechanical engineering.

[28]  R. Steele,et al.  Gray's Anatomy. The Anatomical Basis of Clinical Practice, 40th Edition, Susan Standring (Ed.). Churchill Livingstone Elsevier (2008), Editor-in Chief, ISBN: 978 0 8089 2371 8 , 2009 .

[29]  A F BORGES,et al.  Relaxed skin tension lines, Z-plasties on scars, and fusiform excision of lesions. , 1962, British journal of plastic surgery.

[30]  Nadia Magnenat-Thalmann,et al.  Physically-based Wrinkle Simulation & Skin Rendering , 1997, Computer Animation and Simulation.

[31]  Peter J. Hunter,et al.  A framework for generating anatomically detailed subject-specific human facial models for biomechanical simulations , 2014, The Visual Computer.

[32]  Yohan Payan,et al.  A fast and robust patient specific Finite Element mesh registration technique: Application to 60 clinical cases , 2010, Medical Image Anal..

[33]  S. Cowin,et al.  Biomechanics: Mechanical Properties of Living Tissues, 2nd ed. , 1994 .

[34]  Justin W. Fernandez,et al.  Anatomically based geometric modelling of the musculo-skeletal system and other organs , 2004, Biomechanics and modeling in mechanobiology.

[35]  Kumar Mithraratne,et al.  A Volume-Preserving Free-Form Deformation Technique for Customising a Face Model to Another Configuration , 2014 .

[36]  Lance Williams,et al.  Performance-driven facial animation , 1990, SIGGRAPH.

[37]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[38]  Kumar Mithraratne,et al.  Emulating facial biomechanics using multivariate partial least squares surrogate models , 2014, International journal for numerical methods in biomedical engineering.

[39]  B. Mendelson,et al.  Surgical Anatomy of the Lower Face: The Premasseter Space, the Jowl, and the Labiomandibular Fold , 2008, Aesthetic Plastic Surgery.

[40]  Kumar Mithraratne,et al.  Characterizing facial tissue sliding using ultrasonography , 2010 .

[41]  T. E. Smith.  Surgical anatomy of the face. , 1982, Otolaryngologic clinics of North America.

[42]  B. Mendelson,et al.  Surgical anatomy of the midcheek: facial layers, spaces, and the midcheek segments. , 2008, Clinics in plastic surgery.

[43]  P. Flory,et al.  Thermodynamic relations for high elastic materials , 1961 .

[44]  N. Klein.  Sectional Anatomy of the Head and Neck: A Detailed Atlas , 1995 .

[45]  A. Pullan,et al.  Three-dimensional finite element modelling of muscle forces during mastication. , 2007, Journal of biomechanics.

[46]  Nanning Zheng,et al.  Example-based performance driven facial shape animation , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[47]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, SIGGRAPH '05.

[48]  Yohan Payan,et al.  A 3D Finite Element Model of the Face for Simulation in Plastic and Maxillo-Facial Surgery , 2000, MICCAI.

[49]  Kumar Mithraratne,et al.  On modelling large deformations of heterogeneous biological tissues using a mixed finite element formulation , 2015, Computer methods in biomechanics and biomedical engineering.

[50]  Yohan Payan,et al.  Comparison of Linear and Non-linear Soft Tissue Models with Post-operative CT Scan in Maxillofacial Surgery , 2004, ISMS.

[51]  Peter J. Hunter,et al.  Estimating muscle activation patterns using a surrogate model of facial biomechanics , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[52]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[53]  V Mitz,et al.  THE SUPERFICIAL MUSCULO‐APONEUROTIC SYSTEM (SMAS) IN THE PAROTID AND CHEEK AREA , 1976, Plastic and reconstructive surgery.

[54]  Lawrence H. Mathers,et al.  Anatomy–A Regional Atlas of the Human Body, 4th edition , 2000 .

[55]  P. Deuflhard,et al.  Anatomy- and physics-based facial animation for craniofacial surgery simulations , 2004, Medical and Biological Engineering and Computing.

[56]  F. Zajac.  Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[57]  S. Govindjee,et al.  Computational methods for inverse de-formations in quasi-incompressible nite elasticity , 1998 .

[58]  M. Nash,et al.  Determining the finite elasticity reference state from a loaded configuration , 2007 .

[59]  Yohan Payan,et al.  Simulation of dynamic orofacial movements using a constitutive law varying with muscle activation , 2010, Computer methods in biomechanics and biomedical engineering.

[60]  Enrique Muñoz,et al.  Performance driven facial animation using illumination independent appearance-based tracking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).