Simulating facial expressions using anatomically accurate biomechanical model

An anatomically accurate biomechanical model of the human face for simulating facial expressions is presented in this paper. The equations governing large (nonlinear) deformations or finite elasticity were solved using the Finite Element Method with Hermite family cubic elements to obtain the deformed state of soft tissue structures. Anatomically accurate 3D geometry of the muscles were embedded in the FE continuum using grid-based method. Facial movements were driven by an active contraction model for skeletal muscles.

[1]  Y. Fung,et al.  Biomechanics: Mechanical Properties of Living Tissues , 1981 .

[2]  Justin W. Fernandez,et al.  Anatomically based geometric modelling of the musculo-skeletal system and other organs , 2004, Biomechanics and modeling in mechanobiology.

[3]  P. Perrier,et al.  Shaping by stiffening: a modeling study for lips. , 2011, Motor control.

[4]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, ACM Trans. Graph..

[5]  T. Laursen.  Computational Contact and Impact Mechanics: Fundamentals of Modeling Interfacial Phenomena in Nonlinear Finite Element Analysis , 2002 .

[6]  Ragip Ozdemir,et al.  Anatomicohistologic study of the retaining ligaments of the face and use in face lift: retaining ligament correction and SMAS plication. , 2002, Plastic and reconstructive surgery.

[7]  J. Oden.  Finite Elements of Nonlinear Continua , 1971 .

[8]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[9]  Yu Zhang,et al.  PR OO Anatomy-based face reconstruction for animation using multi-layer deformation , 2004 .

[10]  G G Barbarino,et al.  Development and validation of a three-dimensional finite element model of the face. , 2009, Journal of biomechanical engineering.

[11]  M. Nash,et al.  Determining the finite elasticity reference state from a loaded configuration , 2007 .

[12]  Yohan Payan,et al.  Simulation of dynamic orofacial movements using a constitutive law varying with muscle activation , 2010, Computer methods in biomechanics and biomedical engineering.

[13]  Enrique Muñoz,et al.  Performance driven facial animation using illumination independent appearance-based tracking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  P. Flory,et al.  Thermodynamic relations for high elastic materials , 1961 .

[15]  A. Pullan,et al.  Three-dimensional finite element modelling of muscle forces during mastication. , 2007, Journal of biomechanics.

[16]  Nanning Zheng,et al.  Example-based performance driven facial shape animation , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[17]  G. M. Roberts,et al.  Basic Atlas of Sectional Anatomy: With Correlated Imaging , 1998 .

[18]  T. J. Baker,et al.  The Relationship of the Superficial and Deep Facial Fascias: Relevance to Rhytidectomy and Aging , 1992, Plastic and reconstructive surgery.

[19]  Yohan Payan,et al.  A 3D Finite Element Model of the Face for Simulation in Plastic and Maxillo-Facial Surgery , 2000, MICCAI.

[20]  Yohan Payan,et al.  Comparison of Linear and Non-linear Soft Tissue Models with Post-operative CT Scan in Maxillofacial Surgery , 2004, ISMS.

[21]  Peter J. Hunter,et al.  Estimating muscle activation patterns using a surrogate model of facial biomechanics , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  S. Govindjee,et al.  Computational methods for inverse de-formations in quasi-incompressible nite elasticity , 1998 .

[23]  Tamaki Ura,et al.  A perioral dynamic model for investigating human speech articulation , 2011 .

[24]  Kumar Mithraratne,et al.  An Efficient Heterogeneous Continuum Model to Simulate Active Contraction of Facial Soft Tissue Structures , 2010 .

[25]  John Middleton,et al.  Finite element modelling of maxillofacial surgery and facial expressions—a preliminary study , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[26]  Bernice B. Capusten.  Basic Atlas of Sectional Anatomy with Correlated Imaging. 3rd ed , 1998 .

[27]  M. Puso,et al.  A 3D contact smoothing method using Gregory patches , 2002 .

[28]  S. Delp,et al.  A 3D model of muscle reveals the causes of nonuniform strains in the biceps brachii. , 2005, Journal of biomechanics.

[29]  J. E. Alexander,et al.  SKIN: Relaxed skin tension lines, Z‐plasties on scars, and fusiform excision of lesions , 1963 .

[30]  A J Pullan,et al.  Anatomically Based Modelling of the Human Skull and Jaw , 2005, Cells Tissues Organs.

[31]  Lutz-Peter Nolte,et al.  Anatomically-Driven Soft-Tissue Simulation Strategy for Cranio-Maxillofacial Surgery Using Facial Muscle Template Model , 2010, MICCAI.

[32]  Tribikram Kundu,et al.  Introductory Finite Element Method , 2001 .

[33]  A. J. Pullan,et al.  Geometric modeling of the human torso using cubic hermite elements , 2007, Annals of Biomedical Engineering.

[34]  F. Charleux,et al.  In vivo characterization of the mechanical properties of human skin derived from MRI and indentation techniques , 2007, Computer methods in biomechanics and biomedical engineering.

[35]  B. Mendelson,et al.  Surgical anatomy of the midcheek: facial layers, spaces, and the midcheek segments. , 2008, Clinics in plastic surgery.

[36]  Yohan Payan,et al.  A fast and robust patient specific Finite Element mesh registration technique: Application to 60 clinical cases , 2010, Medical Image Anal..

[37]  Nadia Magnenat-Thalmann,et al.  Physically-based Wrinkle Simulation & Skin Rendering , 1997, Computer Animation and Simulation.

[38]  B. Mendelson,et al.  Surgical Anatomy of the Lower Face: The Premasseter Space, the Jowl, and the Labiomandibular Fold , 2008, Aesthetic Plastic Surgery.

[39]  Lance Williams,et al.  Performance-driven facial animation , 1990, SIGGRAPH Courses.

[40]  P. Deuflhard,et al.  Anatomy- and physics-based facial animation for craniofacial surgery simulations , 2004, Medical and Biological Engineering and Computing.

[41]  F. Zajac.  Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[42]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[43]  V M Spitzer,et al.  The Visible Human data set: an image resource for anatomical visualization. , 1995, Medinfo. MEDINFO.

[44]  V Mitz,et al.  THE SUPERFICIAL MUSCULO‐APONEUROTIC SYSTEM (SMAS) IN THE PAROTID AND CHEEK AREA , 1976, Plastic and reconstructive surgery.