Modelling facial expressions: A framework for simulating nonlinear soft tissue deformations using embedded 3D muscles

Human face can be seen as a soft tissue organ complex with a large investing network of musculature. Due to its complexity, most existing computational models approximate these muscular structures using simple geometries such as 1-D curves or primitive 3-D shapes. This paper presents a new approach to evaluate muscle contribution from anatomically accurate geometries while maintaining the computational complexity at a tractable level. In the proposed method, 3-D muscle structures are embedded inside a facial continuum (encompassing all superficial soft tissue structures), where mechanical contribution of muscles is evaluated independently and transferred to the facial computational domain through a finite element mapping procedure. Muscle forces are decomposed into an array of discrete point loads that are determined at the integration points of an appropriate quadrature scheme. As a result, muscle meshes can be constructed independent from the facial mesh giving two main advantages: (i) the muscle geometries can be refined independent of the facial computational domain, and (ii) it is not required for the computational domain to conform to complex topology of muscle structures.

[1]  Keith Waters,et al.  Computer facial animation , 1996 .

[2]  Ragip Ozdemir,et al.  Anatomicohistologic study of the retaining ligaments of the face and use in face lift: retaining ligament correction and SMAS plication. , 2002, Plastic and reconstructive surgery.

[3]  Francesco Mazzoleni,et al.  Histotopographic Study of the Fibroadipose Connective Cheek System , 2009, Cells Tissues Organs.

[4]  Orlando Guntinas-Lichius,et al.  Facial muscle activation patterns in healthy male humans: A multi-channel surface EMG study , 2010, Journal of Neuroscience Methods.

[5]  J. Oden Finite Elements of Nonlinear Continua , 1971 .

[6]  L M Dzubow,et al.  The fasciae of the face: an anatomic and histologic analysis. , 1986, Journal of the American Academy of Dermatology.

[7]  Kumar Mithraratne,et al.  An Efficient Heterogeneous Continuum Model to Simulate Active Contraction of Facial Soft Tissue Structures , 2010 .

[8]  Rogelio Hasimoto-Beltran,et al.  3D‐Facial Expression Synthesis and its Application to Face Recognition Systems , 2009 .

[9]  Markus H. Gross,et al.  Emotion Editing using Finite Elements , 1998, Comput. Graph. Forum.

[10]  S. Delp,et al.  A 3D model of muscle reveals the causes of nonuniform strains in the biceps brachii. , 2005, Journal of biomechanics.

[11]  S. Cowin,et al.  Biomechanics: Mechanical Properties of Living Tissues, 2nd ed. , 1994 .

[12]  Justin W. Fernandez,et al.  Anatomically based geometric modelling of the musculo-skeletal system and other organs , 2004, Biomechanics and modeling in mechanobiology.

[13]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, ACM Trans. Graph..

[14]  Kumar Mithraratne,et al.  Characterizing facial tissue sliding using ultrasonography , 2010 .

[15]  Ramírez,et al.  3d‐facial Expression Synthesis and Its Application to Face Recognition Systems , .

[16]  O. C. Zienkiewicz,et al.  The Finite Element Method: Its Basis and Fundamentals , 2005 .

[17]  John Middleton,et al.  Finite element modelling of maxillofacial surgery and facial expressions—a preliminary study , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[18]  P. Flory,et al.  Thermodynamic relations for high elastic materials , 1961 .

[19]  Lutz-Peter Nolte,et al.  Anatomically-Driven Soft-Tissue Simulation Strategy for Cranio-Maxillofacial Surgery Using Facial Muscle Template Model , 2010, MICCAI.

[20]  A. J. Pullan,et al.  Geometric modeling of the human torso using cubic hermite elements , 2007, Annals of Biomedical Engineering.

[21]  Yohan Payan,et al.  Patient specific finite element model of the face soft tissues for computer-assisted maxillofacial surgery , 2003, Medical Image Anal..

[22]  Yohan Payan,et al.  Simulation of dynamic orofacial movements using a constitutive law varying with muscle activation , 2010, Computer methods in biomechanics and biomedical engineering.

[23]  V. Spitzer,et al.  The visible human male: a technical report. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[24]  A. Huxley Muscle structure and theories of contraction. , 1957, Progress in biophysics and biophysical chemistry.

[25]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[26]  Leonid Zhukov,et al.  Heart-muscle fiber reconstruction from diffusion tensor MRI , 2003, IEEE Visualization, 2003. VIS 2003..

[27]  Edoardo Mazza,et al.  Experimental and numerical study of the relaxation behavior of facial soft tissue , 2009 .

[28]  Yohan Payan,et al.  Finite element speaker-specific face model generation for the study of speech production , 2010, Computer methods in biomechanics and biomedical engineering.

[29]  S. Delp,et al.  Three-Dimensional Representation of Complex Muscle Architectures and Geometries , 2005, Annals of Biomedical Engineering.

[30]  P. Deuflhard,et al.  Anatomy- and physics-based facial animation for craniofacial surgery simulations , 2004, Medical and Biological Engineering and Computing.

[31]  F. Zajac Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[32]  A. Huxley,et al.  Proposed Mechanism of Force Generation in Striated Muscle , 1971, Nature.

[33]  Susan Standring PhD DSc Gray's Anatomy: The Anatomical Basis of Clinical Practice , 2005 .

[34]  Kumar Mithraratne,et al.  On modelling large deformations of heterogeneous biological tissues using a mixed finite element formulation , 2015, Computer methods in biomechanics and biomedical engineering.

[35]  Yu Zhang,et al.  Face alive , 2004, J. Vis. Lang. Comput..