Simulation of dynamic orofacial movements using a constitutive law varying with muscle activation

This paper presents a biomechanical model of the face to simulate orofacial movements in speech and non-verbal communication. A 3D finite element model, based on medical images of a subject, is presented. A hyperelastic Mooney–Rivlin constitutive law accounts for the non-linear behaviour of facial tissue. Muscle fibres are represented by piece-wise uniaxial tensile element that generate force. The stress stiffening effect, an increase in the stiffness of the muscles when activated, is modelled by varying the constitutive law of the tissue with the level of activation of the muscle. A large number of facial movements occurring during speech and facial mimics are simulated. Results show that our modelling approach provides a realistic account of facial mimics. The differences between dynamic vs. quasi-static simulations are also discussed, proving that dynamic trajectories better fit experimental data.

[1]  Kevin G Munhall,et al.  Empirical modeling of human face kinematics during speech using motion clustering. , 2005, The Journal of the Acoustical Society of America.

[2]  Yohan Payan,et al.  A biomechanical model of the face including muscles for the prediction of deformations during speech production , 2008, MAVEBA.

[3]  B. Koopman,et al.  Three-dimensional finite element modeling of skeletal muscle using a two-domain approach: linked fiber-matrix mesh model. , 2001, Journal of biomechanics.

[4]  Ronald Fedkiw,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2006) Simulating Speech with a Physics-based Facial Muscle Model , 2022 .

[5]  A. Hill.  The heat of shortening and the dynamic constants of muscle , 1938 .

[6]  P. Perrier,et al.  A biomechanical model of cardinal vowel production: muscle activations and the impact of gravity on tongue positioning. , 2009, The Journal of the Acoustical Society of America.

[7]  Yohan Payan,et al.  Synthesis of V-V sequences with a 2D biomechanical tongue model controlled by the Equilibrium Point Hypothesis , 1997, Speech Commun..

[8]  R. Wilhelms-Tricarico.  Physiological modeling of speech production: methods for modeling soft-tissue articulators. , 1995, The Journal of the Acoustical Society of America.

[9]  C. G. Lyons,et al.  A validated model of passive muscle in compression. , 2006, Journal of biomechanics.

[10]  J. Harrington,et al.  Speech Production: Models, Phonetic Processes, and Techniques , 2006 .

[11]  J. Perkell,et al.  Influences of tongue biomechanics on speech movements during the production of velar stop consonants: a modeling study. , 2003, Journal of the Acoustical Society of America.

[12]  V Luboz,et al.  Non-linear elastic properties of the lingual and facial tissues assessed by indentation technique. Application to the biomechanics of speech production. , 2005, Medical engineering & physics.

[13]  Christian Abry,et al.  How can coarticulation models account for speech sensitivity to audio-visual desynchronization? , 1996 .

[14]  Victor Ng-Thow-Hing,et al.  Application-Specific Muscle Representations , 2002, Graphics Interface.

[15]  Jacques Ohayon,et al.  Transmission of Mechanical Stresses within the Cytoskeleton of Adherent Cells: A Theoretical Analysis Based on a Multi-Component Cell Model , 2004, Acta biotheoretica.

[16]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[17]  Guojie Li,et al.  From the Editor-in-Chief , 1995, Journal of Computer Science and Technology.

[18]  N. Isshiki.  Physiology of Speech Production , 1989 .

[19]  M. GerardJ..  Non linear elastic properties of the lingual and facial tissues assessed by indentation technique . Application to the biomechanics of speech production , 2005 .

[20]  Gérard Bailly,et al.  An Audiovisual Talking Head for Augmented Speech Generation: Models and Animations Based on a Real Speaker's Articulatory Data , 2008, AMDO.

[21]  J D Humphrey,et al.  Constitutive Relations and Finite Deformations of Passive Cardiac Tissue II: Stress Analysis in the Left Ventricle , 1989, Circulation research.

[22]  Thomas A. McMahon,et al.  Muscles, Reflexes, and Locomotion , 1984 .

[23]  Ronald Fedkiw,et al.  Creating and simulating skeletal muscle from the visible human data set , 2005, IEEE Transactions on Visualization and Computer Graphics.

[24]  Bruce Elliot Hirsch,et al.  Gray’s Anatomy: The Anatomical Basis of Clinical Practice , 2009 .

[25]  F. Zajac.  Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[26]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[27]  Y. Fung,et al.  Biomechanics: Mechanical Properties of Living Tissues , 1981 .

[28]  D. O'Shaughnessy.  A study of French vowel and consonant durations , 1981 .

[29]  A. G. Feldman.  Once More on the Equilibrium-Point Hypothesis (λ Model) for Motor Control , 1986 .

[30]  K G Munhall,et al.  A model of facial biomechanics for speech production. , 1999, The Journal of the Acoustical Society of America.

[31]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, SIGGRAPH '05.

[32]  Evgeny Gladilin,et al.  A Framework for Biomechanical Simulation of Cranio-Maxillofacial Surgery Interventions , 2004, ISMS.

[33]  J. Weiss,et al.  Finite element implementation of incompressible, transversely isotropic hyperelasticity , 1996 .

[34]  Yohan Payan,et al.  A Continuous Biomechanical Model of the Face: A Study of Muscle Coordination for Speech Lip Gestures , 2008 .

[35]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[36]  Hiroaki Gomi,et al.  Model-Based Investigation of Control and Dynamics in Human Articulatory Motion , 2007 .

[37]  P. Morasso.  Spatial control of arm movements , 2004, Experimental Brain Research.

[38]  P. Blanton,et al.  Electromyographic Analysis of the Buccinator Muscle , 1970, Journal of dentistry research.

[39]  Eric Vatikiotis-Bateson,et al.  The moving face during speech communication , 1998 .

[40]  Yohan Payan,et al.  Patient specific finite element model of the face soft tissues for computer-assisted maxillofacial surgery , 2003, Medical Image Anal..

[41]  S. Delp,et al.  A 3D model of muscle reveals the causes of nonuniform strains in the biceps brachii. , 2005, Journal of biomechanics.

[42]  Yohan Payan,et al.  A 3D biomechanical vocal tract model to study speech production control: How to take into account the gravity? , 2007, physics/0701285.

[43]  S. Adams,et al.  Velocity profiles of lip protrusion across changes in speaking rate. , 1997, Journal of speech, language, and hearing research : JSLHR.