A framework for generating anatomically detailed subject-specific human facial models for biomechanical simulations

Realistic biomechanical simulations of the human face rely on detailed and accurate anatomical models. A recent study involving ultrasound imaging revealed that tissue structures in the human face can be separated into two major strata that move independent of each other. Based on this observation, anatomically accurate finite element models representing soft tissues in both layers of the human face were developed using 3D segmented data derived from the high-resolution US Visible Human cryosection images. The three-dimensional geometry of these tissue structures was described using Cubic Hermite finite elements. The use of Hermite family elements ensures the continuity of displacement gradient across element boundaries and hence maintains the moment balance throughout the computational domain in mechanical simulations. This in turn leads to more accurate predictions of soft tissue deformations. Creating subject-specific detailed model of the face suitable for biomechanical analysis is, however, a time-consuming task. This paper proposes a fast semi-automated framework for generating detailed subject-specific facial models including internal muscles using techniques that involve landmark-based affine transformation, iterative surface-fitting and free-form deformation. Generated models for three individuals are presented to demonstrate the efficacy of the proposed methodology.

[1]  Yohan Payan,et al.  Patient specific finite element model of the face soft tissues for computer-assisted maxillofacial surgery , 2003, Medical Image Anal..

[2]  Lutz-Peter Nolte,et al.  A new soft-tissue simulation strategy for cranio-maxillofacial surgery using facial muscle template model. , 2010, Progress in biophysics and molecular biology.

[3]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[4]  Felmont F. Eaves,et al.  Aesthetic Plastic Surgery , 2010 .

[5]  P. Deuflhard,et al.  Anatomy- and physics-based facial animation for craniofacial surgery simulations , 2004, Medical and Biological Engineering and Computing.

[6]  R. Manktelow,et al.  Depressor labii inferioris resection: an effective treatment for marginal mandibular nerve paralysis. , 2004, British journal of plastic surgery.

[7]  M. Puso,et al.  A 3D contact smoothing method using Gregory patches , 2002 .

[8]  B M Zide,et al.  The mentalis muscle: an essential component of chin and lower lip position. , 1989, Plastic and reconstructive surgery.

[9]  V Mitz,et al.  THE SUPERFICIAL MUSCULO‐APONEUROTIC SYSTEM (SMAS) IN THE PAROTID AND CHEEK AREA , 1976, Plastic and reconstructive surgery.

[10]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, SIGGRAPH '05.

[11]  Yu Zhang,et al.  Real-time physically-based facial expression animation using mass-spring system , 2001, Proceedings. Computer Graphics International 2001.

[12]  P J Nicolau,et al.  The orbicularis oris muscle: a functional approach to its repair in the cleft lip. , 1983, British journal of plastic surgery.

[13]  Erik Schulte,et al.  Head and Neuroanatomy , 2006 .

[14]  Alice Hung An Anatomically Accurate Biomechanical Model of the Human Face for Simulating Facial Expressions , 2012 .

[15]  Olusola Olumide Aina,et al.  Generating anatomical substructures for physically-based facial animation. Part 1: A methodology for skull fitting , 2009, The Visual Computer.

[16]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[17]  R. Reeves Anatomy: A regional atlas of the human body , 2007 .

[18]  G G Barbarino,et al.  Development and validation of a three-dimensional finite element model of the face. , 2009, Journal of biomechanical engineering.

[19]  Yu Zhang,et al.  A new physical model with multilayer architecture for facial expression animation using dynamic adaptive mesh , 2004, IEEE Transactions on Visualization and Computer Graphics.

[20]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[21]  Bernd Girod,et al.  Anatomy-based facial tissue modeling using the finite element method , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[22]  R. T. Hutchings,et al.  Color atlas of human anatomy , 1977 .

[23]  T. Lander,et al.  Orbicularis oculi muscle fibers are relatively short and heterogeneous in length. , 1996, Investigative ophthalmology & visual science.

[24]  Caroline Wilkinson,et al.  Forensic Facial Reconstruction , 2004 .

[25]  A F Borges,et al.  Relaxed skin tension lines (RSTL) versus other skin lines. , 1984, Plastic and reconstructive surgery.

[26]  Kumar Mithraratne,et al.  Characterizing facial tissue sliding using ultrasonography , 2010 .

[27]  ZhangYu,et al.  A New Physical Model with Multilayer Architecture for Facial Expression Animation Using Dynamic Adaptive Mesh , 2004 .

[28]  J. Wyndaele,et al.  Color atlas of human anatomy , 2009, Spinal Cord.

[29]  Kumar Mithraratne,et al.  A Subject-Specific Framework to Inform Musculoskeletal Modeling: Outcomes from the IUPS Physiome Project , 2012 .

[30]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[31]  Hans-Peter Seidel,et al.  Geometry-based Muscle Modeling for Facial Animation , 2001, Graphics Interface.

[32]  P J Hunter,et al.  An anatomically based patient-specific finite element model of patella articulation: towards a diagnostic tool , 2005, Biomechanics and modeling in mechanobiology.

[33]  A. Erian,et al.  Advanced surgical facial rejuvenation , 2012 .

[34]  C. Clemente,et al.  Anatomy (Regional Atlas of the Human Body) , 1982 .

[35]  Kumar Mithraratne,et al.  Anatomically-based musculoskeletal modeling: prediction and validation of muscle deformation during walking , 2009, The Visual Computer.

[36]  Markus H. Gross,et al.  Simulating facial surgery using finite element models , 1996, SIGGRAPH.

[37]  John Middleton,et al.  Finite element modelling of maxillofacial surgery and facial expressions—a preliminary study , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[38]  Tribikram Kundu,et al.  Introductory Finite Element Method , 2001 .

[39]  J. McCarthy,et al.  The Mentalis Muscle: An Essential Component of Chin and Lower Lip Position , 1989, Plastic and reconstructive surgery.

[40]  Kumar Mithraratne,et al.  Simulating facial expressions using anatomically accurate biomechanical model , 2011, SA '11.

[41]  Ragip Ozdemir,et al.  Anatomicohistologic study of the retaining ligaments of the face and use in face lift: retaining ligament correction and SMAS plication. , 2002, Plastic and reconstructive surgery.

[42]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[43]  Francesco Mazzoleni,et al.  Histotopographic Study of the Fibroadipose Connective Cheek System , 2009, Cells Tissues Organs.

[44]  Peter J Hunter,et al.  Development and validation of patient-specific finite element models of the hemipelvis generated from a sparse CT data set. , 2008, Journal of biomechanical engineering.

[45]  Justin W. Fernandez,et al.  Anatomically based geometric modelling of the musculo-skeletal system and other organs , 2004, Biomechanics and modeling in mechanobiology.

[46]  M J Ackerman,et al.  The Visible Human Project , 1998, Proc. IEEE.