Emulating facial biomechanics using multivariate partial least squares surrogate models

A detailed biomechanical model of the human face driven by a network of muscles is a useful tool in relating the muscle activities to facial deformations. However, lengthy computational times often hinder its applications in practical settings. The objective of this study is to replace precise but computationally demanding biomechanical model by a much faster multivariate meta-model (surrogate model), such that a significant speedup (to real-time interactive speed) can be achieved. Using a multilevel fractional factorial design, the parameter space of the biomechanical system was probed from a set of sample points chosen to satisfy maximal rank optimality and volume filling. The input-output relationship at these sampled points was then statistically emulated using linear and nonlinear, cross-validated, partial least squares regression models. It was demonstrated that these surrogate models can mimic facial biomechanics efficiently and reliably in real-time.

[1]  H. Wold.  Path Models with Latent Variables: The NIPALS Approach , 1975 .

[2]  S. Maitra,et al.  Principle Component Analysis and Partial Least Squares: Two Dimension Reduction Techniques for Regression , 2008 .

[3]  Bernd Girod,et al.  Anatomy-based facial tissue modeling using the finite element method , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[4]  Rogelio Hasimoto-Beltran,et al.  3D‐Facial Expression Synthesis and its Application to Face Recognition Systems , 2009 .

[5]  S. Wold,et al.  The Collinearity Problem in Linear Regression. The Partial Least Squares (PLS) Approach to Generalized Inverses , 1984 .

[6]  Markus H. Gross,et al.  Simulating facial surgery using finite element models , 1996, SIGGRAPH.

[7]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[8]  John Middleton,et al.  Finite element modelling of maxillofacial surgery and facial expressions—a preliminary study , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[9]  Peter J. Hunter,et al.  Hierarchical Cluster-based Partial Least Squares Regression (HC-PLSR) is an efficient tool for metamodelling of nonlinear dynamic models , 2011, BMC Systems Biology.

[10]  Harald Martens,et al.  Multi‐level binary replacement (MBR) design for computer experiments in high‐dimensional nonlinear systems , 2010 .

[11]  M. E. Johnson,et al.  Minimax and maximin distance designs , 1990 .

[12]  Kumar Mithraratne,et al.  Modelling facial expressions: A framework for simulating nonlinear soft tissue deformations using embedded 3D muscles , 2013 .

[13]  Heye Zhang,et al.  OpenCMISS: a multi-physics & multi-scale computational infrastructure for the VPH/Physiome project. , 2011, Progress in biophysics and molecular biology.

[14]  Huma Lodhi,et al.  Chemoinformatics and Advanced Machine Learning Perspectives: Complex Computational Methods and Collaborative Techniques , 2010 .

[15]  Robert E. Shannon,et al.  Design and analysis of simulation experiments , 1978, WSC '78.

[16]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[17]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[18]  Demetri Terzopoulos,et al.  A physical model of facial tissue and muscle articulation , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[19]  Peter J. Hunter,et al.  Simulating and Validating Facial Expressions using an Anatomically Accurate Biomechanical Model Derived from MRI Data - Towards Fast and Realistic Generation of Animated Characters , 2013, GRAPP/IVAPP.

[20]  P. Perrier,et al.  Shaping by stiffening: a modeling study for lips. , 2011, Motor control.

[21]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[22]  K G Munhall,et al.  A model of facial biomechanics for speech production. , 1999, The Journal of the Acoustical Society of America.

[23]  S. Wold,et al.  The multivariate calibration problem in chemistry solved by the PLS method , 1983 .

[24]  P. Lancaster,et al.  Surfaces generated by moving least squares methods , 1981 .

[25]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[26]  Ramírez,et al.  3d‐facial Expression Synthesis and Its Application to Face Recognition Systems , .

[27]  Yohan Payan,et al.  Patient specific finite element model of the face soft tissues for computer-assisted maxillofacial surgery , 2003, Medical Image Anal..

[28]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, SIGGRAPH '05.

[29]  Harald Martens,et al.  Screening design for computer experiments: metamodelling of a deterministic mathematical model of the mammalian circadian clock , 2010 .

[30]  E. Martin,et al.  Non-linear projection to latent structures revisited: the quadratic PLS algorithm , 1999 .

[31]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[32]  R. Rosipal.  Nonlinear Partial Least Squares An Overview , 2011 .

[33]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[34]  S. Wold,et al.  Nonlinear PLS modeling , 1989 .

[35]  Roman Rosipal,et al.  Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space , 2002, J. Mach. Learn. Res..

[36]  Fred L. Bookstein,et al.  Allometry for the Twenty-First Century , 2013 .

[37]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[38]  P. Deuflhard,et al.  Anatomy- and physics-based facial animation for craniofacial surgery simulations , 2004, Medical and Biological Engineering and Computing.

[39]  Kumar Mithraratne,et al.  On modelling large deformations of heterogeneous biological tissues using a mixed finite element formulation , 2015, Computer methods in biomechanics and biomedical engineering.

[40]  Peter J. Hunter,et al.  Estimating muscle activation patterns using a surrogate model of facial biomechanics , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).