A novel incremental simulation of facial changes following orthognathic surgery using FEM with realistic lip sliding effect

Accurate prediction of facial soft-tissue changes following orthognathic surgery is crucial for surgical outcome improvement. We developed a novel incremental simulation approach using finite element method (FEM) with a realistic lip sliding effect to improve the prediction accuracy in the lip region. First, a lip-detailed mesh is generated based on accurately digitized lip surface points. Second, an improved facial soft-tissue change simulation method is developed by applying a lip sliding effect along with the mucosa sliding effect. Finally, the orthognathic surgery initiated soft-tissue change is simulated incrementally to facilitate a natural transition of the facial change and improve the effectiveness of the sliding effects. Our method was quantitatively validated using 35 retrospective clinical data sets by comparing it to the traditional FEM simulation method and the FEM simulation method with mucosa sliding effect only. The surface deviation error of our method showed significant improvement in the upper and lower lips over the other two prior methods. In addition, the evaluation results using our lip-shape analysis, which reflects clinician's qualitative evaluation, also proved significant improvement of the lip prediction accuracy of our method for the lower lip and both upper and lower lips as a whole compared to the other two methods. In conclusion, the prediction accuracy in the clinically critical region, i.e., the lips, significantly improved after applying incremental simulation with realistic lip sliding effect compared with the FEM simulation methods without the lip sliding effect.

[1]  Wouter Mollemans,et al.  Quantitative validation of a computer-aided maxillofacial planning system, focusing on soft tissue deformations , 2014, Annals of maxillofacial surgery.

[2]  P. Perrier,et al.  Shaping by stiffening: a modeling study for lips. , 2011, Motor control.

[3]  Lutz-Peter Nolte,et al.  A new soft-tissue simulation strategy for cranio-maxillofacial surgery using facial muscle template model. , 2010, Progress in biophysics and molecular biology.

[4]  Slim Ouni,et al.  Dynamic lip animation from a limited number of control points: Towards an effective audiovisual spoken communication , 2018, Speech Commun..

[5]  Xiaobo Zhou,et al.  Incremental Kernel Ridge Regression for the Prediction of Soft Tissue Deformations , 2012, MICCAI.

[6]  Ian Stavness,et al.  sEMG-assisted inverse modelling of 3D lip movement: a feasibility study towards person-specific modelling , 2017, Scientific Reports.

[7]  Yohan Payan,et al.  Simulation of dynamic orofacial movements using a constitutive law varying with muscle activation , 2010, Computer methods in biomechanics and biomedical engineering.

[8]  Stephane Cotin,et al.  A hybrid elastic model for real-time cutting, deformations, and force feedback for surgery training and simulation , 2000, The Visual Computer.

[9]  S. Drew,et al.  Virtual model surgery for efficient planning and surgical performance. , 2011, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[10]  Jaime Gateno,et al.  Accuracy of the computer-aided surgical simulation (CASS) system in the treatment of patients with complex craniomaxillofacial deformity: A pilot study. , 2007, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[11]  Yohan Payan,et al.  Patient specific finite element model of the face soft tissues for computer-assisted maxillofacial surgery , 2003, Medical Image Anal..

[12]  Silvia Schievano,et al.  A novel soft tissue prediction methodology for orthognathic surgery based on probabilistic finite element modelling , 2018, PloS one.

[13]  Ying He,et al.  Direct-Product Volumetric Parameterization of Handlebodies via Harmonic Fields , 2010, 2010 Shape Modeling International Conference.

[14]  Jaime Gateno,et al.  An eFTD-VP framework for efficiently generating patient-specific anatomically detailed facial soft tissue FE mesh for craniomaxillofacial surgery simulation , 2018, Biomechanics and modeling in mechanobiology.

[15]  Paul Suetens,et al.  Predicting soft tissue deformations for a maxillofacial surgery planning system: From computational strategies to a complete clinical validation , 2007, Medical Image Anal..

[16]  Paul Suetens,et al.  Parameter Optimisation of a Linear Tetrahedral Mass Tensor Model for a Maxillofacial Soft Tissue Simulator , 2006, ISBMS.

[17]  Shenghui Liao,et al.  Facial hexahedral mesh transferring by volumetric mapping based on harmonic fields , 2011, Comput. Graph..

[18]  Jaime Gateno,et al.  Accuracy of a computer-aided surgical simulation protocol for orthognathic surgery: a prospective multicenter study. , 2013, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[19]  Anand Rangarajan,et al.  A new algorithm for non-rigid point matching , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[20]  Gérard Bailly,et al.  TOWARDS AN AUDIOVISUAL VIRTUAL TALKING HEAD: 3D ARTICULATORY MODELING OF TONGUE, LIPS AND FACE BASED ON MRI AND VIDEO IMAGES , 1998 .

[21]  B. N. Maker,et al.  Rigid bodies for metal forming analysis with NIKE3D , 1995 .

[22]  Gérard Bailly,et al.  Three-dimensional linear articulatory modeling of tongue, lips and face, based on MRI and video images , 2002, J. Phonetics.

[23]  Peng Yuan,et al.  A clinically validated prediction method for facial soft‐tissue changes following double‐jaw surgery , 2017, Medical physics.

[24]  Ferdinand van der Heijden,et al.  Simulation of facial expressions using person-specific sEMG signals controlling a biomechanical face model , 2017, International Journal of Computer Assisted Radiology and Surgery.

[25]  Paul G M Knoops,et al.  Three-dimensional soft tissue prediction in orthognathic surgery: a clinical comparison of Dolphin, ProPlan CMF, and probabilistic finite element modelling. , 2019, International journal of oral and maxillofacial surgery.

[26]  José J. Muñoz,et al.  Sliding contact conditions using the master-slave approach with application on geometrically non-linear beams , 2004 .

[27]  B. Khambay,et al.  Current methods of assessing the accuracy of three-dimensional soft tissue facial predictions: technical and clinical considerations. , 2015, International journal of oral and maxillofacial surgery.

[28]  J Li,et al.  Algorithm for planning a double-jaw orthognathic surgery using a computer-aided surgical simulation (CASS) protocol. Part 1: planning sequence. , 2015, International journal of oral and maxillofacial surgery.

[29]  Stefan Zachow,et al.  A quantitative evaluation of 3D soft tissue prediction in maxillofacial surgery planning , 2004 .

[30]  K. Weimer,et al.  Virtual surgical planning for orthognathic surgery using digital data transfer and an intraoral fiducial marker: the charlotte method. , 2015, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[31]  Lutz-Peter Nolte,et al.  Anatomically-Driven Soft-Tissue Simulation Strategy for Cranio-Maxillofacial Surgery Using Facial Muscle Template Model , 2010, MICCAI.

[32]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[33]  Peng Yuan,et al.  An eFace-Template Method for Efficiently Generating Patient-Specific Anatomically-Detailed Facial Soft Tissue FE Models for Craniomaxillofacial Surgery Simulation , 2015, Annals of Biomedical Engineering.

[34]  R Kikinis,et al.  Deformable modeling of facial tissue for craniofacial surgery simulation. , 1998, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.