Real-time biomechanical modeling of the liver using Machine Learning models trained on Finite Element Method simulations

Abstract The development of accurate real-time models of the biomechanical behavior of different organs and tissues still poses a challenge in the field of biomechanical engineering. In the case of the liver, specifically, such a model would constitute a great leap forward in the implementation of complex applications such as surgical simulators, computed-assisted surgery or guided tumor irradiation. In this work, a relatively novel approach for developing such a model is presented. It consists in the use of a machine learning algorithm, which provides real-time inference, trained on tens of thousands of simulations of the biomechanical behavior of the liver carried out by the finite element method on more than 100 different liver geometries. Considering a target accuracy threshold of 3 mm for the Euclidean Error, four different scenarios were modeled and assessed: a single liver with an arbitrary force applied (99.96% of samples within the accepted error range), a single liver with two simultaneous forces applied (99.84% samples in range), a single liver with different material properties and an arbitrary force applied (98.46% samples in range), and a much more general model capable of modeling the behavior of any liver with an arbitrary force applied (99.01% samples in range for the median liver). The results show that the Machine Learning models perform extremely well on all the scenarios, managing to keep the Mean Euclidean Error under 1 mm in all cases. Furthermore, the proposed model achieves working frequencies above 100Hz on modest hardware (with frequencies above 1000Hz being easily achievable on more powerful GPUs) thus fulfilling the real-time requirements. These results constitute a remarkable improvement in this field and may involve a prompt implementation in clinical practice.

[1]  Christian Duriez,et al.  SOFA: A Multi-Model Framework for Interactive Physical Simulation , 2012 .

[2]  H. Delingette,et al.  Nonlinear Biomechanical Model of the Liver , 2017 .

[3]  Stephane Cotin,et al.  Atlas-Based Transfer of Boundary Conditions for Biomechanical Simulation , 2014, MICCAI.

[4]  Y. Fung,et al.  Biomechanics: Mechanical Properties of Living Tissues , 1981 .

[5]  D. González,et al.  kPCA-Based Parametric Solutions Within the PGD Framework , 2017 .

[6]  R. Landel,et al.  The Strain‐Energy Function of a Hyperelastic Material in Terms of the Extension Ratios , 1967 .

[7]  M. Coret,et al.  Mechanical characterization of liver capsule through uniaxial quasi-static tensile tests until failure. , 2010, Journal of biomechanics.

[8]  Stephane Cotin,et al.  Modeling and Real-Time Simulation of a Vascularized Liver Tissue , 2012, MICCAI.

[9]  G. Strang,et al.  An Analysis of the Finite Element Method , 1974 .

[10]  Siamak Niroomandi,et al.  Accounting for large deformations in real-time simulations of soft tissues based on reduced-order models , 2012, Comput. Methods Programs Biomed..

[11]  K. Cleary,et al.  Assessment of hepatic motion secondary to respiration for computer assisted interventions. , 2002, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[12]  Sarthak Misra,et al.  A framework for predicting three‐dimensional prostate deformation in real time , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[13]  Antonio J. Serrano,et al.  A framework for modelling the biomechanical behaviour of the human liver during breathing in real time using machine learning , 2017, Expert Syst. Appl..

[14]  R. Rivlin Large elastic deformations of isotropic materials IV. further developments of the general theory , 1948, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[15]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[16]  Suvranu De,et al.  PhyNeSS: A Physics-driven Neural Networks-based Surgery Simulation system with force feedback , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[17]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Ryo Kurazume,et al.  Real-Time Nonlinear FEM with Neural Network for Simulating Soft Organ Model Deformation , 2008, MICCAI.

[19]  Yuan-Chiao Lu,et al.  Material characterization of liver parenchyma using specimen-specific finite element models. , 2013, Journal of the mechanical behavior of biomedical materials.

[20]  David González,et al.  Computational Patient Avatars for Surgery Planning , 2015, Annals of Biomedical Engineering.

[21]  Benjamin J. Ellis,et al.  FEBio: finite elements for biomechanics. , 2012, Journal of biomechanical engineering.

[22]  Daniel Thalmann,et al.  Real time muscle deformations using mass-spring systems , 1998, Proceedings. Computer Graphics International (Cat. No.98EX149).

[23]  Jian J. Zhang,et al.  An Efficient modelling and simulation of soft tissue deformation using mass-spring systems , 2003, CARS.

[24]  R. Rivlin LARGE ELASTIC DEFORMATIONS OF ISOTROPIC MATERIALS. I. FUNDAMENTAL CONCEPTS , 1997 .

[25]  Jaydev P. Desai,et al.  Development of In Vivo Constitutive Models for Liver: Application to Surgical Simulation , 2011, Annals of Biomedical Engineering.

[26]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[27]  A. Ammar,et al.  PGD-Based Computational Vademecum for Efficient Design, Optimization and Control , 2013, Archives of Computational Methods in Engineering.

[28]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[29]  Stephane Cotin,et al.  A hybrid elastic model for real-time cutting, deformations, and force feedback for surgery training and simulation , 2000, The Visual Computer.

[30]  Nazim Haouchine,et al.  Patient-Specific Biomechanical Modeling for Guidance During Minimally-Invasive Hepatic Surgery , 2015, Annals of Biomedical Engineering.