Fast Prototyping of Virtual Reality Based Surgical Simulators with PhysX-enabled GPU

We present our experience in fast prototyping of a series of important but computation-intensive functionalities in surgical simulators based on newly released PhysX-enabled GPU. We focus on soft tissue deformation and bleeding simulation, as they are essential but have previously been difficult to be rapidly prototyped. A multilayered soft tissue deformation model is implemented by extending the hardware-accelerated mass-spring system (MSS) in PhysX engine. To ensure accuracy, we configure spring parameters in an analytic way and integrate a fast volume preservation method to overcome the volume loss problem in MSS. Fast bleeding simulation with consideration of both patient behavior and mechanical dynamics is introduced. By making use of the PhysX built-in SPH-based fluid solver with careful assignment of parameters, realistic yet efficient bleeding effects can be achieved. Experimental results demonstrate that our approaches can achieve both interactive frame rates and convincing visual effects even when complex models are involved.

[1]  Thomas Sangild Sørensen,et al.  GPU accelerated surgical simulators for complex morphology , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[2]  Gábor Székely,et al.  Mesh Topology Identification for Mass-Spring Models , 2003, MICCAI.

[3]  J. Monaghan.  Simulating Free Surface Flows with SPH , 1994 .

[4]  Gábor Székely,et al.  Simultaneous Topology and Stiffness Identification for Mass-Spring Models Based on FEM Reference Deformations , 2004, MICCAI.

[5]  Stephane Cotin,et al.  EP4A: Software and Computer Based Simulator Research: Development and Outlook SOFA—An Open Source Framework for Medical Simulation , 2007, MMVR.

[6]  Markus H. Gross,et al.  Particle-based fluid simulation for interactive applications , 2003, SCA '03.

[7]  Min-Hyung Choi,et al.  Fast Volume Preservation for a Mass-Spring System , 2006, IEEE Computer Graphics and Applications.

[8]  Pierre Hellier,et al.  Level Set Methods in an EM Framework for Shape Classification and Estimation , 2004, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[9]  Kup-Sze Choi,et al.  Learning Blood Management in Orthopedic Surgery through Gameplay , 2010, IEEE Computer Graphics and Applications.

[10]  Terry M. Peters,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2003 , 2003, Lecture Notes in Computer Science.

[11]  Y. Fung,et al.  Biomechanics: Mechanical Properties of Living Tissues , 1981 .

[12]  Helene M. Hoffman,et al.  Medicine Meets Virtual Reality 2002 , 2002 .

[13]  R White,et al.  A computer model of major haemorrhage and resuscitation. , 1996, Medical engineering & physics.

[14]  Min-Hyung Choi,et al.  Effective Constrained Dynamic Simulation Using Implicit Constraint Enforcement , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[15]  William E. Lorensen,et al.  Marching cubes: a high resolution 3D surface construction algorithm , 1996 .

[16]  D. Gentile,et al.  The impact of video games on training surgeons in the 21st century. , 2007, Archives of surgery.

[17]  David R. Michael,et al.  Serious Games: Games That Educate, Train, and Inform , 2005 .

[18]  Gábor Székely,et al.  Identification of Spring Parameters for Deformable Object Simulation , 2007, IEEE Transactions on Visualization and Computer Graphics.

[19]  Suvranu De,et al.  Using the PhysX engine for physics‐based virtual surgery with force feedback , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[20]  Jean Louchet,et al.  Evolutionary identification of cloth animation models , 1995 .

[21]  L. Libersky,et al.  High strain Lagrangian hydrodynamics: a three-dimensional SPH code for dynamic material response , 1993 .

[22]  S. Levinson,et al.  Sonoelastic determination of human skeletal muscle elasticity. , 1995, Journal of biomechanics.

[23]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2006, Comput. Graph. Forum.

[24]  Joel Brown,et al.  Spring: a general framework for collaborative, real-time surgical simulation. , 2002, Studies in health technology and informatics.

[25]  Rüdiger Westermann,et al.  Mass-spring systems on the GPU , 2005, Simul. Model. Pract. Theory.

[26]  Sébastien Ourselin,et al.  High-Speed Nonlinear Finite Element Analysis for Surgical Simulation Using Graphics Processing Units , 2008, IEEE Transactions on Medical Imaging.

[27]  H. Zahouani,et al.  In vivo measurements of the elastic mechanical properties of human skin by indentation tests. , 2008, Medical engineering & physics.

[28]  Alan Liu,et al.  A Survey of Surgical Simulation: Applications, Technology, and Education , 2003, Presence: Teleoperators & Virtual Environments.

[29]  Mukul Mukherjee,et al.  Medicine Meets Virtual Reality 14 , 2005 .

[30]  Leif Kobbelt,et al.  Using Simulated Annealing to Obtain Good Nodal Approximations of Deformable Bodies , 1995 .

[31]  Tien-Tsin Wong,et al.  Orthopedics Surgery Trainer with PPU-Accelerated Blood and Tissue Simulation , 2007, MICCAI.

[32]  Nicholas Ayache,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2007, 10th International Conference, Brisbane, Australia, October 29 - November 2, 2007, Proceedings, Part I , 2007, MICCAI.

[33]  Lance Chun Che Fung,et al.  Distinguishing games and simulation games from simulators , 2006, CIE.

[34]  Frank Tendick,et al.  GiPSi: a framework for open source/open architecture software development for organ-level surgical simulation , 2006, IEEE Transactions on Information Technology in Biomedicine.