Real-time haptic incision simulation using FEM-based discontinuous free-form deformation

Computer-aided surgical simulation is a topic of increasingly extensive research. Computer graphics, geometrical modelling and finite-element analysis all play major roles in these simulations. Furthermore, real-time response, interactivity and accuracy are crucial components in any such simulation system. A major effort has been invested in recent years to find ways to improve the performance, accuracy and realism of existing systems. In this paper, we extend the work of [Sela G, Schein S, Elber G. Real-time incision simulation using discontinuous free form deformation. In: Cotin S, Metaxas DN, editors. Medical simulation: International symposium, 2004. Lecture notes in computer science, vol. 3078. Springer; 2004. p. 114-123], in which we used discontinuous free-form deformations (DFFD) to artificially simulate real-time surgical operations. The presented scheme now uses accurate data from a finite-element model (FEM), which simulates the motion response of the tissue around the scalpel, during incision. The data are then encoded once into the DFFD, representing the simulation over time. In real-time, The DFFD is applied to the vertices of the surface mesh at the actual incision location and time. The presented scheme encapsulates and takes advantage of both the speed of the DFFD application, and the accuracy of a FEM. In addition, the presented system uses a haptic force feedback device in order to improve realism and ease of use.

[1]  W SederbergThomas,et al.  Free-form deformation of solid geometric models , 1986 .

[2]  BerkleyJeffrey,et al.  Real-Time Finite Element Modeling for Surgery Simulation , 2004 .

[3]  Markus H. Gross,et al.  Interactive Cuts through 3‐Dimensional Soft Tissue , 1999, Comput. Graph. Forum.

[4]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[5]  Gershon Elber,et al.  Geometric modeling with splines - an introduction , 2001 .

[6]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[7]  Fabio Ganovelli,et al.  Animating cuts with on-the-fly re-meshing , 2001, Eurographics.

[8]  Libor Preucil,et al.  European Robotics Symposium 2008 , 2008 .

[9]  Gershon Elber,et al.  Real-Time Incision Simulation Using Discontinuous Free Form Deformation , 2004, ISMS.

[10]  Hervé Delingette,et al.  Cutting Simulation of Manifold Volumetric Meshes , 2002, MICCAI.

[11]  Han-Wen Nienhuys,et al.  A Surgery Simulation Supporting Cuts and Finite Element Deformation , 2001, MICCAI.

[12]  TerzopoulosDemetri,et al.  Elastically deformable models , 1987 .

[13]  Pheng-Ann Heng,et al.  A hybrid condensed finite element model with GPU acceleration for interactive 3D soft tissue cutting , 2004, Comput. Animat. Virtual Worlds.

[14]  Han-Wen Nienhuys,et al.  A Delaunay Approach to Interactive Cutting in Triangulated Surfaces , 2002, WAFR.

[15]  Takeo Kanade,et al.  Modifying Soft Tissue Models: Progressive Cutting with Minimal New Element Creation , 2000, MICCAI.

[16]  Mark A. Ganter,et al.  Real-time finite element modeling for surgery simulation: an application to virtual suturing , 2004, IEEE Transactions on Visualization and Computer Graphics.

[17]  Tom Lyche,et al.  Discrete B-splines and subdivision techniques in computer-aided geometric design and computer graphics , 1980 .

[18]  Simon K. Warfield,et al.  Modelling Surgical Cuts, Retractions, and Resections via Extended Finite Element Method , 2004, MICCAI.

[19]  Han-Wen Nienhuys,et al.  Combining finite element deformation with cutting for surgery simulations , 2000, Eurographics.

[20]  Cynthia Bruyns,et al.  Interactive cutting of 3D surface meshes , 2001, Comput. Graph..

[21]  M. Bro-Nielsen,et al.  Finite element modeling in surgery simulation , 1998, Proc. IEEE.

[22]  Gershon Elber,et al.  Discontinuous free form deformations , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[23]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.