A physically-based framework for real-time haptic cutting and interaction with 3D continuum models

General haptic interaction with solid models requires an underlying physically-based model that can generate, in real-time, the forces and deformations to be rendered as a result of user interaction. In order to allow for a rich set of interactions, the physical model must support real-time topological modifications including the embedding of new elements in the model, and the introduction of cuts in the geometry. In this paper, we describe and demonstrate a physically-based framework for real-time interaction with 3D solid models discretized by finite elements. We present a model formulation that allows for fast progressive updates to be used in modeling the addition of new elements as well as dynamic inter- and intra-element changes in model connectivity. Our motivating applications have been in the area of open suturing simulations where cutting through skin and tissue, undermining skin to separate it from the underlying soft tissue, addition of sutures to close wounds, and manipulation using multiple surgical instruments simultaneously, are all tasks that must be supported. We show a new surgical simulator we recently developed to demonstrate the framework.

[1]  Fabio Ganovelli,et al.  Simulating Drilling on Tetrahedral Meshes , 2006, Eurographics.

[2]  Ming C. Lin,et al.  A Simulation-based VR System for Interactive Hairstyling , 2006, IEEE Virtual Reality Conference (VR 2006).

[3]  Jack J. Dongarra,et al.  Automatically Tuned Linear Algebra Software , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[4]  Eitan Grinspun,et al.  CHARMS: a simple framework for adaptive simulation , 2002, ACM Trans. Graph..

[5]  Ted Belytschko,et al.  A finite element method for crack growth without remeshing , 1999 .

[6]  Leonard McMillan,et al.  Stable real-time deformations , 2002, SCA '02.

[7]  Kevin Montgomery,et al.  Generalized interactions using virtual tools within the spring framework: cutting. , 2002, Studies in health technology and informatics.

[8]  Pheng-Ann Heng,et al.  An improved scheme of an interactive finite element model for 3D soft-tissue cutting and deformation , 2005, The Visual Computer.

[9]  Markus H. Gross,et al.  Interactive simulation of surgical cuts , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[10]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[11]  Michael Garland,et al.  Sketching mesh deformations , 2005, SI3D.

[12]  John M. Snyder,et al.  Large mesh deformation using the volumetric graph Laplacian , 2005, SIGGRAPH '05.

[13]  Fabio Ganovelli,et al.  Animating cuts with on-the-fly re-meshing , 2001, Eurographics.

[14]  James F. O'Brien,et al.  Graphical modeling and animation of ductile fracture , 2002, SIGGRAPH '02.

[15]  Jules Bloomenthal,et al.  Medial-based vertex deformation , 2002, SCA '02.

[16]  Leif Kobbelt,et al.  An intuitive framework for real-time freeform modeling , 2004, SIGGRAPH 2004.

[17]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[18]  Gene H. Golub,et al.  Matrix computations , 1983 .

[19]  Mathieu Desbrun,et al.  Discrete shells , 2003, SCA '03.

[20]  George M. Turkiyyah,et al.  Flexible bones for the haptic prototyping of deformable objects , 2003, Virtual Reality.

[21]  L. E. Malvern Introduction to the mechanics of a continuous medium , 1969 .

[22]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[23]  Ronald Fedkiw,et al.  A virtual node algorithm for changing mesh topology during simulation , 2004, SIGGRAPH 2004.

[24]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[25]  Nadia Magnenat-Thalmann,et al.  Accurate Garment Prototyping and Simulation , 2005 .

[26]  Mark A. Ganter,et al.  Real-time finite element modeling for surgery simulation: an application to virtual suturing , 2004, IEEE Transactions on Visualization and Computer Graphics.

[27]  Gino van den Bergen,et al.  Collision Detection , 2003, Real-Time Rendering.

[28]  Han-Wen Nienhuys,et al.  A Surgery Simulation Supporting Cuts and Finite Element Deformation , 2001, MICCAI.

[29]  Markus H. Gross,et al.  A state machine for real-time cutting of tetrahedral meshes , 2004, Graph. Model..

[30]  Daniel Thalmann,et al.  Multi-Finger Haptic Rendering of Deformable Objects , 2004, EGVE.

[31]  Paolo Cignoni,et al.  A Multiresolution Model for Soft Objects Supporting Interactive Cuts and Lacerations , 2000, Comput. Graph. Forum.

[32]  Jean-Claude Latombe,et al.  Real-time simulation of deformable objects: tools and application , 2001, Proceedings Computer Animation 2001. Fourteenth Conference on Computer Animation (Cat. No.01TH8596).

[33]  Gershon Elber,et al.  Real-time haptic incision simulation using FEM-based discontinuous free-form deformation , 2007, Comput. Aided Des..

[34]  Joel Brown,et al.  Spring: a general framework for collaborative, real-time surgical simulation. , 2002, Studies in health technology and informatics.

[35]  Gino van den Bergen Collision Detection in Interactive 3D Environments , 2003 .

[36]  Uwe G. Kühnapfel,et al.  Endoscopic surgery training using virtual reality and deformable tissue simulation , 2000, Computers & graphics.