Simulating Surgery using Volumetric Object Representations, Real-Time Volume Rendering and Haptic Feedback

Surgical simulation has many applications in education and training, surgical planning, and intraoperative assistance. However, extending current surface-based computer graphics methods to model phenomena such as the deformation, cutting, tearing, or repairing of soft tissues pose significant challenges for real-time interactions. In this paper, the use of volumetric methods for modeling complex anatomy and tissue interactions is introduced. New techniques for modeling soft tissue deformation and tissue cutting at interactive rates are detailed. In addition, an initial prototype for simulating arthroscopic knee surgery that has resulted from an ongoing collaboration is described. Volumetric models for the knee simulator were derived from 3D Magnetic Resonance Imaging. Visual and haptic feedback is provided to the user via real-time volume and polygon rendering and a force feedback device.

[1]  Norberto F. Ezquerra,et al.  Interactively deformable models for surgery simulation , 1993, IEEE Computer Graphics and Applications.

[2]  Ron Kikinis,et al.  Simulation of Endoscopy , 1995, CVRMed.

[3]  D. Vining.  Virtual colonoscopy. , 1999, Seminars in ultrasound, CT, and MR.

[4]  Arie E. Kaufman.  Volume visualization , 1996, CSUR.

[5]  Steven D. Pieper,et al.  CAPS: computer-aided plastic surgery , 1992 .

[6]  Sarah F. Frisken.  3D Chainmail: A Fast Algorithm for Deforming Volumetric Objects , 1997, SI3D.

[7]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[8]  Zhengrong Liang,et al.  3D virtual colonoscopy , 1995, Proceedings 1995 Biomedical Visualization.

[9]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[10]  Ricardo S. Avila,et al.  A haptic interaction method for volume visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[11]  Lynette A. Jones,et al.  A Teleoperated Microsurgical Robot and Associated Virtual Environment for Eye Surgery , 1993, Presence: Teleoperators & Virtual Environments.

[12]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[13]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[14]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[15]  John F. Canny,et al.  Impulse-based simulation of rigid bodies , 1995, I3D '95.

[16]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[17]  Sarah F. Frisken.  Beyond volume rendering: visualization, haptic exploration, and physical modeling of voxel-based objects , 1995, Visualization in Scientific Computing.

[18]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[19]  Arie E. Kaufman,et al.  Volume sculpting , 1995, I3D '95.

[20]  David Baraff,et al.  Analytical methods for dynamic simulation of non-penetrating rigid bodies , 1989, SIGGRAPH.

[21]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[22]  Jane Wilhelms,et al.  AN ANALYSIS OF APPROACHES TO RAY-TRACING CURVILINEAR GRIDS , 1992 .

[23]  John F. Hughes,et al.  Sculpting: an interactive volumetric modeling technique , 1991, SIGGRAPH.

[24]  P. Shirley,et al.  A polygonal approximation to direct scalar volume rendering , 1990, VVS.

[25]  William E. Lorensen,et al.  The Exploration of Cross-Sectional Data with a Virtual Endoscope , 1995 .

[26]  Christian Kuhn,et al.  Endosurgery simulations with KISMET: a flexible tool for surgical instrument design, operation room planning and VR technology based abdominal surgery training , 1995 .

[27]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[28]  H Delingette,et al.  Geometric and physical representations for a simulator of hepatic surgery. , 1996, Studies in health technology and informatics.

[29]  John F. Hughes,et al.  Direct manipulation of free-form deformations , 1992, SIGGRAPH.