Simulating arthroscopic knee surgery using volumetric object representations, real-time volume rendering and haptic feedback

A system for simulating arthroscopic knee surgery that is based on volumetric object models derived from 3D Magnetic Resonance Imaging is presented. Feedback is provided to the user via real-time volume rendering and force feedback for haptic exploration. The system is the result of a unique collaboration between an industrial research laboratory, two major universities, and a leading research hospital. In this paper, components of the system are detailed and the current state of the integrated system is presented. Issues related to future research and plans for expanding the current system are discussed.

[1]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[2]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[3]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[4]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[5]  Zhengrong Liang,et al.  3D virtual colonoscopy , 1995, Proceedings 1995 Biomedical Visualization.

[6]  Jane Wilhelms,et al.  AN ANALYSIS OF APPROACHES TO RAY-TRACING CURVILINEAR GRIDS , 1992 .

[7]  David Baraff,et al.  Analytical methods for dynamic simulation of non-penetrating rigid bodies , 1989, SIGGRAPH.

[8]  Sarah F. Frisken.  3D Chainmail: A Fast Algorithm for Deforming Volumetric Objects , 1997, SI3D.

[9]  Sarah F. Frisken.  Beyond volume rendering: visualization, haptic exploration, and physical modeling of voxel-based objects , 1995, Visualization in Scientific Computing.

[10]  William E. Lorensen,et al.  The Exploration of Cross-Sectional Data with a Virtual Endoscope , 1995 .

[11]  John F. Canny,et al.  Impulse-based simulation of rigid bodies , 1995, I3D '95.

[12]  Lynette A. Jones,et al.  A Teleoperated Microsurgical Robot and Associated Virtual Environment for Eye Surgery , 1993, Presence: Teleoperators & Virtual Environments.

[13]  David Baraff,et al.  Curved surfaces and coherence for non-penetrating rigid body simulation , 1990, SIGGRAPH.

[14]  Sabrina S Wilson.  Radiology , 1938, Glasgow Medical Journal.

[15]  Peter Shirley,et al.  A polygonal approximation to direct scalar volume rendering , 1990, SIGGRAPH 1990.

[16]  Norberto F. Ezquerra,et al.  Interactively deformable models for surgery simulation , 1993, IEEE Computer Graphics and Applications.

[17]  Ron Kikinis,et al.  Simulation of Endoscopy , 1995, CVRMed.

[18]  Arie E. Kaufman,et al.  Volume sculpting , 1995, I3D '95.

[19]  D. Vining.  Virtual colonoscopy. , 1999, Seminars in ultrasound, CT, and MR.

[20]  John F. Hughes,et al.  Direct manipulation of free-form deformations , 1992, SIGGRAPH.

[21]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[22]  H Delingette,et al.  Geometric and physical representations for a simulator of hepatic surgery. , 1996, Studies in health technology and informatics.

[23]  Norberto F. Ezquerra,et al.  Interactively deformable models for surgery simulation : Graphics in medicine , 1993 .

[24]  Arie E. Kaufman.  Volume visualization , 1996, CSUR.

[25]  Steven D. Pieper,et al.  CAPS: computer-aided plastic surgery , 1992 .

[26]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[27]  Ricardo S. Avila,et al.  A haptic interaction method for volume visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[28]  Christian Kuhn,et al.  Endosurgery simulations with KISMET: a flexible tool for surgical instrument design, operation room planning and VR technology based abdominal surgery training , 1995 .