Volumetric object modeling for surgical simulation

Surgical simulation has many applications in medical education, surgical training, surgical planning and intra-operative assistance. However, extending current surface-based computer graphics methods to model phenomena such as the deformation, cutting, tearing or repairing of soft tissues poses significant challenges for real-time interactions. This paper discusses the use of volumetric methods for modeling complex anatomy and tissue interactions. New techniques are introduced that use volumetric methods for modeling soft-tissue deformation and tissue cutting at interactive rates. An initial prototype for simulating arthroscopic knee surgery is described which uses volumetric models of the knee derived from 3-D magnetic resonance imaging, visual feedback via real-time volume and polygon rendering, and haptic feedback provided by a force-feedback device.

[1]  R Ziegler,et al.  Virtual reality in surgical arthroscopic training. , 1995, Journal of image guided surgery.

[2]  B. Neisius,et al.  The Karlsruhe Endoscopic Surgery Trainer as an example for virtual reality in medical education , 1997 .

[3]  J.M.A. Lenihan,et al.  Biomechanics — Mechanical properties of living tissue , 1982 .

[4]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[5]  Sarah F. Frisken,et al.  EM-Cube: an architecture for low-cost real-time volume rendering , 1997, HWWS '97.

[6]  Wolfgang Müller,et al.  A Virtual Reality Medical Training System , 1995, CVRMed.

[7]  Lynette A. Jones,et al.  A Teleoperated Microsurgical Robot and Associated Virtual Environment for Eye Surgery , 1993, Presence: Teleoperators & Virtual Environments.

[8]  Sarah F. Frisken.  3D Chainmail: A Fast Algorithm for Deforming Volumetric Objects , 1997, SI3D.

[9]  Jane Wilhelms,et al.  AN ANALYSIS OF APPROACHES TO RAY-TRACING CURVILINEAR GRIDS , 1992 .

[10]  B. H. McCormick,et al.  Visualization in scientific computing , 1995 .

[11]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[12]  David Baraff,et al.  Analytical methods for dynamic simulation of non-penetrating rigid bodies , 1989, SIGGRAPH.

[13]  Norberto F. Ezquerra,et al.  Interactively deformable models for surgery simulation , 1993, IEEE Computer Graphics and Applications.

[14]  Ron Kikinis,et al.  Simulation of Endoscopy , 1995, CVRMed.

[15]  Sarah Gibson,et al.  Beyond Volume Rendering: Visualization, Haptic Exploration, and Physical Modeling of Voxel-based Objects , 1995 .

[16]  John F. Canny,et al.  Impulse-based simulation of rigid bodies , 1995, I3D '95.

[17]  H Delingette,et al.  Geometric and physical representations for a simulator of hepatic surgery. , 1996, Studies in health technology and informatics.

[18]  D. Vining.  Virtual colonoscopy. , 1999, Seminars in ultrasound, CT, and MR.

[19]  Paul F. Hemler,et al.  Freeflight: a virtual endoscopy system , 1997, CVRMed.

[20]  Kenton R. Kaufman.  Muscle and joint forces in the knee during isokinetic exercise , 1990 .

[21]  Jocelyne Troccaz,et al.  CVRMed-MRCAS'97 , 1997, Lecture Notes in Computer Science.

[22]  Morten Bro-Nielsen,et al.  Modelling Elasticity in Solids Using Active Cubes - Application to Simulated Operations , 1995, CVRMed.

[23]  John F. Hughes,et al.  Sculpting: an interactive volumetric modeling technique , 1991, SIGGRAPH.

[24]  William E. Lorensen,et al.  The Exploration of Cross-Sectional Data with a Virtual Endoscope , 1995 .

[25]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[26]  Robert Scott Fijan.  A three-dimensional mathematical model of the human knee joint , 1990 .

[27]  Arie E. Kaufman.  Volume visualization , 1996, CSUR.

[28]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[29]  H. Grootenboer,et al.  Articular contact in a three-dimensional model of the knee. , 1991, Journal of biomechanics.

[30]  Steven D. Pieper,et al.  CAPS: computer-aided plastic surgery , 1992 .

[31]  Chandrajit L. Bajaj,et al.  Comprehensive Analysis of Joints from Patient Clinical Data , 1997 .

[32]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[33]  Zhengrong Liang,et al.  3D virtual colonoscopy , 1995, Proceedings 1995 Biomedical Visualization.

[34]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[35]  M. Bro-Nielsen.  Fast finite elements for surgery simulation. , 1997, Studies in health technology and informatics.

[36]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[37]  Ricardo S. Avila,et al.  A haptic interaction method for volume visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[38]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[39]  R H Choplin,et al.  Virtual Bronchoscopy: Relationships of Virtual Reality Endobronchial Simulations to Actual Bronchoscopic Findings , 1996 .

[40]  Y. Fung,et al.  Biomechanics: Mechanical Properties of Living Tissues , 1981 .

[41]  Arie E. Kaufman,et al.  Volume sculpting , 1995, I3D '95.

[42]  Robert D. Howe,et al.  Remote Palpation Technology for Surgical Applications , 1995 .

[43]  David Baraff,et al.  Curved surfaces and coherence for non-penetrating rigid body simulation , 1990, SIGGRAPH.

[44]  Hwj Rik Huiskes,et al.  An in-vitro study of the passive kinematic behavior of the human knee-joint , 1984 .

[45]  Robert D. Howe,et al.  Remote palpation technology , 1995 .

[46]  William E. Lorensen,et al.  Decimation of triangle meshes , 1992, SIGGRAPH.

[47]  Peter Shirley,et al.  A polygonal approximation to direct scalar volume rendering , 1990, SIGGRAPH 1990.

[48]  Peter L. Williams.  Interactive splatting of nonrectilinear volumes , 1992, Proceedings Visualization '92.