An intestinal surgery simulator: real-time collision processing and visualization

This research work is aimed toward the development of a VR-based trainer for colon cancer removal. It enables the surgeons to interactively view and manipulate the concerned virtual organs as during a real surgery. First, we present a method for animating the small intestine and the mesentery (the tissue that connects it to the main vessels) in real-time, thus enabling user interaction through virtual surgical tools during the simulation. We present a stochastic approach for fast collision detection in highly deformable, self-colliding objects. A simple and efficient response to collisions is also introduced in order to reduce the overall animation complexity. Second, we describe a new method based on generalized cylinders for fast rendering of the intestine. An efficient curvature detection method, along with an adaptive sampling algorithm, is presented. This approach, while providing improved tessellation without the classical self-intersection problem, also allows for high-performance rendering thanks to the new 3D skinning feature available in recent GPUs. The rendering algorithm is also designed to ensure a guaranteed frame rate. Finally, we present the quantitative results of the simulations and describe the qualitative feedback obtained from the surgeons.

[1]  H. Fischer.  Radiology of the Digestive System. , 1966 .

[2]  Gerald J. Agin.  Representation and description of curved objects , 1972 .

[3]  Thomas O. Binford,et al.  Computer Description of Curved Objects , 1973, IEEE Transactions on Computers.

[4]  Fujio Yamaguchi,et al.  Curves and Surfaces in Computer Aided Geometric Design , 1988, Springer Berlin Heidelberg.

[5]  John C. Platt,et al.  Constraints methods for flexible models , 1988, SIGGRAPH.

[6]  J. Bloomenthal.  Calculation of reference frames along a space curve , 1990 .

[7]  Gershon Elber,et al.  Second-order surface analysis using hybrid symbolic and numeric operators , 1993, TOGS.

[8]  Dinesh Manocha,et al.  I-COLLIDE: an interactive and exact collision detection system for large-scale environments , 1995, I3D '95.

[9]  Richard L. Grimsdale,et al.  Collision Detection for Animation using Sphere‐Trees , 1995, Comput. Graph. Forum.

[10]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[11]  Mel Slater,et al.  The sensitivity of presence to collision response , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[12]  Gino van den Bergen.  Efficient Collision Detection of Complex Deformable Models using AABB Trees , 1997, J. Graphics, GPU, & Game Tools.

[13]  Les A. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communication.

[14]  M. Bro-Nielsen,et al.  Finite element modeling in surgery simulation , 1998, Proc. IEEE.

[15]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[16]  Joseph S. B. Mitchell,et al.  Efficient Collision Detection Using Bounding Volume Hierarchies of k-DOPs , 1998, IEEE Trans. Vis. Comput. Graph..

[17]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[18]  Jean-Christophe Lombardo,et al.  Real-time collision detection for virtual surgery , 1999, Proceedings Computer Animation 1999.

[19]  Stephane Cotin,et al.  A hybrid elastic model for real-time cutting, deformations, and force feedback for surgery training and simulation , 2000, The Visual Computer.

[20]  Christophe Chaillou,et al.  A deformable body model for surgical simulation , 2000, Comput. Animat. Virtual Worlds.

[21]  David H. Eberly,et al.  3D game engine design - a practical approach to real-time computer graphics , 2000 .

[22]  Gábor Székely,et al.  Modelling of soft tissue deformation for laparoscopic surgery simulation , 2000, Medical Image Anal..

[23]  Mathieu Desbrun,et al.  Dynamic real-time deformations using space & time adaptive sampling , 2001, SIGGRAPH.

[24]  François Faure,et al.  Implicit representations of the human intestines for surgery simulations , 2002 .

[25]  Steve Capell,et al.  Interactive skeleton-driven dynamic deformations , 2002, ACM Trans. Graph..

[26]  Gábor Székely,et al.  Inverse Finite Element Characterization of Soft Tissues , 2001, MICCAI.

[27]  Carol O'Sullivan,et al.  Sphere-tree construction using dynamic medial axis approximation , 2002, SCA '02.

[28]  Eitan Grinspun,et al.  CHARMS: a simple framework for adaptive simulation , 2002, ACM Trans. Graph..

[29]  Christophe Chaillou,et al.  Simulation of a Minimally Invasive Surgery of Intestines , 2002 .

[30]  Jules Bloomenthal,et al.  Medial-based vertex deformation , 2002, SCA '02.

[31]  Carol O'Sullivan,et al.  Complementarity based multiple point collision resolution , 2003 .

[32]  Christophe Chaillou,et al.  A Physically-Based Virtual Environment Dedicated to Surgical Simulation , 2003, IS4TH.

[33]  Marie-Paule Cani,et al.  Real-Time Simulation of Self-collisions for Virtual Intestinal Surgery , 2003, IS4TH.

[34]  Laurent Grisoni,et al.  High performance generalized cylinders visualization , 2003, 2003 Shape Modeling International..

[35]  Gilles Debunne,et al.  Monte-Carlo collision detection , 2004 .