Haptic Surgical Simulation: An Application to Virtual Suture

AbstractVirtual surgical planning and training require high fidelity not only in visual modeling, but also in haptic modeling. As a fundamental and typical application of surgical simulation, virtual suturing deals with technical problems such as soft tissue modeling, collision detection, and force modeling. In this paper, a haptic system of virtual suture is developed for surgical training. A realistic tissue modeling method based on either MRI or CT images is proposed. Given a CT or MRI file, an STL file is constructed. The STL file is voxelized to generate a regular spatial lattice that provides the basis for constructing the mass-spring system (MSS). Surface textures are mapped to this MSS for better visual effect of human tissues. Haptic interaction between the tissue model and a haptic device is rendered on a piecewise linear stress-strain model. A prototype system based on the proposed method is implemented. When using this system, a user can feel the force change at different stage of the suturing...

[1]  Septimiu E. Salcudean,et al.  Needle insertion modeling and simulation , 2003, IEEE Trans. Robotics Autom..

[2]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[3]  Mark A. Ganter,et al.  Real-time finite element modeling for surgery simulation: an application to virtual suturing , 2004, IEEE Transactions on Visualization and Computer Graphics.

[4]  Allison M. Okamura,et al.  Force modeling for needle insertion into soft tissue , 2004, IEEE Transactions on Biomedical Engineering.

[5]  Markus H. Gross,et al.  Interactive simulation of surgical cuts , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[6]  Kevin Montgomery,et al.  Generalized interactions using virtual tools within the spring framework: cutting. , 2002, Studies in health technology and informatics.

[7]  Uwe G. Kühnapfel,et al.  Endoscopic surgery training using virtual reality and deformable tissue simulation , 2000, Computers & graphics.

[8]  Walter Maurel,et al.  Biomechanical Models for Soft Tissue Simulation , 2003, Esprit Basic Research Series.

[9]  Daniel Thalmann,et al.  Real time muscle deformations using mass-spring systems , 1998, Proceedings. Computer Graphics International (Cat. No.98EX149).

[10]  Marie-Paule Cani,et al.  Controlling Anisotropy in Mass-Spring Systems , 2000, Computer Animation and Simulation.

[11]  Christian Laugier,et al.  Towards a Realistic Medical Simulator using Virtual Environments and Haptic Interaction , 2001, ISRR.

[12]  Jean-Claude Latombe,et al.  A Microsurgery Simulation System , 2001, MICCAI.

[13]  Gino van den Bergen.  Efficient Collision Detection of Complex Deformable Models using AABB Trees , 1997, J. Graphics, GPU, & Game Tools.

[14]  Stephane Cotin,et al.  Real Time Volumetric Deformable Models for Surgery Simulation , 1996, VBC.

[15]  Stephane Cotin,et al.  A hybrid elastic model for real-time cutting, deformations, and force feedback for surgery training and simulation , 2000, The Visual Computer.

[16]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[17]  Allison M Okamura,et al.  Haptic rendering of tissue cutting with scissors. , 2004, Studies in health technology and informatics.

[18]  Hervé Delingette,et al.  Anisotropic elasticity and force extrapolation to improve realism of surgery simulation , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Terry Hewitt,et al.  Adaptive refinement for mass/spring simulations , 1996 .

[20]  M. Bro-Nielsen,et al.  Finite element modeling in surgery simulation , 1998, Proc. IEEE.

[21]  Suvranu De,et al.  Computationally efficient techniques for real time surgical simulation with force feedback , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[22]  Ming C. Lin,et al.  Collision Detection between Geometric Models: A Survey , 1998 .

[23]  Cagatay Basdogan,et al.  Virtual environments for medical training: graphical and haptic simulation of laparoscopic common bile duct exploration , 2001 .