Physics-Based Interactive Volume Manipulation for Sharing Surgical Process

This paper presents a new set of techniques by which surgeons can interactively manipulate patient-specific volumetric models for sharing surgical process. To handle physical interaction between the surgical tools and organs, we propose a simple surface-constraint-based manipulation algorithm to consistently simulate common surgical manipulations such as grasping, holding and retraction. Our computation model is capable of simulating soft-tissue deformation and incision in real time. We also present visualization techniques in order to rapidly visualize time-varying, volumetric information on the deformed image. This paper demonstrates the success of the proposed methods in enabling the simulation of surgical processes, and the ways in which this simulation facilitates preoperative planning and rehearsal.

[1]  Markus H. Gross,et al.  A state machine for real-time cutting of tetrahedral meshes , 2004, Graph. Model..

[2]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[3]  M. Riemer,et al.  A new representation of knowledge concerning human anatomy and function , 1995, Nature Medicine.

[4]  Hiroshi Oyama,et al.  Physics-Based Simulation of Surgical Fields for Preoperative Strategic Planning , 2006, Journal of Medical Systems.

[5]  B Pflesser,et al.  Planning and rehearsal of surgical interventions in the volume model. , 2000, Studies in health technology and informatics.

[6]  U. Ku,et al.  Endoscopic surgery training using virtual reality and deformable tissue simulation , 2000 .

[7]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[8]  Andrea Giachetti,et al.  Adaptive techniques for real-time haptic and visual simulation of bone dissection , 2003, IEEE Virtual Reality, 2003. Proceedings..

[9]  Ronald Fedkiw,et al.  Arbitrary cutting of deformable tetrahedralized objects , 2007, SCA '07.

[10]  R A Robb,et al.  Dynamic volume texture mapping and model deformation for visually realistic surgical simulation. , 1999, Studies in health technology and informatics.

[11]  Gábor Székely,et al.  Hybrid Cutting of Deformable Solids , 2006, IEEE Virtual Reality Conference (VR 2006).

[12]  Günther Greiner,et al.  Fast volumetric deformation on general purpose hardware , 2001, HWWS '01.

[13]  Markus H. Gross,et al.  Interactive Virtual Materials , 2004, Graphics Interface.

[14]  Hiroshi Oyama,et al.  Transferring bioelasticity knowledge through haptic interaction , 2006, IEEE MultiMedia.

[15]  Yoshinori Mori,et al.  Kidney displacement simulator for retroperitoneal laparoscopic nephrectomy. , 2005, The Journal of urology.

[16]  Min Chen,et al.  Feature Aligned Volume Manipulation for Illustration and Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[17]  Ichiro Sakuma,et al.  Development of surgical simulator based on FEM and deformable volume-rendering , 2004, Medical Imaging: Image-Guided Procedures.

[18]  Mark A. Ganter,et al.  Real-time finite element modeling for surgery simulation: an application to virtual suturing , 2004, IEEE Transactions on Visualization and Computer Graphics.

[19]  Marc Levoy,et al.  Efficient ray tracing of volume data , 1990, TOGS.

[20]  Stephane Cotin,et al.  Real Time Volumetric Deformable Models for Surgery Simulation , 1996, VBC.

[21]  Han-Wen Nienhuys,et al.  Combining finite element deformation with cutting for surgery simulations , 2000, Eurographics.

[22]  Stephane Cotin,et al.  A hybrid elastic model for real-time cutting, deformations, and force feedback for surgery training and simulation , 2000, The Visual Computer.

[23]  Alan Liu,et al.  A Survey of Surgical Simulation: Applications, Technology, and Education , 2003, Presence: Teleoperators & Virtual Environments.

[24]  Tomohiro Kuroda,et al.  Organ Exclusion Simulation with Multi-finger Haptic Interaction for Open Surgery Simulator , 2007, MMVR.

[25]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[26]  Elliot K. Fishman,et al.  Surgical Planning for Liver Resection , 1996, Computer.

[27]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2006, Comput. Graph. Forum.

[28]  Septimiu E. Salcudean,et al.  Interactive simulation of needle insertion models , 2005, IEEE Transactions on Biomedical Engineering.