Haptic Interaction of Organs Based on the Spherical Harmonic Representation

Visual and haptic organ interactions in real time are essential in virtual reality–based medical simulations to provide training, early diagnosis, and improved treatment planning. This work presents a robust method of computing the deformation of an elastic object when external forces are applied. Point-based haptic interaction between the user of the haptic device and an object is outlined and is formulated as a deformation problem over the surface. The model is expressed in the spherical harmonic basis, from which both haptic device force feedback and object surface updates are calculated. Haptic and visual updates are performed in the same basis, in turn providing significant benefits of computing efficiency and multiresolution modeling. Partially, this is due to the fact that in the model the objects are represented as surfaces. A haptic device is used to probe different prostates that have been segmented and reconstructed from MR images to validate the findings. The calculated deformation and feedback force is further validated against the established finite element method.

[1]  Allison M. Okamura,et al.  Modeling of Tool-Tissue Interactions for Computer-Based Surgical Simulation: A Literature Review , 2008, PRESENCE: Teleoperators and Virtual Environments.

[2]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[3]  Ming C. Lin,et al.  CLODs: Dual Hierarchies for Multiresolution Collision Detection , 2003, Symposium on Geometry Processing.

[4]  M. Bro-Nielsen,et al.  Finite element modeling in surgery simulation , 1998, Proc. IEEE.

[5]  Jeffrey D. Smith,et al.  Finite element methods for real-time haptic feedback of soft-tissue models in virtual reality simulators , 2001, Proceedings IEEE Virtual Reality 2001.

[6]  Jean-Louis Dillenseger,et al.  Spherical Harmonics Based Intrasubject 3-D Kidney Modeling/Registration Technique Applied on Partial Information , 2006, IEEE Transactions on Biomedical Engineering.

[7]  Kenneth E. Barner,et al.  A Displacement Driven Real-Time Deformable Model For Haptic Surgery Simulation , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[8]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2006, Comput. Graph. Forum.

[9]  Mathieu Desbrun,et al.  Dynamic real-time deformations using space & time adaptive sampling , 2001, SIGGRAPH.

[10]  Christian Duriez,et al.  Realistic haptic rendering of interacting deformable objects in virtual environments , 2008, IEEE Transactions on Visualization and Computer Graphics.

[11]  Yonghua Chen,et al.  A Haptic Virtual Turning Operation System , 2006, 2006 International Conference on Mechatronics and Automation.

[12]  Heng Huang,et al.  Three-dimensional Models for Cardiac Bioelectricity Simulation: Cell to Organ , 2007, Simul..

[13]  Stephen D. Laycock,et al.  A Survey of Haptic Rendering Techniques , 2007, Comput. Graph. Forum.

[14]  K. Miller,et al.  Total Lagrangian explicit dynamics finite element algorithm for computing soft tissue deformation , 2006 .

[15]  Karol Miller,et al.  Suite of finite element algorithms for accurate computation of soft tissue deformation for surgical simulation , 2009, Medical Image Anal..

[16]  Demetri Terzopoulos,et al.  Adaptive meshes and shells: irregular triangulation, discontinuities, and hierarchical subdivision , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Xiaogang Wang,et al.  A virtual reality based 3D real-time interactive brachytherapy simulation of needle insertion and seed implantation , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[18]  P. Ström,et al.  Early exposure to haptic feedback enhances performance in surgical simulator training: a prospective randomized crossover study in surgical residents , 2006, Surgical Endoscopy And Other Interventional Techniques.

[19]  Bijan Shirinzadeh,et al.  Soft tissue modelling through autowaves for surgery simulation , 2006, Medical and Biological Engineering and Computing.

[20]  Hiroshi Oyama,et al.  FEM-based interaction model between elastic objects for indirect palpation simulator. , 2004, Studies in health technology and informatics.

[21]  Hervé Delingette,et al.  Computational Models for Image-Guided Robot-Assisted and Simulated Medical Interventions , 2006, Proceedings of the IEEE.

[22]  Mariano Alcañiz Raya,et al.  A new approach for the real-time simulation of tissue deformations in surgery simulation , 2001, Comput. Methods Programs Biomed..

[23]  P. Ask,et al.  Computer analysis of hyperthermia treatment of the prostate , 1997 .

[24]  Eric L. Miller,et al.  Spherical harmonics microwave algorithm for shape and location reconstruction of breast cancer tumor , 2006, IEEE Transactions on Medical Imaging.

[25]  Hervé Delingette,et al.  Toward realistic soft-tissue modeling in medical simulation , 1998, Proc. IEEE.

[26]  Moo K. Chung,et al.  Encoding Neuroanatomical Information using Weighted Spherical Harmonic Representation , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[27]  Fernando Bello,et al.  Online Multiresolution Volumetric Mass Spring Model for Real Time Soft Tissue Deformation , 2002, MICCAI.

[28]  R. Balaniuk,et al.  LEM-an approach for real time physically based soft tissue simulation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[29]  Yongmin Kim,et al.  Semiautomatic 3-D Prostate Segmentation from TRUS Images Using Spherical Harmonics , 2006, IEEE Transactions on Medical Imaging.

[30]  Lutz Gross,et al.  Interface modeling in incompressible media using level sets in Escript , 2007 .

[31]  Hiroshi Oyama,et al.  Interaction model between elastic objects for haptic feedback considering collisions of soft tissue , 2005, Comput. Methods Programs Biomed..

[32]  Guido Gerig,et al.  Parametrization of Closed Surfaces for 3-D Shape Description , 1995, Comput. Vis. Image Underst..

[33]  Stephane Cotin,et al.  A hybrid elastic model for real-time cutting, deformations, and force feedback for surgery training and simulation , 2000, The Visual Computer.

[34]  Ridha Hambli,et al.  Real-time deformation of structure using finite element and neural networks in virtual reality applications , 2006 .

[35]  Gershon Elber,et al.  Real-time haptic incision simulation using FEM-based discontinuous free form deformation , 2006, SPM '06.

[36]  Gábor Székely,et al.  Identification of Spring Parameters for Deformable Object Simulation , 2007, IEEE Transactions on Visualization and Computer Graphics.