Interactive deformation and cutting simulation directly using patient‐specific volumetric images

This paper systematically advocates an interactive volumetric image manipulation framework, which can enable the rapid deployment and instant utility of patient‐specific medical images in virtual surgery simulation while requiring little user involvement. We seamlessly integrate multiple technical elements to synchronously accommodate physics‐plausible simulation and high‐fidelity anatomical structures visualization. Given a volumetric image, in a user‐transparent way, we build a proxy to represent the geometrical structure and encode its physical state without the need of explicit 3‐D reconstruction. On the basis of the dynamic update of the proxy, we simulate large‐scale deformation, arbitrary cutting, and accompanying collision response driven by a non‐linear finite element method. By resorting to the upsampling of the sparse displacement field resulted from non‐linear finite element simulation, the cut/deformed volumetric image can evolve naturally and serves as a time‐varying 3‐D texture to expedite direct volume rendering. Moreover, our entire framework is built upon CUDA (Beihang University, Beijing, China) and thus can achieve interactive performance even on a commodity laptop. The implementation details, timing statistics, and physical behavior measurements have shown its practicality, efficiency, and robustness. Copyright © 2013 John Wiley & Sons, Ltd.

[1]  Volkmar Falk,et al.  Aortic valve replacement through a minimally invasive approach: preoperative planning, surgical technique, and outcome. , 2009, The Annals of thoracic surgery.

[2]  Sébastien Ourselin,et al.  High-Speed Nonlinear Finite Element Analysis for Surgical Simulation Using Graphics Processing Units , 2008, IEEE Transactions on Medical Imaging.

[3]  Ronald Fedkiw,et al.  Arbitrary cutting of deformable tetrahedralized objects , 2007, SCA '07.

[4]  Zeike A. Taylor,et al.  Towards computing brain deformations for diagnosis, prognosis and neurosurgical simulation , 2005 .

[5]  Megumi Nakao,et al.  Background-incorporated volumetric model for patient-specific surgical simulation: a segmentation-free, modeling-free framework , 2010, International Journal of Computer Assisted Radiology and Surgery.

[6]  David Atkinson,et al.  On modelling of anisotropic viscoelasticity for soft tissue simulation: Numerical solution and GPU execution , 2009, Medical Image Anal..

[7]  Leonidas J. Guibas,et al.  Meshless animation of fracturing solids , 2005, ACM Trans. Graph..

[8]  Boliang Wang,et al.  A Open Source Based General Framework for Virtual Surgery Simulation , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[9]  Thomas Sangild Sørensen,et al.  A GPU accelerated spring mass system for surgical simulation. , 2005, Studies in health technology and informatics.

[10]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[11]  Jian Chang,et al.  Mesh-free deformations: Research Articles , 2004 .

[12]  Luc Soler,et al.  Patient-specific Surgical Simulation , 2008, World Journal of Surgery.

[13]  Fabio Ganovelli,et al.  Fast Tetrahedron-Tetrahedron Overlap Algorithm , 2002, J. Graphics, GPU, & Game Tools.

[14]  Markus H. Gross,et al.  A Finite Element Method on Convex Polyhedra , 2007, Comput. Graph. Forum.

[15]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[16]  Karsten O. Noe,et al.  Solid Mesh Registration for Radiotherapy Treatment Planning , 2010, ISMBS.

[17]  Stefan Bruckner,et al.  Exploded Views for Volume Data , 2006, IEEE Transactions on Visualization and Computer Graphics.

[18]  Karol Miller,et al.  Patient-specific model of brain deformation: application to medical image registration. , 2007, Journal of biomechanics.

[19]  Hervé Delingette,et al.  Cutting Simulation of Manifold Volumetric Meshes , 2002, MICCAI.

[20]  Jérémie Allard,et al.  Volumetric modeling and interactive cutting of deformable bodies. , 2010, Progress in biophysics and molecular biology.

[21]  G. Maddern,et al.  Surgical Simulation: A Systematic Review , 2006, Annals of surgery.

[22]  Karol Miller,et al.  Meshless algorithm for soft tissue cutting in surgical simulation , 2014, Computer methods in biomechanics and biomedical engineering.

[23]  Matthias Harders,et al.  Element-wise mixed implicit-explicit integration for stable dynamic simulation of deformable objects , 2011, SCA '11.

[24]  K. Miller,et al.  Total Lagrangian explicit dynamics finite element algorithm for computing soft tissue deformation , 2006 .

[25]  Megumi Nakao,et al.  Adaptive proxy geometry for direct volume manipulation , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[26]  Takeo Igarashi,et al.  Lapped solid textures: filling a model with anisotropic textures , 2008, ACM Trans. Graph..

[27]  Min Chen,et al.  Feature Aligned Volume Manipulation for Illustration and Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[28]  Philip Fong Sensing, Acquisition, and Interactive Playback of Data-based Models for Elastic Deformable Objects , 2009, Int. J. Robotics Res..

[29]  Min Chen,et al.  Discontinuous Displacement Mapping for Volume Graphics , 2006, VG@SIGGRAPH.

[30]  Ichiro Sakuma,et al.  Development of surgical simulator based on FEM and deformable volume-rendering , 2004, Medical Imaging: Image-Guided Procedures.

[31]  Ravin Balakrishnan,et al.  Using deformations for browsing volumetric data , 2003, IEEE Visualization, 2003. VIS 2003..

[32]  Matthias Harders,et al.  Maintaining Large Time Steps in Explicit Finite Element Simulations Using Shape Matching , 2012, IEEE Transactions on Visualization and Computer Graphics.

[33]  Jian J. Zhang,et al.  Mesh‐free deformations , 2004, Comput. Animat. Virtual Worlds.

[34]  Kai Bürger,et al.  Direct Volume Editing , 2008, IEEE Transactions on Visualization and Computer Graphics.

[35]  Heinz Handels,et al.  GPU-Based Visualization of Deformable Volumetric Soft-Tissue for Real-Time Simulation of Haptic Needle Insertion , 2012, Bildverarbeitung für die Medizin.

[36]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[37]  Peter Schröder,et al.  A simple geometric model for elastic deformations , 2010, ACM Trans. Graph..

[38]  R. Satava Historical Review of Surgical Simulation—A Personal Perspective , 2008, World Journal of Surgery.

[39]  Rüdiger Westermann,et al.  A Hexahedral Multigrid Approach for Simulating Cuts in Deformable Objects , 2011, IEEE Transactions on Visualization and Computer Graphics.

[40]  Min Chen,et al.  Volume Deformation via Scattered Data Interpolation , 2007, VG@Eurographics.