Computer-aided liver surgery planning: an augmented reality approach

Surgical resection of liver tumors requires a detailed three-dimensional understanding of a complex arrangement of vasculature, liver segments and tumors inside the liver. In most cases, surgeons need to develop this understanding by looking at sequences of axial images from modalities like X-ray computed tomography. A system for liver surgery planning is reported that enables physicians to visualize and refine segmented input liver data sets, as well as to simulate and evaluate different resections plans. The system supports surgeons in finding the optimal treatment strategy for each patient and eases the data preparation process. The use of augmented reality contributes to a user-friendly design and simplifies complex interaction with 3D objects. The main function blocks developed so far are: basic augmented reality environment, user interface, rendering, surface reconstruction from segmented volume data sets, surface manipulation and quantitative measurement toolkit. The flexible design allows to add functionality via plug-ins. First practical evaluation steps have shown a good acceptance. Evaluation of the system is ongoing and future feedback from surgeons will be collected and used for design refinements.

[1]  Heinz Wörn,et al.  KasOp - A generic system for pre- and intraoperative surgical assistance and operation planning , 2001, CARS.

[2]  Arie E. Kaufman,et al.  Novel Techniques for Robust Voxelization and Visualization of Implicit Surfaces , 2001, Graph. Model..

[3]  David J. Hawkes,et al.  Stereo Augmented Reality in the Surgical Microscope , 2000, Presence: Teleoperators & Virtual Environments.

[4]  Brian K. Rutt,et al.  Fast reprojection of volume data , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[5]  Hervé Delingette,et al.  Improving realism of a surgery simulator: linear anisotropic elasticity, complex interactions and force extrapolation , 2002, Comput. Animat. Virtual Worlds.

[6]  Maria Chiara Carrozza,et al.  An Augmented Reality Navigation System for Computer Assisted Arthroscopic Surgery of the Knee , 2000, MICCAI.

[7]  Thomas Malzbender,et al.  Fourier volume rendering , 1993, TOGS.

[8]  R. Hummel,et al.  The wrapper algorithm: surface extraction and simplification , 1994, Proceedings of IEEE Workshop on Biomedical Image Analysis.

[9]  N. Ayache,et al.  Fully automatic anatomical, pathological, and functional segmentation from CT scans for hepatic surgery , 2001 .

[10]  Shiaofen Fang,et al.  Fast CSG Voxelization by Frame Buffer Pixel Mapping , 2000, 2000 IEEE Symposium on Volume Visualization (VV 2000).

[11]  Hervé Delingette,et al.  Modélisation, déformation et reconnaissance d'objets tridimensionnels à l'aide de maillages simplexes , 1994 .

[12]  M. Bauer,et al.  Interactive volume on standard PC graphics hardware using multi-textures and multi-stage rasterization , 2000, Workshop on Graphics Hardware.

[13]  Hervé Delingette,et al.  Simplex meshes: a general representation for 3D shape reconstruction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[14]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[15]  Arthur W. Toga,et al.  Distance field manipulation of surface models , 1992, IEEE Computer Graphics and Applications.

[16]  Dieter Schmalstieg,et al.  “Studierstube”: An environment for collaboration in augmented reality , 1998, Virtual Reality.

[17]  H.-P. Meinzer.  A system for the virtual planning of liver surgery , 2001 .

[18]  Johan Montagnat,et al.  Fully Automatic Anatomical, Pathological, and Functional Segmentation from CT Scans for Hepatic Surgery , 2000, Medical Imaging: Image Processing.

[19]  H. Peitgen,et al.  HepaVision2 — a software assistant for preoperative planning in living-related liver transplantation and oncologic liver surgery , 2002 .

[20]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[21]  Milan Sonka,et al.  Diaphragm dome surface segmentation in CT data sets: a 3D active appearance model approach , 2002, SPIE Medical Imaging.

[22]  Ruediger Dillmann,et al.  Intraoperative presentation of surgical planning and simulation results using a stereoscopic see-through head-mounted display , 2000, Electronic Imaging.

[23]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[24]  Hervé Delingette,et al.  Planification Chirurgicale Hépatique Assistée par Ordinateur , 2000 .

[25]  Wolfgang Birkfellner,et al.  Calibration of tracking systems in a surgical environment , 1998, IEEE Transactions on Medical Imaging.

[26]  Mark W. Jones,et al.  The Production of Volume Data from Triangular Meshes Using Voxelisation , 1996, Comput. Graph. Forum.

[27]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.