Virtual Reality Aided Mobile C-arm Positioning for Image-Guided Surgery

Image-guided surgery (IGS) is the minimally invasive procedure based on the pre-operative volume in conjunction with intra-operative X-ray images which are commonly captured by mobile C-arms for the confirmation of surgical outcomes. Although currently some commercial navigation systems are employed, one critical issue of such systems is the neglect regarding the radiation exposure to the patient and surgeons. In practice, when one surgical stage is finished, several X-ray images have to be acquired repeatedly by the mobile C-arm to obtain the desired image. Excessive radiation exposure may increase the risk of some complications. Therefore, it is necessary to develop a positioning system for mobile C-arms, and achieve one-time imaging to avoid the additional radiation exposure. In this dissertation, a mobile C-arm positioning system is proposed with the aid of virtual reality (VR). The surface model of patient is reconstructed by a camera mounted on the mobile C-arm. A novel registration method is proposed to align this model and pre-operative volume based on a tracker, so that surgeons can visualize the hidden anatomy directly from the outside view and determine a reference pose of C-arm. Considering the congested operating room, the C-arm is modeled as manipulator with a movable base to maneuver the image intensifier to the desired pose. In the registration procedure above, intensity-based 2D/3D registration is used to transform the pre-operative volume into the coordinate system of tracker. Although it provides a high accuracy, the small capture range hinders its clinical use due to the initial guess. To address such problem, a robust and fast initialization method is proposed based on the automatic tracking based initialization and multi-resolution estimation in frequency domain. This hardware-software integrated approach provides almost optimal transformation parameters for intensity-based registration. To determine the pose of mobile C-arm, high-quality visualization is necessary to locate the pathology in the hidden anatomy. A novel dimensionality reduction method based on sparse representation is proposed for the design of multi-dimensional transfer function in direct volume rendering. It not only achieves the similar performance to the conventional methods, but also owns the capability to deal with the large data sets.

[1]  Ameet K. Jain,et al.  FTRAC--a robust fluoroscope tracking fiducial. , 2005, Medical physics.

[2]  Lejing Wang,et al.  Closed-Form Inverse Kinematics for Interventional C-Arm X-Ray Imaging With Six Degrees of Freedom: Modeling and Application , 2012, IEEE Transactions on Medical Imaging.

[3]  Eduard Grller,et al.  Curvature-Based Transfer Functions for Direct Volume Rendering , 2000 .

[4]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[5]  J. Balter,et al.  Imaging and alignment for image-guided radiation therapy. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[6]  S. Glaze,et al.  Surgeon and patient radiation exposure in minimally invasive transforaminal lumbar interbody fusion. , 2008, Journal of neurosurgery. Spine.

[7]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[8]  A.N. Akansu,et al.  The Binomial QMF-Wavelet Transform for Multiresolution Signal Decomposition , 1993, IEEE Trans. Signal Process..

[9]  Frank Deinzer,et al.  Extended Global Optimization Strategy for Rigid 2D/3D Image Registration , 2007, CAIP.

[10]  Michael J Ackerman,et al.  Engineering and algorithm design for an image processing Api: a technical report on ITK--the Insight Toolkit. , 2002, Studies in health technology and informatics.

[11]  S. Chaganti,et al.  A language for effective communication between surgeons and radiographers in trauma theatre. , 2009, Annals of the Royal College of Surgeons of England.

[12]  Bruno Siciliano,et al.  Control of robotic systems through singularities , 1991 .

[13]  David A Jaffray,et al.  A frequency-based approach to locate common structure for 2D-3D intensity-based registration of setup images in prostate radiotherapy. , 2007, Medical physics.

[14]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Lejing Wang,et al.  Augmented reality during angiography: Integration of a virtual mirror for improved 2D/3D visualization , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[16]  Kwan-Liu Ma,et al.  ISpace: interactive volume data classification techniques using independent component analysis , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[17]  William J. Schroeder,et al.  A Parallel Approach for Efficiently Visualizing Extremely Large, Time-Varying Datasets , 2000 .

[18]  A. Shapiro,et al.  Convergence analysis of gradient descent stochastic algorithms , 1996 .

[19]  R. Burgkart,et al.  Image Guided Positioning for an Interactive Carm Fluoroscope , 2006 .

[20]  Gabor Fichtinger,et al.  C-arm Tracking and Reconstruction Without an External Tracker , 2006, MICCAI.

[21]  M. Viergever,et al.  Robust initialization of 2D-3D image registration using the projection-slice theorem and phase correlation. , 2010, Medical physics.

[22]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[23]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[24]  Dan Roth,et al.  Learning to detect objects in images via a sparse, part-based representation , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  M. Synowitz,et al.  Surgeon's radiation exposure during percutaneous vertebroplasty. , 2006, Journal of neurosurgery. Spine.

[26]  Heiko Hoffmann,et al.  Kernel PCA for novelty detection , 2007, Pattern Recognit..

[27]  Jerry L. Prince,et al.  C-arm pose estimation using a set of coplanar ellipses in correspondence , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[28]  Léon Bottou,et al.  The Tradeoffs of Large Scale Learning , 2007, NIPS.

[29]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[30]  Joachim Denzler,et al.  Progressive attenuation fields: Fast 2D‐3D image registration without precomputation , 2005 .

[31]  Peter Kazanzides,et al.  Intraoperative Image-based Multiview 2D/3D Registration for Image-Guided Orthopaedic Surgery: Incorporation of Fiducial-Based C-Arm Tracking and GPU-Acceleration , 2012, IEEE Transactions on Medical Imaging.

[32]  Carl D. Meyer,et al.  Matrix Analysis and Applied Linear Algebra , 2000 .

[33]  A. Liegeois,et al.  Automatic supervisory control of the configuration and behavior of multi-body mechanisms , 1977 .

[34]  K. Cleary,et al.  Image-guided interventions: technology review and clinical applications. , 2010, Annual review of biomedical engineering.

[35]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[36]  Rama Chellappa,et al.  Sparse Embedding: A Framework for Sparsity Promoting Dimensionality Reduction , 2012, ECCV.

[37]  David A. Landgrebe,et al.  High dimensional feature reduction via projection pursuit , 1994, Proceedings of IGARSS '94 - 1994 IEEE International Geoscience and Remote Sensing Symposium.

[38]  Yang Zhang,et al.  Dimensionality Reduction by Using Sparse Reconstruction Embedding , 2010, PCM.

[39]  Dang Jianwu,et al.  An Algorithm Multi-Resolution Medical Image Registration Based on Firefly Algorithm and Powell , 2013, 2013 Third International Conference on Intelligent System Design and Engineering Applications.

[40]  F. Gaita,et al.  Reduced fluoroscopy exposure during ablation of atrial fibrillation using a novel electroanatomical navigation system: a multicentre experience. , 2012, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[41]  Russell H. Taylor,et al.  Deformable 2D-3D Registration of the Pelvis with a Limited Field of View, Using Shape Statistics , 2007, MICCAI.

[42]  Nassir Navab,et al.  Real-Time 3D Reconstruction for Collision Avoidance in Interventional Environments , 2008, MICCAI.

[43]  L. Joskowicz,et al.  Gradient-based 2-D/3-D rigid registration of fluoroscopic X-ray to CT , 2003, IEEE Transactions on Medical Imaging.

[44]  Xin Zhao,et al.  Multi-dimensional Reduction and Transfer Function Design using Parallel Coordinates , 2010, VG@Eurographics.

[45]  Stephen T. C. Wong,et al.  A Fast CT and CT-Fluoroscopy Registration Algorithm With Respiratory Motion Compensation for Image-Guided Lung Intervention , 2013, IEEE Transactions on Biomedical Engineering.

[46]  Jianzhong Wang.  Classical Multidimensional Scaling , 2012 .

[47]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[48]  Bjorn De Sutter,et al.  A Fast Algorithm to Calculate the Exact Radiological Path through a Pixel or Voxel Space , 1998 .

[49]  Leo Joskowicz,et al.  Registration of a CT-like atlas to fluoroscopic X-ray images using intensity correspondences , 2008, International Journal of Computer Assisted Radiology and Surgery.

[50]  Raymond Ko,et al.  C-arm laser positioning device to facilitate percutaneous renal access. , 2007, Urology.

[51]  Joe Michael Kniss,et al.  Multidimensional Transfer Functions for Interactive Volume Rendering , 2002, IEEE Trans. Vis. Comput. Graph..

[52]  Daniel Mirota,et al.  An on-board surgical tracking and video augmentation system for C-arm image guidance , 2012, International Journal of Computer Assisted Radiology and Surgery.

[53]  Ekkehard Euler,et al.  Visual Servoing for Intraoperative Positioning and Repositioning of Mobile C-arms , 2006, MICCAI.

[54]  Ross T. Whitaker,et al.  Curvature-based transfer functions for direct volume rendering: methods and applications , 2003, IEEE Visualization, 2003. VIS 2003..

[55]  Richard Szeliski,et al.  Towards Internet-scale multi-view stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[56]  Penny Rheingans,et al.  Texture-based Transfer Functions for Direct Volume Rendering , 2008, IEEE Transactions on Visualization and Computer Graphics.

[57]  Gabor Fichtinger,et al.  Rotational Encoding of C-arm Fluoroscope with Tilt Sensing Accelerometer , 2010, MICCAI.

[58]  Majid Maybody,et al.  Overview of navigation systems in image-guided interventions. , 2013, Techniques in vascular and interventional radiology.

[59]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[60]  Marco Caversaccio,et al.  High-Accuracy Patient-to-Image Registration for the Facilitation of Image-Guided Robotic Microsurgery on the Head , 2013, IEEE Transactions on Biomedical Engineering.

[61]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[62]  Bernhard Preim,et al.  Combining Silhouettes, Surface, and Volume Rendering for Surgery Education and Planning , 2005, EuroVis.

[63]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[64]  B van der Merwe.  Radiation dose to surgeons in theatre. , 2012, South African journal of surgery. Suid-Afrikaanse tydskrif vir chirurgie.

[65]  Bruno Siciliano,et al.  A closed-loop inverse kinematic scheme for on-line joint-based robot control , 1990, Robotica.

[66]  Rui Xu,et al.  Wavelet-based Multiresolution Medical Image Registration Strategy Combining Mutual Information with Spatial Information , 2006 .

[67]  James Theiler,et al.  Online Feature Selection using Grafting , 2003, ICML.

[68]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[69]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[70]  Achim Schweikard,et al.  Closed-form inverse kinematic solution for fluoroscopic C-arms , 2007, Adv. Robotics.

[71]  Carla Maria Dal Sasso Freitas,et al.  Design of Multi-dimensional Transfer Functions Using Dimensional Reduction , 2007, EuroVis.

[72]  Paul Suetens,et al.  Efficient GPU-accelerated elastic image registration , 2008 .

[73]  Maryann E. Martone,et al.  Dimensionality Reduction on Multi-Dimensional Transfer Functions for Multi-Channel Volume Data Sets , 2010, Inf. Vis..

[74]  P.D. Wolf,et al.  Registration of three-dimensional cardiac catheter models to single-plane fluoroscopic images , 1999, IEEE Transactions on Biomedical Engineering.

[75]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[76]  Michael Teistler,et al.  Informatics in radiology: use of a C-arm fluoroscopy simulator to support training in intraoperative radiography. , 2011, Radiographics : a review publication of the Radiological Society of North America, Inc.

[77]  Christian Roux,et al.  2-D–3-D Frequency Registration Using a Low-Dose Radiographic System for Knee Motion Estimation , 2013, IEEE Transactions on Biomedical Engineering.

[78]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[79]  Drazenko Babic,et al.  C-arm cone beam computed tomography needle path overlay for image-guided procedures of the spine and pelvis , 2012, Neuroradiology.

[80]  M. Figl,et al.  Validation for 2D/3D registration. I: A new gold standard data set. , 2011, Medical physics.

[81]  Anna Vilanova,et al.  Visualization of boundaries in volumetric data sets using LH histograms , 2006, IEEE Transactions on Visualization and Computer Graphics.

[82]  B van der Merwe,et al.  Radiation dose to surgeons in theatre , 2012 .

[83]  Gordon L. Kindlmann,et al.  Semi-Automatic Generation of Transfer Functions for Direct Volume Rendering , 1998, VVS.

[84]  Joachim Hornegger,et al.  Inverse C-arm Positioning for Interventional Procedures Using Real-Time Body Part Detection , 2009, MICCAI.

[85]  Christof Rezk-Salama,et al.  High-Level User Interfaces for Transfer Function Design with Semantics , 2006, IEEE Transactions on Visualization and Computer Graphics.

[86]  Gabor Fichtinger,et al.  CTREC: C-arm tracking and reconstruction using elliptic curves , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[87]  C. Morandi,et al.  Registration of Translated and Rotated Images Using Finite Fourier Transforms , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[88]  G. Kindlmann.  Transfer Functions in Direct Volume Rendering : Design , Interface , Interaction , 2002 .

[89]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[90]  David Zhang,et al.  On the Dimensionality Reduction for Sparse Representation Based Face Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[91]  Kwan-Liu Ma,et al.  Size-based Transfer Functions: A New Volume Exploration Technique , 2008, IEEE Transactions on Visualization and Computer Graphics.

[92]  William E. Lorensen,et al.  The Transfer Function Bake-Off , 2001, IEEE Computer Graphics and Applications.

[93]  R. Halír.  Numerically Stable Direct Least Squares Fitting of Ellipses , 1998 .

[94]  Peter J. O'Shea,et al.  The Generalised Image Fusion Toolkit (GIFT) , 2006, The Insight Journal.

[95]  David I. Lee,et al.  Virtual reality-assisted robotic surgery simulation. , 2007, Journal of endourology.

[96]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[97]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[98]  Terry M. Peters,et al.  US–Fluoroscopy Registration for Transcatheter Aortic Valve Implantation , 2012, IEEE Transactions on Biomedical Engineering.

[99]  Benoit M. Dawant,et al.  Automatic pre- to intra-operative CT registration for image-guided cochlear implant surgery , 2012, Medical Imaging.

[100]  Ekkehard Euler,et al.  Interactive Guidance System for C-Arm Repositioning Without Radiation , 2007, Bildverarbeitung für die Medizin.

[101]  Boštjan Likar,et al.  Standardized evaluation methodology for 3D/2D registration based on the Visible Human data set. , 2010, Medical physics.

[102]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[103]  Markus Hadwiger,et al.  High-Quality Multimodal Volume Rendering for Preoperative Planning of Neurosurgical Interventions , 2007, IEEE Transactions on Visualization and Computer Graphics.

[104]  Jörg-Stefan Praßni,et al.  Shape-based transfer functions for volume visualization , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[105]  Benoit M. Dawant,et al.  Automatic Pre- to Intra-Operative CT Registration for Image-Guided Cochlear Implant Surgery , 2012, IEEE Transactions on Biomedical Engineering.