Supervoxels for graph cuts-based deformable image registration using guided image filtering

Abstract. We propose combining a supervoxel-based image representation with the concept of graph cuts as an efficient optimization technique for three-dimensional (3-D) deformable image registration. Due to the pixels/voxels-wise graph construction, the use of graph cuts in this context has been mainly limited to two-dimensional (2-D) applications. However, our work overcomes some of the previous limitations by posing the problem on a graph created by adjacent supervoxels, where the number of nodes in the graph is reduced from the number of voxels to the number of supervoxels. We demonstrate how a supervoxel image representation combined with graph cuts-based optimization can be applied to 3-D data. We further show that the application of a relaxed graph representation of the image, followed by guided image filtering over the estimated deformation field, allows us to model “sliding motion.” Applying this method to lung image registration results in highly accurate image registration and anatomically plausible estimations of the deformations. Evaluation of our method on a publicly available computed tomography lung image dataset leads to the observation that our approach compares very favorably with state of the art methods in continuous and discrete image registration, achieving target registration error of 1.16 mm on average per landmark.

[1]  Gary E. Christensen,et al.  A Measure for Characterizing Sliding on Lung Boundaries , 2013, Annals of Biomedical Engineering.

[2]  Michael Brady,et al.  MRF-Based Deformable Registration and Ventilation Estimation of Lung CT , 2013, IEEE Transactions on Medical Imaging.

[3]  Vladimir Kolmogorov,et al.  Visual correspondence using energy minimization and mutual information , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[5]  Jan Rühaak,et al.  Highly accurate fast lung CT registration , 2013, Medical Imaging.

[6]  N H Holstein-Rathlou,et al.  Volume adjustment of lung density by computed tomography scans in patients with emphysema , 2004, Acta radiologica.

[7]  Farida Cheriet,et al.  Landmark-Based Non-rigid Registration Via Graph Cuts , 2007, ICIAR.

[8]  R. Castillo,et al.  A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets , 2009, Physics in medicine and biology.

[9]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[10]  Hyun Myung,et al.  Real-Time Human Pose Estimation and Gesture Recognition from Depth Images Using Superpixels and SVM Classifier , 2015, Sensors.

[11]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[12]  Abhishek Sen,et al.  Random Walks for Deformable Image Registration , 2011, MICCAI.

[13]  R. Castillo,et al.  Four-dimensional deformable image registration using trajectory modeling , 2010, Physics in medicine and biology.

[14]  Stephen Gould,et al.  Single image depth estimation from predicted semantic labels , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[16]  François-Xavier Vialard,et al.  Piecewise-diffeomorphic image registration: Application to the motion estimation between 3D CT lung images with sliding conditions , 2013, Medical Image Anal..

[17]  S. Vaughndill.  TUMOR AND NORMAL TISSUE MOTION IN THE THORAX DURING RESPIRATION: ANALYSIS OF VOLUMETRIC AND POSITIONAL VARIATIONS USING 4D CT , 2007 .

[18]  Jan Rühaak,et al.  A fast and accurate parallel algorithm for non-linear image registration using Normalized Gradient fields , 2014, ISBI.

[19]  Danielle F. Pace,et al.  A Locally Adaptive Regularization Based on Anisotropic Diffusion for Deformable Image Registration of Sliding Organs , 2013, IEEE Transactions on Medical Imaging.

[20]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[21]  Albert C. S. Chung,et al.  Non-rigid Image Registration Using Graph-cuts , 2007, MICCAI.

[22]  Albert C. S. Chung,et al.  Learning-based non-rigid image registration using prior joint intensity distributions with graph-cuts , 2011, 2011 18th IEEE International Conference on Image Processing.

[23]  Sven Kabus,et al.  Estimation of Organ Motion from 4D CT for 4D Radiation Therapy Planning of Lung Cancer , 2004, MICCAI.

[24]  Etienne Kerre,et al.  A new fuzzy additive noise reduction method , 2007 .

[25]  Mattias P. Heinrich,et al.  Advances and challenges in deformable image registration: From image fusion to complex motion modelling , 2016, Medical Image Anal..

[26]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[27]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Patrick Clarysse,et al.  Automated segmentation of a motion mask to preserve sliding motion in deformable registration of thoracic CT. , 2012, Medical physics.

[29]  Habib Y. Baluwala.  Physically motivated registration of diagnostic CT and PET/CT of lung volumes , 2013 .

[30]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[31]  Laurent Risser,et al.  An implicit sliding-motion preserving regularisation via bilateral filtering for deformable image registration , 2014, Medical Image Anal..

[32]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Ashish Raj,et al.  A graph cut algorithm for generalized image deconvolution , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[34]  Mattias P. Heinrich,et al.  Liver Motion Estimation via Locally Adaptive Over-Segmentation Regularization , 2015, MICCAI.

[35]  Sing Bing Kang,et al.  Stereo for Image-Based Rendering using Image Over-Segmentation , 2007, International Journal of Computer Vision.

[36]  Michael Brady,et al.  MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration , 2012, Medical Image Anal..

[37]  Albert C. S. Chung,et al.  Non-rigid image registration of brain magnetic resonance images using graph-cuts , 2011, Pattern Recognit..

[38]  Weiguo Lu,et al.  A simple fixed-point approach to invert a deformation field. , 2007, Medical physics.

[39]  Michael Brady,et al.  Deformable image registration by combining uncertainty estimates from supervoxel belief propagation , 2016, Medical Image Anal..

[40]  Nassir Navab,et al.  Dense image registration through MRFs and efficient linear programming , 2008, Medical Image Anal..

[41]  Albert C. S. Chung,et al.  Non-rigid image registration by using graph-cuts with mutual information , 2010, 2010 IEEE International Conference on Image Processing.

[42]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[43]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[44]  Julia A. Schnabel,et al.  Graph Cuts-Based Registration Revisited: A Novel Approach for Lung Image Registration Using Supervoxels and Image-Guided Filtering , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[45]  Stefano Soatto,et al.  Class segmentation and object localization with superpixel neighborhoods , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[46]  Heinz Handels,et al.  Estimating Large Lung Motion in COPD Patients by Symmetric Regularised Correspondence Fields , 2015, MICCAI.

[47]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[48]  Thomas Guerrero,et al.  Ventilation from four-dimensional computed tomography: density versus Jacobian methods , 2010, Physics in medicine and biology.

[49]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Heinz Handels,et al.  Estimation of slipping organ motion by registration with direction-dependent regularization , 2012, Medical Image Anal..