GIFTed Demons: deformable image registration with local structure-preserving regularization using supervoxels for liver applications

Abstract. Deformable image registration, a key component of motion correction in medical imaging, needs to be efficient and provides plausible spatial transformations that reliably approximate biological aspects of complex human organ motion. Standard approaches, such as Demons registration, mostly use Gaussian regularization for organ motion, which, though computationally efficient, rule out their application to intrinsically more complex organ motions, such as sliding interfaces. We propose regularization of motion based on supervoxels, which provides an integrated discontinuity preserving prior for motions, such as sliding. More precisely, we replace Gaussian smoothing by fast, structure-preserving, guided filtering to provide efficient, locally adaptive regularization of the estimated displacement field. We illustrate the approach by applying it to estimate sliding motions at lung and liver interfaces on challenging four-dimensional computed tomography (CT) and dynamic contrast-enhanced magnetic resonance imaging datasets. The results show that guided filter-based regularization improves the accuracy of lung and liver motion correction as compared to Gaussian smoothing. Furthermore, our framework achieves state-of-the-art results on a publicly available CT liver dataset.

[1]  David A Jaffray,et al.  Improving image-guided target localization through deformable registration , 2008, Acta oncologica.

[2]  Nicholas Ayache,et al.  Understanding the "Demon's Algorithm": 3D Non-rigid Registration by Gradient Descent , 1999, MICCAI.

[3]  David Atkinson,et al.  Respiratory motion correction in dynamic MRI using robust data decomposition registration - Application to DCE-MRI , 2014, Medical Image Anal..

[4]  Laurent Risser,et al.  Complex Lung Motion Estimation via Adaptive Bilateral Filtering of the Deformation Field , 2013, MICCAI.

[5]  M L W Ziech,et al.  Dynamic Contrast- Enhanced MRI in patients with luminal Crohn’s disease , 2013 .

[6]  Michael Brady,et al.  Edge- and Detail-Preserving Sparse Image Representations for Deformable Registration of Chest MRI and CT Volumes , 2013, IPMI.

[7]  D Atkinson,et al.  Dual registration of abdominal motion for motility assessment in free-breathing data sets acquired using dynamic MRI , 2014, Physics in medicine and biology.

[8]  M. Staring,et al.  Nonrigid registration with tissue-dependent filtering of the deformation field , 2007, Physics in medicine and biology.

[9]  Sven Kabus,et al.  Variational Image Registration with Local Properties , 2006, WBIR.

[10]  Olivier D. Faugeras,et al.  Variational Methods for Multimodal Image Matching , 2002, International Journal of Computer Vision.

[11]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[12]  Philippe C. Cattin,et al.  Discontinuity Preserving Registration of Abdominal MR Images with Apparent Sliding Organ Motion , 2011, Abdominal Imaging.

[13]  Yaoqin Xie,et al.  Deformable image registration of liver with consideration of lung sliding motion. , 2011, Medical physics.

[14]  Patrick Clarysse,et al.  Automated segmentation of a motion mask to preserve sliding motion in deformable registration of thoracic CT. , 2012, Medical physics.

[15]  Eric A. Hoffman,et al.  Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images , 2001, IEEE Transactions on Medical Imaging.

[16]  Danielle F. Pace,et al.  A Locally Adaptive Regularization Based on Anisotropic Diffusion for Deformable Image Registration of Sliding Organs , 2013, IEEE Transactions on Medical Imaging.

[17]  George T. Y. Chen,et al.  Deformable registration of 4D computed tomography data. , 2006, Medical physics.

[18]  Tobias Gass,et al.  Isotropic Total Variation Regularization of Displacements in Parametric Image Registration , 2017, IEEE Transactions on Medical Imaging.

[19]  Laurent Risser,et al.  Motion Correction and Parameter Estimation in dceMRI Sequences: Application to Colorectal Cancer , 2011, MICCAI.

[20]  Alejandro F. Frangi,et al.  Multiresolution eXtended Free‐Form Deformations (XFFD) for non‐rigid registration with discontinuous transforms , 2017, Medical Image Anal..

[21]  S Ourselin,et al.  The effect of motion correction on pharmacokinetic parameter estimation in dynamic-contrast-enhanced MRI. , 2011, Physics in medicine and biology.

[22]  François-Xavier Vialard,et al.  Piecewise-diffeomorphic image registration: Application to the motion estimation between 3D CT lung images with sliding conditions , 2013, Medical Image Anal..

[23]  D Sarrut,et al.  Registration of sliding objects using direction dependent B-splines decomposition , 2013, Physics in medicine and biology.

[24]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Mattias P. Heinrich,et al.  Liver Motion Estimation via Locally Adaptive Over-Segmentation Regularization , 2015, MICCAI.

[26]  Daniel Rueckert,et al.  Simultaneous Multi-scale Registration Using Large Deformation Diffeomorphic Metric Mapping , 2011, IEEE Transactions on Medical Imaging.

[27]  Heinz Handels,et al.  Fast Explicit Diffusion for Registration with Direction-Dependent Regularization , 2012, WBIR.

[28]  Marek Kretowski,et al.  Multiscale Model of Liver DCE-MRI Towards a Better Understanding of Tumor Complexity , 2010, IEEE Transactions on Medical Imaging.

[29]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[30]  Veerle Kersemans,et al.  Tumor Growth Estimation via Registration of DCE-MRI Derived Tumor Specific Descriptors , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[31]  Simon K. Warfield,et al.  Demons registration with local affine adaptive regularization: application to registration of abdominal structures , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[32]  Joao Seco,et al.  Dosimetric impact of motion in free-breathing and gated lung radiotherapy: a 4D Monte Carlo study of intrafraction and interfraction effects. , 2007, Medical physics.

[33]  Hans Knutsson,et al.  Adaptive anisotropic regularization of deformation fields for non-rigid registration using the morphon framework , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[34]  Xavier Pennec,et al.  Sparse Multi-Scale Diffeomorphic Registration: The Kernel Bundle Framework , 2012, Journal of Mathematical Imaging and Vision.

[35]  Alexandre Hostettler,et al.  Fast Segmentation of Abdominal Wall: Application to Sliding Effect Removal for Non-rigid Registration , 2012, Abdominal Imaging.

[36]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[37]  Hervé Delingette,et al.  International Journal of Computer Vision Manuscript No. 10.1007/s11263-010-0405-z The final publication is available at www.springerlink.com iLogDemons: A Demons-Based Registration Algorithm for Tracking Incompressible Elastic Biological Tissues , 2022 .

[38]  Nicholas Ayache,et al.  Grid powered nonlinear image registration with locally adaptive regularization , 2004, Medical Image Anal..

[39]  M. Kessler Image registration and data fusion in radiation therapy. , 2006, The British journal of radiology.

[40]  Michael Brady,et al.  Deformable image registration by combining uncertainty estimates from supervoxel belief propagation , 2016, Medical Image Anal..

[41]  Laurent Risser,et al.  An implicit sliding-motion preserving regularisation via bilateral filtering for deformable image registration , 2014, Medical Image Anal..

[42]  Joachim Weickert,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Optic Flow in Harmony Optic Flow in Harmony Optic Flow in Harmony , 2022 .

[43]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Mattias P. Heinrich,et al.  Advances and challenges in deformable image registration: From image fusion to complex motion modelling , 2016, Medical Image Anal..

[45]  K. Cleary,et al.  Assessment of hepatic motion secondary to respiration for computer assisted interventions. , 2002, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[46]  Yen-Wei Chen,et al.  Automated segmentation of the liver from 3D CT images using probabilistic atlas and multilevel statistical shape model. , 2008, Academic radiology.

[47]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[48]  Hui Cheng,et al.  Bilateral Filtering-Based Optical Flow Estimation with Occlusion Detection , 2006, ECCV.

[49]  Heinz Handels,et al.  Estimation of slipping organ motion by registration with direction-dependent regularization , 2012, Medical Image Anal..

[50]  Nicholas Ayache,et al.  LCC-Demons: A robust and accurate symmetric diffeomorphic registration algorithm , 2013, NeuroImage.

[51]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[52]  Michael Brady,et al.  Non-local Graph-Based Regularization for Deformable Image Registration , 2016, MCV/BAMBI@MICCAI.

[53]  Gregory C Sharp,et al.  Evaluation of deformable registration of patient lung 4DCT with subanatomical region segmentations. , 2008, Medical physics.

[54]  Nathan D. Cahill,et al.  A Demons Algorithm for Image Registration with Locally Adaptive Regularization , 2009, MICCAI.