Accelerating multi-modal image registration using a supervoxel-based variational framework

For the successful completion of medical interventional procedures, several concepts, such as daily positioning compensation, dose accumulation or delineation propagation, rely on establishing a spatial coherence between planning images and images acquired at different time instants over the course of the therapy. To meet this need, image-based motion estimation and compensation relies on fast, automatic, accurate and precise registration algorithms. However, image registration quickly becomes a challenging and computationally intensive task, especially when multiple imaging modalities are involved. In the current study, a novel framework is introduced to reduce the computational overhead of variational registration methods. The proposed framework selects representative voxels of the registration process, based on a supervoxel algorithm. Costly calculations are hereby restrained to a subset of voxels, leading to a less expensive spatial regularized interpolation process. The novel framework is tested in conjunction with the recently proposed EVolution multi-modal registration method. This results in an algorithm requiring a low number of input parameters, is easily parallelizable and provides an elastic voxel-wise deformation with a subvoxel accuracy. The performance of the proposed accelerated registration method is evaluated on cross-contrast abdominal T1/T2 MR-scans undergoing a known deformation and annotated CT-images of the lung. We also analyze the ability of the method to capture slow physiological drifts during MR-guided high intensity focused ultrasound therapies and to perform multi-modal CT/MR registration in the abdomen. Results have shown that computation time can be reduced by 75% on the same hardware with no negative impact on the accuracy.

[1]  R. Castillo,et al.  Four-dimensional deformable image registration using trajectory modeling , 2010, Physics in medicine and biology.

[2]  K. Brock,et al.  Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132 , 2017, Medical physics.

[3]  Paul Suetens,et al.  Nonrigid Image Registration Using Conditional Mutual Information , 2010, IEEE Transactions on Medical Imaging.

[4]  Cornel Zachiu,et al.  Non-rigid CT/CBCT to CBCT registration for online external beam radiotherapy guidance , 2017, Physics in medicine and biology.

[5]  B. Denis de Senneville,et al.  EVolution: an edge-based variational method for non-rigid multi-modal image registration , 2016, Physics in medicine and biology.

[6]  Torsten Rohlfing,et al.  Volume-preserving nonrigid registration of MR breast images using free-form deformation with an incompressibility constraint , 2003, IEEE Transactions on Medical Imaging.

[7]  Sebastiano Battiato,et al.  Advanced Concepts for Intelligent Vision Systems , 2015, Lecture Notes in Computer Science.

[8]  Pascal Haigron,et al.  Evaluation of non-rigid constrained CT/CBCT registration algorithms for delineation propagation in the context of prostate cancer radiotherapy , 2013, Medical Imaging.

[9]  Robert J. Maciunas,et al.  Registration of head volume images using implantable fiducial markers , 1997, IEEE Transactions on Medical Imaging.

[10]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[11]  T. Brox,et al.  Variational Optic Flow Computation: From Continuous Models to Algorithms , 2003 .

[12]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[13]  A. Giuliano,et al.  Advances in FDG PET probes in surgical oncology. , 2002, Cancer journal.

[14]  B. Raaymakers,et al.  Anatomically plausible models and quality assurance criteria for online mono- and multi-modal medical image registration , 2018, Physics in medicine and biology.

[15]  Paria Mehrani,et al.  Superpixels and Supervoxels in an Energy Optimization Framework , 2010, ECCV.

[16]  R. Castillo,et al.  A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets , 2009, Physics in medicine and biology.

[17]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[18]  Michael Brady,et al.  MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration , 2012, Medical Image Anal..

[19]  Colin Studholme,et al.  Deformation-based mapping of volume change from serial brain MRI in the presence of local tissue contrast change , 2006, IEEE Transactions on Medical Imaging.

[20]  Eldad Haber,et al.  Intensity Gradient Based Registration and Fusion of Multi-modal Images , 2006, MICCAI.

[21]  Thomas Guerrero,et al.  Ventilation from four-dimensional computed tomography: density versus Jacobian methods , 2010, Physics in medicine and biology.

[22]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[23]  Luminita A. Vese,et al.  Variational Methods in Image Processing , 2015 .

[24]  Cornel Zachiu,et al.  A framework for continuous target tracking during MR-guided high intensity focused ultrasound thermal ablations in the abdomen , 2017, Journal of therapeutic ultrasound.

[25]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Kullervo Hynynen,et al.  Magnetic resonance image-guided focused ultrasound surgery. , 2002, Cancer journal.

[27]  B Denis de Senneville,et al.  An improved optical flow tracking technique for real-time MR-guided beam therapies in moving organs , 2015, Physics in medicine and biology.

[28]  Mattias P. Heinrich,et al.  Multi-Atlas Based Pseudo-CT Synthesis Using Multimodal Image Registration and Local Atlas Fusion Strategies , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[29]  L. König,et al.  A Non-Linear Image Registration Scheme for Real-Time Liver Ultrasound Tracking using Normalized Gradient Fields , 2014 .

[30]  Stefan Klein,et al.  Automatic segmentation of the prostate in 3D MR images by atlas matching using localized mutual information. , 2008, Medical physics.

[31]  Josien P. W. Pluim,et al.  MUTUAL INFORMATION BASED REGISTRATION OF MEDICAL IMAGES , 2001 .

[32]  Erlend Hodneland,et al.  Normalized gradient fields for nonlinear motion correction of DCE-MRI time series , 2014, Comput. Medical Imaging Graph..

[33]  D. Louis Collins,et al.  Self-similarity weighted mutual information: A new nonrigid image registration metric , 2014, Medical Image Anal..

[34]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[35]  M Glitzner,et al.  On-line 3D motion estimation using low resolution MRI , 2015, Physics in medicine and biology.

[36]  Cornel Zachiu,et al.  Real-time non-rigid target tracking for ultrasound-guided clinical interventions , 2017, Physics in medicine and biology.

[37]  Wilfried Philips,et al.  Fast and Robust Variational Optical Flow for High-Resolution Images Using SLIC Superpixels , 2015, ACIVS.

[38]  Christophoros Nikou,et al.  Guiding optical flow estimation using superpixels , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[39]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[40]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[41]  Matthias Guckenberger,et al.  Motion compensation in radiotherapy. , 2012, Critical reviews in biomedical engineering.

[42]  Cornel Zachiu,et al.  A framework for the correction of slow physiological drifts during MR-guided HIFU therapies: Proof of concept. , 2015, Medical physics.

[43]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[44]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[45]  Michael Unser,et al.  Regularized Interpolation for Noisy Images , 2010, IEEE Transactions on Medical Imaging.