A Variational Joint Segmentation and Registration Framework for Multimodal Images

Image segmentation and registration are closely related image processing techniques and often required as simultaneous tasks. In this work, we introduce an optimization-based approach to a joint registration and segmentation model for multimodal images deformation. The model combines an active contour variational term with a mutual information smoothing fitting term and solves in this way the difficulties of simultaneously performed segmentation and registration models for multimodal images. This combination takes into account the image structure boundaries and the movement of the objects, leading in this way to a robust dynamic scheme that links the object boundaries information that changes over time. Comparison of our model with state of art shows that our method leads to more consistent registrations and accurate results.

[1]  Bernhard Schölkopf,et al.  Learning similarity measure for multi-modal 3D image registration , 2009, CVPR 2009.

[2]  Jan Modersitzki,et al.  Curvature Based Image Registration , 2004, Journal of Mathematical Imaging and Vision.

[3]  Joachim Weickert,et al.  Reliable Estimation of Dense Optical Flow Fields with Large Displacements , 2000, International Journal of Computer Vision.

[4]  Baba C. Vemuri,et al.  Simultaneous Registration and Segmentation of Anatomical Structures from Brain MRI , 2005, MICCAI.

[5]  Ke Chen,et al.  An improved model for joint segmentation and registration based on linear curvature smoother , 2016 .

[6]  Zhijian Song,et al.  Fast and robust multimodal image registration using a local derivative pattern , 2017, Medical physics.

[7]  Eldad Haber,et al.  Intensity Gradient Based Registration and Fusion of Multi-modal Images , 2006, MICCAI.

[8]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[9]  Carole Le Guyader,et al.  A Joint Segmentation/Registration Model Based on a Nonlocal Characterization of Weighted Total Variation and Nonlocal Shape Descriptors , 2018, SIAM J. Imaging Sci..

[10]  Nikos Paragios,et al.  Boosted metric learning for 3D multi-modal deformable registration , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[11]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[12]  Luminita A. Vese,et al.  A combined segmentation and registration framework with a nonlinear elasticity smoother , 2009, Comput. Vis. Image Underst..

[13]  Nikos Komodakis,et al.  A Deep Metric for Multimodal Registration , 2016, MICCAI.

[14]  S. Talha Ahsan,et al.  Multimodal medical image registration using discrete wavelet transform and Gaussian pyramids , 2015, 2015 IEEE International Conference on Imaging Systems and Techniques (IST).

[15]  Gregory G. Slabaugh,et al.  Coupled PDEs for non-rigid registration and segmentation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Christos Davatzikos,et al.  Joint Segmentation and Deformable Registration of Brain Scans Guided by a Tumor Growth Model , 2011, MICCAI.

[17]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[18]  A. Yezzi,et al.  A variational framework for joint segmentation and registration , 2001, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001).

[19]  Tony F. Chan,et al.  An Active Contour Model without Edges , 1999, Scale-Space.

[20]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[21]  Bruce Fischl,et al.  Multimodal Image Registration Through Simultaneous Segmentation , 2017, IEEE Signal Processing Letters.

[22]  Martin Rumpf,et al.  Multiscale Joint Segmentation and Registration of Image Morphology , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[24]  Frank Sauer,et al.  Learning Based Non-rigid Multi-modal Image Registration Using Kullback-Leibler Divergence , 2005, MICCAI.

[25]  Georgios Sakas,et al.  Regmentation: A New View of Image Segmentation and Registration , 2017, Journal of Radiation Oncology Informatics.