Fast free-form registration based on Kullback-Leibler distance for multimodal medical image

Multimodal image registration is a great challenge in medical imaging which requires to aligning anatomically identical structures. Their appearance in images acquired with different multimodality images may be very different. In order to realize fast, precise and robust image registration, we proposed a new multimodal medical registration method, which is based on free-form deformation (FFD) and Kullback-Leibler distance (KLD) algorithm. We made the affine transform between the source image and target image as global transformation and FFD as local transformation took KLD as the similarity metric. Particle swarm optimization (PSO) and nonlinear least-squares (NLLS) algorithm were adopted to find the optimal transform parameters. Experimental results show that, as compared with the mutual information, normalized mutual information and cross correlation based registration methods, the proposed method has longer capture range at different image resolutions. Besides faster, its implementation can lead to a more robust performance and outperforms the state of the art methods for multimodal medical image registration.

[1]  N. Ayache,et al.  An efficient locally affine framework for the smooth registration of anatomical structures , 2008, Medical Image Anal..

[2]  Balraj Naren,et al.  Medical Image Registration , 2022 .

[3]  Samson J. Timoner.  Compact representations for fast nonrigid registration of medical images , 2003 .

[4]  Mark Holden,et al.  A Review of Geometric Transformations for Nonrigid Body Registration , 2008, IEEE Transactions on Medical Imaging.

[5]  Yazhu Chen,et al.  Non-rigid Registration Algorithm Based on Modally Controlled Free Form Deformation , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[6]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[7]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[8]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[9]  Li Chen,et al.  A Nonlinear Least Square Technique for Simultaneous Image Registration and Super-Resolution , 2007, IEEE Transactions on Image Processing.

[10]  Frank Sauer,et al.  Learning Based Non-rigid Multi-modal Image Registration Using Kullback-Leibler Divergence , 2005, MICCAI.

[11]  F. Sauer.  Image Registration: Enabling Technology for Image Guided Surgery and Therapy , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[12]  M Eiselt,et al.  Using mutual information to measure coupling in the cardiorespiratory system. , 1998, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[13]  W. Eric L. Grimson,et al.  Multi-modal Image Registration by Minimising Kullback-Leibler Distance , 2002, MICCAI.

[14]  Charles R. Meyer,et al.  Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations , 1997, Medical Image Anal..

[15]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[16]  S. Nemec,et al.  CT-MR image data fusion for computer assisted navigated neurosurgery of temporal bone tumors. , 2007, European journal of radiology.

[17]  Satoshi Ieiri,et al.  Integration of MRI and ultrasound in surgical navigation for robotic surgery , 2007 .

[18]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[19]  Mateu Sbert,et al.  Medical Image Registration Based on BSP and Quad-Tree Partitioning , 2006, WBIR.

[20]  Jürgen Weese,et al.  A Comparison of Simularity Measures for use in 2D-3D Medical Image Registration , 1998, MICCAI.

[21]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[22]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[23]  Brian Birge,et al.  PSOt - a particle swarm optimization toolbox for use with Matlab , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[24]  W. Eric L. Grimson,et al.  Multi-modal Volume Registration Using Joint Intensity Distributions , 1998, MICCAI.

[25]  Jürgen Weese,et al.  A comparison of similarity measures for use in 2-D-3-D medical image registration , 1998, IEEE Transactions on Medical Imaging.

[26]  Sung Yong Shin,et al.  Scattered Data Interpolation with Multilevel B-Splines , 1997, IEEE Trans. Vis. Comput. Graph..

[27]  William M. Wells,et al.  Robust Multi-modal Image Registration Based on Prior Joint Intensity Distributions and Minimization of Kullback-Leibler Distance , 2007 .

[28]  William M. Wells,et al.  Multi-modal image registration by minimizing Kullback-Leibler distance between expected and observed joint class histograms , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[29]  Jay B. West,et al.  Predicting error in rigid-body point-based registration , 1998, IEEE Transactions on Medical Imaging.

[30]  Vincent Gay-Bellile,et al.  Direct Estimation of Nonrigid Registrations with Image-Based Self-Occlusion Reasoning , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Paul Suetens,et al.  Medical image registration using mutual information , 2003, Proc. IEEE.

[32]  David R. Haynor,et al.  PET-CT image registration in the chest using free-form deformations , 2003, IEEE Transactions on Medical Imaging.

[33]  Sung Yong Shin,et al.  Image Metamorphosis with Scattered Feature Constraints , 1996, IEEE Trans. Vis. Comput. Graph..

[34]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[35]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[36]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[37]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[38]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[39]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.