Textural mutual information based on cluster trees for multimodal deformable registration

Mutual information (MI) has been widely used in image analysis tasks such as feature selection and image registration. In particular, it is the most widely used similarity measure for intensity based registration of multimodal images. However, a major drawback of MI is that it does not take the spatial neighbourhood into account. An effective way of incorporating spatial information could be of great benefit in a number of challenging applications. We propose the use of cluster trees to efficiently incorporate textural information from the local neighbourhood of a voxel into the computation of MI, while at the same time limiting the number of bins used to represent this higher-order information. This new similarity metric is optimised using a Markov random field (MRF). We apply our new method to the registration of dynamic lung CT volumes with simulated contrast. Experimental results show the advantages of this technique compared to standard mutual information.

[1]  Stefano Soatto,et al.  Multimodal Registration via Spatial-Context Mutual Information , 2011, IPMI.

[2]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[3]  R. Castillo,et al.  A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets , 2009, Physics in medicine and biology.

[4]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[5]  Mark Jenkinson,et al.  Non-rigid image registration through efficient discrete optimization , 2011, MIUA.

[6]  Paul Suetens,et al.  Nonrigid Image Registration Using Conditional Mutual Information , 2007, IPMI.

[7]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[8]  Narendra Ahuja,et al.  A constant-space belief propagation algorithm for stereo matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[10]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[11]  Peter N. Yianilos,et al.  Data structures and algorithms for nearest neighbor search in general metric spaces , 1993, SODA '93.

[12]  James C. Gee,et al.  Point similarity measures for non-rigid registration of multi-modal data , 2003, Comput. Vis. Image Underst..

[13]  Andrew Zisserman,et al.  Texture classification: are filter banks necessary? , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Shree K. Nayar,et al.  What Is a Good Nearest Neighbors Algorithm for Finding Similar Patches in Images? , 2008, ECCV.

[15]  Daniel Rueckert,et al.  Non-rigid registration using higher-order mutual information , 2000, Medical Imaging.

[16]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.