Manifold learning based registration algorithms applied to multimodal images

Manifold learning algorithms are proposed to be used in image processing based on their ability in preserving data structures while reducing the dimension and the exposure of data structure in lower dimension. Multi-modal images have the same structure and can be registered together as monomodal images if only structural information is shown. As a result, manifold learning is able to transform multi-modal images to mono-modal ones and subsequently do the registration using mono-modal methods. Based on this application, in this paper novel similarity measures are proposed for multi-modal images in which Laplacian eigenmaps are employed as manifold learning algorithm and are tested against rigid registration of PET/MR images. Results show the feasibility of using manifold learning as a way of calculating the similarity between multimodal images.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Sridhar Mahadevan,et al.  Manifold alignment using Procrustes analysis , 2008, ICML '08.

[3]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[4]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[6]  Kenji Suzuki.  Machine Learning in Computer-Aided Diagnosis: Medical Imaging Intelligence and Analysis , 2012 .

[7]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[8]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[9]  Daniel D. Lee,et al.  Semisupervised alignment of manifolds , 2005, AISTATS.

[10]  Daniel Rueckert,et al.  Manifold Learning for Medical Image Registration, Segmentation, and Classification , 2012 .

[11]  Mark Jenkinson,et al.  Medical image registration , 2001 .

[12]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[13]  Nassir Navab,et al.  Manifold Learning for Multi-Modal Image Registration , 2010, BMVC.

[14]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[15]  Hongbin Zha,et al.  Unsupervised Image Matching Based on Manifold Alignment , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Gerald Q. Maguire,et al.  Comparison and evaluation of retrospective intermodality brain image registration techniques. , 1997, Journal of computer assisted tomography.

[17]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .