Manifold Learning for Medical Image Registration, Segmentation, and Classification

The term manifold learning encompasses a class of machine learning techniques that convert data from a high to lower dimensional representation while respecting the intrinsic geometry of the data. The intuition underlying the use of manifold learning in the context of image analysis is that, while each image may be viewed as a single point in a very high-dimensional space, a set of such points for a population of images may be well represented by a sub-manifold of the space that is likely to be non-linear and of a significantly lower dimension. Recently, manifold learning techniques have begun to be applied to the field of medical image analysis. This chapter will review the most popular manifold learning techniques such as Multi-Dimensional Scaling (MDS), Isomap, Local linear embedding, and Laplacian eigenmaps. It will also demonstrate how these techniques can be used for image registration, segmentation, and biomarker discovery from medical images.

[1]  E. Nadaraya On Estimating Regression , 1964 .

[2]  Anne Lohrli Chapman and Hall , 1985 .

[3]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[5]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[6]  Morten Bro-Nielsen,et al.  Fast Fluid Registration of Medical Images , 1996, VBC.

[7]  Bernhard Schölkopf,et al.  Kernel Principal Component Analysis , 1997, ICANN.

[8]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[9]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[10]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[11]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[12]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  I. Jolliffe Principal Component Analysis , 2002 .

[14]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Nicolas Le Roux,et al.  Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering , 2003, NIPS.

[16]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[17]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[18]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[19]  Torsten Rohlfing,et al.  Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains , 2004, NeuroImage.

[20]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[21]  Ann B. Lee,et al.  Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[22]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[23]  Robert Pless,et al.  Isomap and Nonparametric Models of Image Deformation , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[24]  Robert Pless,et al.  On Manifold Structure of Cardiac MRI Data: Application to Segmentation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[25]  Oscar Camara,et al.  Generalized Overlap Measures for Evaluation and Validation in Medical Image Analysis , 2006, IEEE Transactions on Medical Imaging.

[26]  Daniel Rueckert,et al.  Automatic anatomical brain MRI segmentation combining label propagation and decision fusion , 2006, NeuroImage.

[27]  Robert Pless,et al.  Image distance functions for manifold learning , 2007, Image Vis. Comput..

[28]  Yi-Ping Hung,et al.  Analyzing Facial Expression by Fusing Manifolds , 2007, ACCV.

[29]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[30]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[31]  Robert Pless,et al.  Manifold learning for 4D CT reconstruction of the lung , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[32]  Daniel Rueckert,et al.  Automated morphological analysis of magnetic resonance brain imaging using spectral analysis , 2008, NeuroImage.

[33]  Michael Weiner,et al.  Tensor-based morphometry as a neuroimaging biomarker for Alzheimer's disease: An MRI study of 676 AD, MCI, and normal subjects , 2008, NeuroImage.

[34]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[35]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[36]  Robert Pless,et al.  A Survey of Manifold Learning for Images , 2009, IPSJ Trans. Comput. Vis. Appl..

[37]  Nassir Navab,et al.  Manifold Learning for Multi-Modal Image Registration , 2010, BMVC.

[38]  Christos Davatzikos,et al.  GRAM: A framework for geodesic registration on anatomical manifolds , 2010, Medical Image Anal..

[39]  Daniel Rueckert,et al.  LEAP: Learning embeddings for atlas propagation , 2010, NeuroImage.

[40]  Daniel Rueckert,et al.  Manifold Learning for Biomarker Discovery in MR Imaging , 2010, MLMI.

[41]  Nassir Navab,et al.  Manifold Learning for Image-Based Breathing Gating with Application to 4D Ultrasound , 2010, MICCAI.

[42]  Stefan Klein,et al.  Early diagnosis of dementia based on intersubject whole-brain dissimilarities , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[43]  Dinggang Shen,et al.  Construction of multi-region-multi-reference atlases for neonatal brain MRI segmentation , 2010, NeuroImage.

[44]  Ross T. Whitaker,et al.  Manifold modeling for brain population analysis , 2010, Medical Image Anal..

[45]  Mary A. Rutherford,et al.  Combining Morphological Information in a Manifold Learning Framework: Application to Neonatal MRI , 2010, MICCAI.

[46]  Jyrki Lötjönen,et al.  Manifold learning combining imaging with non-imaging information , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.