Spatial and Anatomical Regularization of SVM: A General Framework for Neuroimaging Data

This paper presents a framework to introduce spatial and anatomical priors in SVM for brain image analysis based on regularization operators. A notion of proximity based on prior anatomical knowledge between the image points is defined by a graph (e.g., brain connectivity graph) or a metric (e.g., Fisher metric on statistical manifolds). A regularization operator is then defined from the graph Laplacian, in the discrete case, or from the Laplace-Beltrami operator, in the continuous case. The regularization operator is then introduced into the SVM, which exponentially penalizes high-frequency components with respect to the graph or to the metric and thus constrains the classification function to be smooth with respect to the prior. It yields a new SVM optimization problem whose kernel is a heat kernel on graphs or on manifolds. We then present different types of priors and provide efficient computations of the Gram matrix. The proposed framework is finally applied to the classification of brain Magnetic Resonance (MR) images (based on Gray Matter (GM) concentration maps and cortical thickness measures) from 137 patients with Alzheimer's Disease (AD) and 162 elderly controls. The results demonstrate that the proposed classifier generates less-noisy and consequently more interpretable feature maps with high classification performances.

[1]  D. Louis Collins,et al.  MRI-Based Automated Computer Classification of Probable AD Versus Normal Controls , 2008, IEEE Transactions on Medical Imaging.

[2]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[3]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[4]  Marie Chupin,et al.  Spatial and anatomical regularization of SVM for brain image analysis , 2010, NIPS.

[5]  Marie Chupin,et al.  Automatic classi fi cation of patients with Alzheimer ' s disease from structural MRI : A comparison of ten methods using the ADNI database , 2010 .

[6]  C. Jack,et al.  MRI patterns of atrophy associated with progression to AD in amnestic mild cognitive impairment , 2008, Neurology.

[7]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[8]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[9]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Thomas Gärtner,et al.  A survey of kernels for structured data , 2003, SKDD.

[11]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[12]  Emmanuel Barillot,et al.  Classification of microarray data using gene networks , 2007, BMC Bioinformatics.

[13]  Karl J. Friston,et al.  A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains , 2001, NeuroImage.

[14]  Emmanuel Hebey,et al.  Sobolev Spaces on Riemannian Manifolds , 1996 .

[15]  Isabelle Bloch,et al.  A primal sketch of the cortex mean curvature: a morphogenesis based approach to study the variability of the folding patterns , 2003, IEEE Transactions on Medical Imaging.

[16]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[17]  Bernhard Schölkopf,et al.  Incorporating Invariances in Support Vector Learning Machines , 1996, ICANN.

[18]  Bernhard Schölkopf,et al.  Prior Knowledge in Support Vector Kernels , 1997, NIPS.

[19]  Simon Duchesne,et al.  Automated computer differential classification in Parkinsonian Syndromes via pattern analysis on MRI. , 2009, Academic radiology.

[20]  Nick C Fox,et al.  Accuracy of dementia diagnosis—a direct comparison between radiologists and a computerized method , 2008, Brain : a journal of neurology.

[21]  Donald Geman,et al.  Gibbs distributions and the bayesian restoration of images , 1984 .

[22]  Janaina Mourão Miranda,et al.  Investigating the predictive value of whole-brain structural MR scans in autism: A pattern classification approach , 2010, NeuroImage.

[23]  Emmanuel Hebey,et al.  Blow-up Theory for Elliptic PDEs in Riemannian Geometry , 2004 .

[24]  Luis Gómez-Chova,et al.  Semisupervised Image Classification With Laplacian Support Vector Machines , 2008, IEEE Geoscience and Remote Sensing Letters.

[25]  X. Wu,et al.  Individual patient diagnosis of AD and FTD via high-dimensional pattern classification of MRI , 2008, NeuroImage.

[26]  Alexander J. Smola,et al.  Kernels and Regularization on Graphs , 2003, COLT.

[27]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[28]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[29]  J. Pariente,et al.  Early diagnosis of Alzheimer's disease using cortical thickness: impact of cognitive reserve , 2009, Brain : a journal of neurology.

[30]  S. Rosenberg The Laplacian on a Riemannian Manifold: An Introduction to Analysis on Manifolds , 1997 .

[31]  Dinggang Shen,et al.  COMPARE: Classification of Morphological Patterns Using Adaptive Regional Elements , 2007, IEEE Transactions on Medical Imaging.

[32]  H. Benali,et al.  Fully automatic hippocampus segmentation and classification in Alzheimer's disease and mild cognitive impairment applied on data from ADNI , 2009, Hippocampus.

[33]  David Haussler,et al.  Exploiting Generative Models in Discriminative Classifiers , 1998, NIPS.

[34]  J. Jost Riemannian geometry and geometric analysis , 1995 .

[35]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[36]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[37]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[38]  H. Benali,et al.  Discrimination between Alzheimer disease, mild cognitive impairment, and normal aging by using automated segmentation of the hippocampus. , 2008, Radiology.

[39]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Isabelle Bloch,et al.  Fusion of spatial relationships for guiding recognition, example of brain structure recognition in 3D MRI , 2005, Pattern Recognit. Lett..

[41]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[42]  Didier Dormont,et al.  Spatial Regularization of Svm for the Detection of Diffusion Alterations Associated with Stroke Outcome , 2022 .

[43]  Marie Chupin,et al.  Multidimensional classification of hippocampal shape features discriminates Alzheimer's disease and mild cognitive impairment from normal aging , 2009, NeuroImage.

[44]  Griselda J. Garrido,et al.  A voxel-based morphometry study of temporal lobe gray matter reductions in Alzheimer’s disease , 2003, Neurobiology of Aging.

[45]  Kiralee M. Hayashi,et al.  Mapping cortical change in Alzheimer's disease, brain development, and schizophrenia , 2004, NeuroImage.

[46]  Alan C. Evans,et al.  Automated cortical thickness measurements from MRI can accurately separate Alzheimer's patients from normal elderly controls , 2008, Neurobiology of Aging.

[47]  John D. Lafferty,et al.  Diffusion Kernels on Graphs and Other Discrete Input Spaces , 2002, ICML.

[48]  Moo K. Chung,et al.  Spatially augmented LPboosting for AD classification with evaluations on the ADNI dataset , 2009, NeuroImage.

[49]  Bernhard Schölkopf,et al.  Training Invariant Support Vector Machines , 2002, Machine Learning.

[50]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[51]  Nick C Fox,et al.  Automatic classification of MR scans in Alzheimer's disease. , 2008, Brain : a journal of neurology.

[52]  Moo K. Chung,et al.  Unified Statistical Approach to Cortical Thickness Analysis , 2005, IPMI.

[53]  Clifford R. Jack,et al.  Alzheimer's disease diagnosis in individual subjects using structural MR images: Validation studies , 2008, NeuroImage.

[54]  et al.,et al.  Spatial patterns of brain atrophy in MCI patients, identified via high-dimensional pattern classification, predict subsequent cognitive decline , 2008, NeuroImage.

[55]  Dinggang Shen,et al.  Morphological classification of brains via high-dimensional shape transformations and machine learning methods , 2004, NeuroImage.

[56]  D Le Bihan,et al.  Detection of fMRI activation using Cortical Surface Mapping , 2001, Human brain mapping.

[57]  Marie Chupin,et al.  Anatomical Regularization on Statistical Manifolds for the Classification of Patients with Alzheimer's Disease , 2011, MLMI.

[58]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[59]  Bernhard Schölkopf,et al.  On a Kernel-Based Method for Pattern Recognition, Regression, Approximation, and Operator Inversion , 1998, Algorithmica.

[60]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[61]  John D. Lafferty,et al.  Diffusion Kernels on Statistical Manifolds , 2005, J. Mach. Learn. Res..