Deformable Image Registration in the Analysis of Multiple Sclerosis

In medical image analysis, image registration is the task of finding corresponding features in two or more images, and using them to solve for the transformation that best aligns the images. Knowing the alignment allows information, such as landmarks and functional metrics, to be easily transferred between images, and allows them to be analyzed together. This dissertation focuses on the development of deformable image registration techniques for the analysis of multiple sclerosis (MS), a neurodegenerative disease that damages the myelin sheath of nervous tissue. MS is known to affect the entire central nervous system (CNS), and can result in the loss of sensorimotor control, cognition, and vision. Hence, the four primary contributions of this dissertation are on the development and application of deformable image registration in the three areas of the CNS that are most currently studied for MS – the spinal cord, the retina, and the brain. First, for spinal cord magnetic resonance imaging (MRI), an approach is presented that uses deformable registration to provide atlas priors for automatic topologypreserving segmentation of the spinal cord and cerebrospinal fluid. The method shows high accuracy and robustness when compared to manual raters, and allows spinal cord atrophy to be analyzed on large datasets without manual segmentations. Second, for spinal cord diffusion tensor imaging, a pipeline is presented that uses deformable registration to correct for susceptibility distortions in the images. The pipeline allows for accurate computation of spinal cord diffusion metrics, which are shown to be significantly correlated with clinical measures of sensorimotor function and disability levels. Third, for optical coherence tomography (OCT) of the retina, a deformable registration technique is presented that constrains the transformation to follow the OCT acquisition

[1]  Aaron Carass,et al.  Topology preserving automatic segmentation of the spinal cord in magnetic resonance images , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[2]  G. Staurenghi,et al.  Aligning scan locations from consecutive spectral-domain optical coherence tomography examinations: a comparison among different strategies. , 2012, Investigative ophthalmology & visual science.

[3]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[4]  I. Allen,et al.  Ocular pathology in multiple sclerosis: retinal atrophy and inflammation irrespective of disease duration. , 2010, Brain : a journal of neurology.

[5]  R. S. Hinks,et al.  Motion artifacts in brain and spine MR. , 1988, Radiologic clinics of North America.

[6]  Jean-Philippe Thirion,et al.  Image matching as a diffusion process: an analogy with Maxwell's demons , 1998, Medical Image Anal..

[7]  M I Miller,et al.  Mathematical textbook of deformable neuroanatomies. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[8]  John A. Butman,et al.  Semi-automatic spinal cord segmentation and quantification , 2005 .

[9]  Benoit M. Dawant,et al.  Automatic segmentation of the optic nerves and chiasm in CT and MR using the atlas-navigated optimal medial axis and deformable-model algorithm , 2009, Medical Imaging.

[10]  Richard S. J. Frackowiak,et al.  Navigation-related structural change in the hippocampi of taxi drivers. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Hiroshi Ishikawa,et al.  Macular segmentation with optical coherence tomography. , 2005, Investigative ophthalmology & visual science.

[12]  Jerry L Prince,et al.  Multiparametric MRI correlates of sensorimotor function in the spinal cord in multiple sclerosis , 2013, Multiple sclerosis.

[13]  Mirza Faisal Beg,et al.  Optic Nerve Head Registration Via Hemispherical Surface and Volume Registration , 2010, IEEE Transactions on Biomedical Engineering.

[14]  Austin Roorda,et al.  Revealing Henle's fiber layer using spectral domain optical coherence tomography. , 2011, Investigative ophthalmology & visual science.

[15]  M Filippi,et al.  Magnetization transfer changes in the normal appering white matter precede the appearance of enhancing lesions in patients with multiple sclerosis , 1998, Annals of neurology.

[16]  Peter D. Scott,et al.  An automatic segmentation method of the spinal canal from clinical MR images based on an attention model and an active contour model , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[17]  Jonathan D. Campbell,et al.  Burden of multiple sclerosis on direct, indirect costs and quality of life: National US estimates. , 2014, Multiple sclerosis and related disorders.

[18]  Peter A. Calabresi,et al.  Deformable registration of macular oct using a-mode scan similarity , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[19]  Min Chen,et al.  Multi-parametric neuroimaging reproducibility: A 3-T resource study , 2011, NeuroImage.

[20]  Yan Wang,et al.  A Generative Model for OCT Retinal Layer Segmentation by Integrating Graph-Based Multi-surface Searching and Image Registration , 2013, MICCAI.

[21]  Aaron Carass,et al.  Erratum to: The Java Image Science Toolkit (JIST) for Rapid Prototyping and Publishing of Neuroimaging Software , 2010, Neuroinformatics.

[22]  Aaron Carass,et al.  Automatic magnetic resonance spinal cord segmentation with topology constraints for variable fields of view , 2013, NeuroImage.

[23]  Benoit M. Dawant,et al.  The adaptive bases algorithm for intensity-based nonrigid image registration , 2003, IEEE Transactions on Medical Imaging.

[24]  Nassir Navab,et al.  Automatic CT-ultrasound registration for diagnostic imaging and image-guided intervention , 2008, Medical Image Anal..

[25]  A. Thompson,et al.  Spinal cord atrophy and disability in multiple sclerosis. A new reproducible and sensitive MRI method with potential to monitor disease progression. , 1996, Brain : a journal of neurology.

[26]  Ross T. Whitaker,et al.  Manifold modeling for brain population analysis , 2010, Medical Image Anal..

[27]  D. Chakeres,et al.  MR imaging artifacts of the axial internal anatomy of the cervical spinal cord. , 1989, AJR. American journal of roentgenology.

[28]  Karl J. Friston,et al.  A Voxel-Based Morphometric Study of Ageing in 465 Normal Adult Human Brains , 2001, NeuroImage.

[29]  Jean Meunier,et al.  Average Brain Models: A Convergence Study , 2000, Comput. Vis. Image Underst..

[30]  Vince D. Calhoun,et al.  ICA-fNORM: Spatial Normalization of fMRI Data Using Intrinsic Group-ICA Networks , 2011, Front. Syst. Neurosci..

[31]  R. Grossman,et al.  Characterizing iron deposition in multiple sclerosis lesions using susceptibility weighted imaging , 2009, Journal of magnetic resonance imaging : JMRI.

[32]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[33]  Snehashis Roy,et al.  Magnetic resonance image synthesis through patch regression , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[34]  Xiaodong Wu,et al.  Intraretinal Layer Segmentation of Macular Optical Coherence Tomography Images Using Optimal 3-D Graph Search , 2008, IEEE Transactions on Medical Imaging.

[35]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[36]  N. Namerow Somatosensory evoked responses in multiple sclerosis patients with varying sensory loss , 1968, Neurology.

[37]  Michael Egmont-Petersen,et al.  A knowledge-based approach to automatic detection of the spinal cord in CT images , 2002, IEEE Transactions on Medical Imaging.

[38]  Thomas Martini Jørgensen,et al.  Enhancing the signal-to-noise ratio in ophthalmic optical coherence tomography by image registration--method and clinical examples. , 2007, Journal of biomedical optics.

[39]  Peter A. Calabresi,et al.  Segmentation of retinal OCT images using a random forest classifier , 2013, Medical Imaging.

[40]  Aaron Carass,et al.  Distance transforms in multi channel MR image registration , 2011, Medical Imaging.

[41]  Christos Davatzikos,et al.  Voxel-Based Morphometry Using the RAVENS Maps: Methods and Validation Using Simulated Longitudinal Atrophy , 2001, NeuroImage.

[42]  Eliza M. Gordon-Lipkin,et al.  Sensorimotor dysfunction in multiple sclerosis and column-specific magnetization transfer-imaging abnormalities in the spinal cord. , 2009, Brain : a journal of neurology.

[43]  Bruno Alfano,et al.  Grey matter loss in relapsing–remitting multiple sclerosis: A voxel-based morphometry study , 2006, NeuroImage.

[44]  Derek K Jones,et al.  Applications of diffusion‐weighted and diffusion tensor MRI to white matter diseases – a review , 2002, NMR in biomedicine.

[45]  Satrajit S. Ghosh,et al.  Evaluation of volume-based and surface-based brain image registration methods , 2010, NeuroImage.

[46]  J. Gee,et al.  Geodesic estimation for large deformation anatomical shape averaging and interpolation , 2004, NeuroImage.

[47]  V M Haughton,et al.  Characteristic features of MR truncation artifacts. , 1988, AJR. American journal of roentgenology.

[48]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[49]  Stelios Zimeras,et al.  An Accurate 3D Segmentation Method of the Spinal Canal Applied to CT Data , 2002, Bildverarbeitung für die Medizin.

[50]  Ghassan Hamarneh,et al.  Spinal Crawlers: Deformable Organisms for Spinal Cord Segmentation and Analysis , 2006, MICCAI.

[51]  James G Fujimoto,et al.  Optical coherence tomography: a window into the mechanisms of multiple sclerosis , 2008, Nature Clinical Practice Neurology.

[52]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[53]  S. Resnick,et al.  An image-processing system for qualitative and quantitative volumetric analysis of brain images. , 1998, Journal of computer assisted tomography.

[54]  Paul Suetens,et al.  Medical image registration using mutual information , 2003, Proc. IEEE.

[55]  R. Bakshi,et al.  Approaches to Normalization of Spinal Cord Volume: Application to Multiple Sclerosis , 2012, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[56]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[57]  Vipin Chaudhary,et al.  Automatic segmentation of the spinal cord and the dural sac in lumbar MR images using gradient vector flow field , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[58]  G. Marchal,et al.  Multi-modal volume registration by maximization of mutual information , 1997 .

[59]  Peter A. Calabresi,et al.  Voxel-wise displacement as independent features in classification of multiple sclerosis , 2013, Medical Imaging.

[60]  C. Crainiceanu,et al.  Microcystic macular oedema, thickness of the inner nuclear layer of the retina, and disease characteristics in multiple sclerosis: a retrospective study , 2012, The Lancet Neurology.

[61]  Irene Cheng,et al.  Automatic Segmentation of Spinal Cord MRI Using Symmetric Boundary Tracing , 2010, IEEE Transactions on Information Technology in Biomedicine.

[62]  A. Green,et al.  Microcystic macular oedema in multiple sclerosis is associated with disease severity. , 2012, Brain : a journal of neurology.

[63]  Jerry L Prince,et al.  Retinal layer segmentation of macular OCT images using boundary classification , 2013, Biomedical optics express.

[64]  C. Tench,et al.  Measurement of Spinal Cord Atrophy in Multiple Sclerosis , 2004, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[65]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[66]  J. Hogg Magnetic resonance imaging. , 1994, Journal of the Royal Naval Medical Service.

[67]  W R Green,et al.  RETINAL PATHOLOGIC CHANGES IN MULTIPLE SCLEROSIS , 1994, Retina.

[68]  Stephen M. Rao,et al.  Cognitive dysfunction in multiple sclerosis. , 1991, Neurology.

[69]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[70]  Michael I. Miller,et al.  Deformable templates using large deformation kinematics , 1996, IEEE Trans. Image Process..

[71]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[72]  Jerry L Prince,et al.  Spinal cord quantitative MRI discriminates between disability levels in multiple sclerosis , 2013, Neurology.

[73]  Xiaoying Wu,et al.  Structural and functional biomarkers of prodromal Alzheimer's disease: A high-dimensional pattern classification study , 2008, NeuroImage.

[74]  P. E. Anuta,et al.  Spatial Registration of Multispectral and Multitemporal Digital Imagery Using Fast Fourier Transform Techniques , 1970 .

[75]  Pierre-Louis Bazin,et al.  Homeomorphic brain image segmentation with topological and statistical atlases , 2008, Medical Image Anal..

[76]  Karl J. Friston,et al.  Disability, atrophy and cortical reorganization following spinal cord injury , 2011, Brain : a journal of neurology.

[77]  R. Bajcsy,et al.  Elastic Matching: Continuum Mechanical and Probabilistic Analysis , 1999 .

[78]  Bostjan Likar,et al.  A hierarchical approach to elastic registration based on mutual information , 2001, Image Vis. Comput..

[79]  Kim L. Boyer,et al.  Retinal thickness measurements from optical coherence tomography using a Markov boundary model , 2001, IEEE Transactions on Medical Imaging.

[80]  M. A. Horsfield,et al.  Rapid semi-automatic segmentation of the spinal cord from magnetic resonance images: Application in multiple sclerosis , 2010, NeuroImage.

[81]  Philippe C. Cattin,et al.  Non-rigid registration of multi-modal images using both mutual information and cross-correlation , 2008, Medical Image Anal..

[82]  Xia Li,et al.  Enhancement of histological volumes through averaging and their use for the analysis of magnetic resonance images. , 2009, Magnetic resonance imaging.

[83]  Milan Sonka,et al.  Registration of 3D spectral OCT volumes combining ICP with a graph-based approach , 2012, Medical Imaging.

[84]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[85]  J. E. Tanner,et al.  Spin diffusion measurements : spin echoes in the presence of a time-dependent field gradient , 1965 .

[86]  M. Horsfield,et al.  A multicenter assessment of cervical cord atrophy among MS clinical phenotypes , 2011, Neurology.

[87]  Juan Xu,et al.  Alignment of 3-D Optical Coherence Tomography Scans to Correct Eye Movement Using a Particle Filtering , 2012, IEEE Transactions on Medical Imaging.

[88]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[89]  Alejandro F. Frangi,et al.  Automatic Construction of 3D Statistical Deformation Models Using Non-rigid Registration , 2001, MICCAI.

[90]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[91]  G J Barker,et al.  Quantification of spinal cord atrophy from magnetic resonance images via a B‐spline active surface model , 2002, Magnetic resonance in medicine.

[92]  Ryan P. McNabb,et al.  Correction of ocular shape in retinal optical coherence tomography and effect on current clinical measures. , 2013, American journal of ophthalmology.

[93]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[94]  Aaron Carass,et al.  Simple paradigm for extra-cerebral tissue removal: Algorithm and analysis , 2011, NeuroImage.

[95]  Milan Sonka,et al.  Automated 3-D method for the correction of axial artifacts in spectral-domain optical coherence tomography images , 2011, Biomedical optics express.

[96]  Derek K. Jones,et al.  Diffusion‐tensor MRI: theory, experimental design and data analysis – a technical review , 2002 .

[97]  Carlo Pierpaoli,et al.  A Comprehensive Approach for Multi-channel Image Registration , 2003, WBIR.

[98]  James C. Bezdek,et al.  A Convergence Theorem for the Fuzzy ISODATA Clustering Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[99]  Hristian,et al.  RELAPSES AND PROGRESSION OF DISABILITY IN MULTIPLE SCLEROSIS , 2000 .

[100]  Richard P. Brent,et al.  An Algorithm with Guaranteed Convergence for Finding a Zero of a Function , 1971, Comput. J..

[101]  Zhongxing Liao,et al.  A deformable-model approach to semi-automatic segmentation of CT images demonstrated by application to the spinal canal. , 2004, Medical physics.

[102]  Aaron Carass,et al.  A JOINT REGISTRATION AND SEGMENTATION APPROACH TO SKULL STRIPPING , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[103]  Craig K. Jones,et al.  Reproducibility of tract‐specific magnetization transfer and diffusion tensor imaging in the cervical spinal cord at 3 tesla , 2009, NMR in biomedicine.

[104]  E R McVeigh,et al.  Syrinx-like artifacts on MR images of the spinal cord. , 1988, Radiology.

[105]  Shiv Saidha,et al.  Relationships between retinal axonal and neuronal measures and global central nervous system pathology in multiple sclerosis. , 2012, JAMA neurology.

[106]  Milan Sonka,et al.  Registration of 3D spectral OCT volumes using 3D SIFT feature point matching , 2009, Medical Imaging.

[107]  Xia Li,et al.  Accuracy of image registration between MRI and light microscopy in the ex vivo brain. , 2011, Magnetic resonance imaging.

[108]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[109]  Jerry L Prince,et al.  Analysis of macular OCT images using deformable registration. , 2014, Biomedical optics express.

[110]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[111]  J. McGowan,et al.  Technical issues for MRI examination of the posterior fossa , 2000, Journal of the Neurological Sciences.

[112]  Joseph A. Izatt,et al.  Automatic segmentation of seven retinal layers in SDOCT images congruent with expert manual segmentation , 2010, Optics express.

[113]  Aaron Carass,et al.  Using image synthesis for multi-channel registration of different image modalities , 2015, Medical Imaging.

[114]  Ning Xu,et al.  Accounting for Signal Loss Due to Dephasing in the Correction of Distortions in Gradient-Echo EPI Via Nonrigid Registration , 2007, IEEE Transactions on Medical Imaging.

[115]  R A Brooks,et al.  Spinal cord artifacts from truncation errors during MR imaging. , 1988, Radiology.

[116]  T. Hammeke,et al.  Memory disturbance in chronic progressive multiple sclerosis. , 1984, Archives of neurology.

[117]  Karl J. Friston,et al.  Voxel-Based Morphometry—The Methods , 2000, NeuroImage.

[118]  Robert A. McLaughlin,et al.  Motion correction of in vivo three-dimensional optical coherence tomography of human skin using a fiducial marker , 2012, Biomedical optics express.

[119]  P. Jezzard,et al.  Correction for geometric distortion in echo planar images from B0 field variations , 1995, Magnetic resonance in medicine.

[120]  M Filippi,et al.  Spinal cord atrophy and disability in multiple sclerosis over four years , 2003, Journal of neurology, neurosurgery, and psychiatry.

[121]  Mara Cercignani,et al.  Regional gray matter atrophy in early primary progressive multiple sclerosis: a voxel-based morphometry study. , 2006, Archives of neurology.

[122]  Pierre-Louis Bazin,et al.  Topology-Preserving Tissue Classification of Magnetic Resonance Brain Images , 2007, IEEE Transactions on Medical Imaging.

[123]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[124]  S. A. Meyer,et al.  Active MS is associated with accelerated retinal ganglion cell/inner plexiform layer thinning , 2013, Neurology.

[125]  Dzung L. Pham,et al.  Spatial Models for Fuzzy Clustering , 2001, Comput. Vis. Image Underst..

[126]  Brian B. Avants,et al.  Evaluation of Registration Methods on Thoracic CT: The EMPIRE10 Challenge , 2011, IEEE Transactions on Medical Imaging.

[127]  Mariusz Nieniewski,et al.  Segmentation of spinal cord images by means of watershed and region merging together with inhomogeneity correction , 2002 .

[128]  Carl-Fredrik Westin,et al.  Improving Registration Using Multi-channel Diffeomorphic Demons Combined with Certainty Maps , 2011, MBIA.

[129]  W G Bradley,et al.  Suspected multiple sclerosis: MR imaging with a thin-section fast FLAIR pulse sequence. , 1995, Radiology.

[130]  Carl-Fredrik Westin,et al.  Spatial normalization of diffusion tensor MRI using multiple channels , 2003, NeuroImage.

[131]  J. Kurtzke Rating neurologic impairment in multiple sclerosis , 1983, Neurology.

[132]  Nikos Paragios,et al.  Image transport regression using mixture of experts and discrete Markov Random Fields , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[133]  László G. Nyúl,et al.  Method for Automatically Segmenting the Spinal Cord and Canal from 3D CT Images , 2005, CAIP.

[134]  Michael Unser,et al.  Unwarping of unidirectionally distorted EPI images , 2000, IEEE Transactions on Medical Imaging.

[135]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .

[136]  Brian B. Avants,et al.  Multivariate Normalization with Symmetric Diffeomorphisms for Multivariate Studies , 2007, MICCAI.

[137]  F. Barkhof,et al.  The effect of the neuroprotective agent riluzole on MRI parameters in primary progressive multiple sclerosis: a pilot study , 2002, Multiple sclerosis.