Local label learning (LLL) for subcortical structure segmentation: Application to hippocampus segmentation

Automatic and reliable segmentation of subcortical structures is an important but difficult task in quantitative brain image analysis. Multi‐atlas based segmentation methods have attracted great interest due to their promising performance. Under the multi‐atlas based segmentation framework, using deformation fields generated for registering atlas images onto a target image to be segmented, labels of the atlases are first propagated to the target image space and then fused to get the target image segmentation based on a label fusion strategy. While many label fusion strategies have been developed, most of these methods adopt predefined weighting models that are not necessarily optimal. In this study, we propose a novel local label learning strategy to estimate the target image's segmentation label using statistical machine learning techniques. In particular, we use a L1‐regularized support vector machine (SVM) with a k nearest neighbor (kNN) based training sample selection strategy to learn a classifier for each of the target image voxel from its neighboring voxels in the atlases based on both image intensity and texture features. Our method has produced segmentation results consistently better than state‐of‐the‐art label fusion methods in validation experiments on hippocampal segmentation of over 100 MR images obtained from publicly available and in‐house datasets. Volumetric analysis has also demonstrated the capability of our method in detecting hippocampal volume changes due to Alzheimer's disease. Hum Brain Mapp 35:2674–2697, 2014. © 2013 Wiley Periodicals, Inc.

[1]  J C Mazziotta,et al.  Relating structure to function in vivo with tomographic imaging. , 1991, Ciba Foundation symposium.

[2]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[3]  Norbert Schuff,et al.  Automated mapping of hippocampal atrophy in 1-year repeat MRI data from 490 subjects with Alzheimer's disease, mild cognitive impairment, and elderly controls , 2009, NeuroImage.

[4]  Michaël Sdika,et al.  Combining atlas based segmentation and intensity classification with nearest neighbor transform and accuracy weighted vote , 2010, Medical Image Anal..

[5]  W. Eric L. Grimson,et al.  A Bayesian model for joint segmentation and registration , 2006, NeuroImage.

[6]  Mert R. Sabuncu,et al.  A Generative Model for Image Segmentation Based on Label Fusion , 2010, IEEE Transactions on Medical Imaging.

[7]  Daniel Rueckert,et al.  Automatic anatomical brain MRI segmentation combining label propagation and decision fusion , 2006, NeuroImage.

[8]  Jitendra Malik,et al.  SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Max A. Viergever,et al.  Label Fusion in Atlas-Based Segmentation Using a Selective and Iterative Method for Performance Level Estimation (SIMPLE) , 2010, IEEE Transactions on Medical Imaging.

[10]  Michael Weiner,et al.  and the Alzheimer’s Disease Neuroimaging Initiative* , 2007 .

[11]  R. Bajcsy,et al.  A computerized system for the elastic matching of deformed radiographic images to idealized atlas images. , 1983, Journal of computer assisted tomography.

[12]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[13]  Liana G. Apostolova,et al.  Comparison of AdaBoost and Support Vector Machines for Detecting Alzheimer's Disease Through Automated Hippocampal Segmentation , 2010, IEEE Transactions on Medical Imaging.

[14]  Paul M. Thompson,et al.  Brain Anatomical Structure Segmentation by Hybrid Discriminative/Generative Models , 2008, IEEE Transactions on Medical Imaging.

[15]  Timothy F. Cootes,et al.  A Unified Information-Theoretic Approach to Groupwise Non-rigid Registration and Model Building , 2005, IPMI.

[16]  Juha Koikkalainen,et al.  Fast and robust multi-atlas segmentation of brain magnetic resonance images , 2010, NeuroImage.

[17]  Cameron S. Carter,et al.  Optimum template selection for atlas-based segmentation , 2007, NeuroImage.

[18]  Daniel Rueckert,et al.  Classifier Selection Strategies for Label Fusion Using Large Atlas Databases , 2007, MICCAI.

[19]  D. Louis Collins,et al.  Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation , 2011, NeuroImage.

[20]  Stephanie Powell,et al.  Registration and machine learning-based automated segmentation of subcortical and cerebellar brain structures , 2008, NeuroImage.

[21]  Bennett A. Landman,et al.  Robust Statistical Label Fusion Through Consensus Level, Labeler Accuracy, and Truth Estimation (COLLATE) , 2011, IEEE Transactions on Medical Imaging.

[22]  Max A. Viergever,et al.  Multi-Atlas-Based Segmentation With Local Decision Fusion—Application to Cardiac and Aortic Segmentation in CT Scans , 2009, IEEE Transactions on Medical Imaging.

[23]  Dennis F. Dunn,et al.  Optimal Gabor filters for texture segmentation , 1995, IEEE Trans. Image Process..

[24]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[25]  Norbert Schuff,et al.  Automated cross-sectional and longitudinal hippocampal volume measurement in mild cognitive impairment and Alzheimer's disease , 2010, NeuroImage.

[26]  C. Jack,et al.  MRI of hippocampal volume loss in early Alzheimer's disease in relation to ApoE genotype and biomarkers , 2008, Brain : a journal of neurology.

[27]  Nicolas Cherbuin,et al.  Optimal weights for local multi-atlas fusion using supervised learning and dynamic information (SuperDyn): Validation on hippocampus segmentation , 2011, NeuroImage.

[28]  Arthur W. Toga,et al.  Towards Whole Brain Segmentation by a Hybrid Model , 2007, MICCAI.

[29]  Hamid Soltanian-Zadeh,et al.  Dataset of Magnetic Resonance Images of Nonepileptic Subjects and Temporal Lobe Epilepsy Patients for Validation of Hippocampal Segmentation Techniques , 2011, Neuroinformatics.

[30]  R. Bajcsy,et al.  Elastically Deforming 3D Atlas to Match Anatomical Brain Images , 1993, Journal of computer assisted tomography.

[31]  Xiao Han,et al.  Atlas Renormalization for Improved Brain MR Image Segmentation Across Scanner Platforms , 2007, IEEE Transactions on Medical Imaging.

[32]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[33]  Olivier D. Faugeras,et al.  Statistical shape influence in geodesic active contours , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[34]  Daniel Rueckert,et al.  LEAP: Learning embeddings for atlas propagation , 2010, NeuroImage.

[35]  D. Louis Collins,et al.  Towards accurate, automatic segmentation of the hippocampus and amygdala from MRI by augmenting ANIMAL with a template library and label fusion , 2010, NeuroImage.

[36]  G C Sharp,et al.  GPU-based streaming architectures for fast cone-beam CT image reconstruction and demons deformable registration , 2007, Physics in medicine and biology.

[37]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Hiroyuki Yoshida,et al.  Fundamentals of Three-dimensional Digital Image Processing , 2009 .

[39]  W. Eric L. Grimson,et al.  Logarithm Odds Maps for Shape Representation , 2006, MICCAI.

[40]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[41]  Junyi Xia,et al.  High performance computing for deformable image registration: towards a new paradigm in adaptive radiotherapy. , 2008, Medical physics.

[42]  Xiao Han,et al.  GPU-accelerated, gradient-free MI deformable registration for atlas-based MR brain image segmentation , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[43]  Torsten Rohlfing,et al.  Shape-Based Averaging , 2007, IEEE Transactions on Image Processing.

[44]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[45]  Tianzi Jiang,et al.  Local label learning (L3) for multi-atlas based segmentation , 2012, Medical Imaging.

[46]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[47]  Sébastien Ourselin,et al.  Brain MAPS: An automated, accurate and robust brain extraction technique using a template library , 2011, NeuroImage.

[48]  J. Ehrhardt,et al.  Measurement of brain structures with artificial neural networks: two- and three-dimensional applications. , 1999, Radiology.

[49]  Mert R. Sabuncu,et al.  Effects of registration regularization and atlas sharpness on segmentation accuracy , 2008, Medical Image Anal..

[50]  T. Jernigan,et al.  Development of cortical and subcortical brain structures in childhood and adolescence: a structural MRI study , 2002, Developmental medicine and child neurology.

[51]  R. Kikinis,et al.  An Automated Registration Algorithm for Measuring MRI Subcortical Brain Structures , 1997, NeuroImage.

[52]  D. Louis Collins,et al.  ANIMAL+INSECT: Improved Cortical Structure Segmentation , 1999, IPMI.

[53]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[54]  Brian B. Avants,et al.  The optimal template effect in hippocampus studies of diseased populations , 2010, NeuroImage.

[55]  Edgar Arce Santana,et al.  Hidden Markov Measure Field Models for Image Segmentation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Ali R. Khan,et al.  FreeSurfer-initiated fully-automated subcortical brain segmentation in MRI using Large Deformation Diffeomorphic Metric Mapping , 2008, NeuroImage.

[57]  Daniel Rueckert,et al.  Improving intersubject image registration using tissue-class information benefits robustness and accuracy of multi-atlas based anatomical segmentation , 2010, NeuroImage.

[58]  Daniel Rueckert,et al.  Automatic morphometry in Alzheimer's disease and mild cognitive impairment☆☆☆ , 2011, NeuroImage.

[59]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[60]  J. Eng,et al.  Sample Size Estimation : How Many Individuals Should Be Studied ? , 2022 .

[61]  Torsten Rohlfing,et al.  Evaluation of atlas selection strategies for atlas-based image segmentation with application to confocal microscopy images of bee brains , 2004, NeuroImage.

[62]  Carlos Ortiz-de-Solorzano,et al.  Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data , 2009, IEEE Transactions on Medical Imaging.

[63]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[64]  Brian B. Avants,et al.  A learning-based wrapper method to correct systematic errors in automatic image segmentation: Consistently improved performance in hippocampus, cortex and brain segmentation , 2011, NeuroImage.

[65]  Max A. Viergever,et al.  Adaptive local multi-atlas segmentation: Application to the heart and the caudate nucleus , 2010, Medical Image Anal..

[66]  Daniel S. O'Leary,et al.  Manual and Semiautomated Measurement of Cerebellar Subregions on MR Images , 2002, NeuroImage.

[67]  Dinggang Shen,et al.  Iterative multi-atlas-based multi-image segmentation with tree-based registration , 2012, NeuroImage.

[68]  D. Louis Collins,et al.  Automatic 3‐D model‐based neuroanatomical segmentation , 1995 .

[69]  Jyrki Lötjönen,et al.  Measurement of hippocampal atrophy using 4D graph-cut segmentation: Application to ADNI , 2010, NeuroImage.

[70]  N. Hata,et al.  An integrated visualization system for surgical planning and guidance using image fusion and an open MR , 2001, Journal of magnetic resonance imaging : JMRI.

[71]  Michael W. Weiner,et al.  Corrigendum to “Validation of a fully automated 3D hippocampal segmentation method using subjects with Alzheimer's disease, mild cognitive impairment, and elderly controls” [NeuroImage 43 (2008) 59–68] , 2009, NeuroImage.

[72]  Arrate Muñoz-Barrutia,et al.  Efficient classifier generation and weighted voting for atlas-based segmentation: two small steps faster and closer to the combination oracle , 2008, SPIE Medical Imaging.

[73]  Teng-Yi Huang,et al.  Accelerating image registration of MRI by GPU-based parallel computation. , 2011, Magnetic resonance imaging.

[74]  Colin Studholme,et al.  A Supervised Patch-Based Approach for Human Brain Labeling , 2011, IEEE Transactions on Medical Imaging.

[75]  Bennett A. Landman,et al.  Non-local STAPLE: An Intensity-Driven Multi-atlas Rater Model , 2012, MICCAI.

[76]  Torsten Rohlfing,et al.  Performance-based classifier combination in atlas-based image segmentation using expectation-maximization parameter estimation , 2004, IEEE Transactions on Medical Imaging.

[77]  Chih-Jen Lin,et al.  A Comparison of Optimization Methods and Software for Large-scale L1-regularized Linear Classification , 2010, J. Mach. Learn. Res..

[78]  Paul A. Yushkevich,et al.  Regression-based label fusion for multi-atlas segmentation , 2011, CVPR 2011.

[79]  Nancy C. Andreasen,et al.  Manual and Automated Measurement of the Whole Thalamus and Mediodorsal Nucleus Using Magnetic Resonance Imaging , 2002, NeuroImage.

[80]  Daniel Rueckert,et al.  Automatic segmentation and reconstruction of the cortex from neonatal MRI , 2007, NeuroImage.

[81]  Anders M. Fjell,et al.  Heterogeneity in Subcortical Brain Development: A Structural Magnetic Resonance Imaging Study of Brain Maturation from 8 to 30 Years , 2009, The Journal of Neuroscience.

[82]  Anders M. Dale,et al.  Reliability in multi-site structural MRI studies: Effects of gradient non-linearity correction on phantom and human data , 2006, NeuroImage.