Combining a Patch-based Approach with a Non-rigid Registration-based Label Fusion Method for the Hippocampal Segmentation in Alzheimer’s Disease

We provide and evaluate an open-source software solution for automatically hippocampal segmentation from T1-weighted (T1w) magnetic resonance imaging (MRI). The method is applied for measuring the hippocampal volume, which allows discriminate between patients with Alzheimer’s disease (AD) or mild cognitive impairment (MCI) and elderly controls (NC). The method is based on a fast patch-based label fusion method, whose selected patches and their weights are calculated from a combination of similarity measures between patches using intensity-based distances and labeling-based distances. These combined similarity measures produces better selection of the patches, and their weights are more robust. The algorithm is trained with the Harmonized Hippocampal Protocol (HarP). The proposal is compared with FreeSurfer and other label fusion methods. To evaluate the performance and the robustness of the proposed label fusion method, we employ two databases of T1w MRI of human brains. For AD vs NC, we obtain a high degree of accuracy, approximately 90 %. For MCI vs NC, we obtain accuracies around 75 %. The average time for the hippocampal segmentation from a T1w MRI is less than 17 minutes.

[1]  Carlos Ortiz-de-Solorzano,et al.  Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data , 2009, IEEE Transactions on Medical Imaging.

[2]  Juha Koikkalainen,et al.  Fast and robust multi-atlas segmentation of brain magnetic resonance images , 2010, NeuroImage.

[3]  Mark W. Woolrich,et al.  Guiding functional connectivity estimation by structural connectivity in MEG: an application to discrimination of conditions of mild cognitive impairment , 2014, NeuroImage.

[4]  Magda Tsolaki,et al.  Automated Hippocampal Subfield Measures as Predictors of Conversion from Mild Cognitive Impairment to Alzheimer’s Disease in Two Independent Cohorts , 2013, Brain Topography.

[5]  Carlos Platero,et al.  A label fusion method using conditional random fields with higher-order potentials: Application to hippocampal segmentation , 2015, Artif. Intell. Medicine.

[6]  Konstantinos G. Derpanis,et al.  Three-dimensional nth derivative of Gaussian separable steerable filters , 2005, IEEE International Conference on Image Processing 2005.

[7]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[8]  D. Louis Collins,et al.  Training labels for hippocampal segmentation based on the EADC-ADNI harmonized hippocampal protocol , 2015, Alzheimer's & Dementia.

[9]  Nick C Fox,et al.  The clinical use of structural MRI in Alzheimer disease , 2010, Nature Reviews Neurology.

[10]  D. Louis Collins,et al.  Towards accurate, automatic segmentation of the hippocampus and amygdala from MRI by augmenting ANIMAL with a template library and label fusion , 2010, NeuroImage.

[11]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[12]  Torsten Rohlfing,et al.  Quo Vadis, Atlas-Based Segmentation? , 2005 .

[13]  Colin Studholme,et al.  A Supervised Patch-Based Approach for Human Brain Labeling , 2011, IEEE Transactions on Medical Imaging.

[14]  Sunil Arya,et al.  ANN: library for approximate nearest neighbor searching , 1998 .

[15]  Arati Dandavate,et al.  Semantic Texton Forests for Image Categorization and Segmentation , 2018, IJARCCE.

[16]  Jens C. Pruessner,et al.  Survey of protocols for the manual segmentation of the hippocampus: preparatory steps towards a joint EADC-ADNI harmonized protocol. , 2011, Journal of Alzheimer's disease : JAD.

[17]  Koenraad Van Leemput,et al.  A computational atlas of the hippocampal formation using ex vivo, ultra-high resolution MRI: Application to adaptive segmentation of in vivo MRI , 2015, NeuroImage.

[18]  D. Louis Collins,et al.  Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation , 2011, NeuroImage.

[19]  P. Scheltens,et al.  Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS–ADRDA criteria , 2007, The Lancet Neurology.

[20]  W. Eric L. Grimson,et al.  Logarithm Odds Maps for Shape Representation , 2006, MICCAI.

[21]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[22]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[23]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[24]  D. Louis Collins,et al.  Optimized PatchMatch for Near Real Time and Accurate Label Fusion , 2014, MICCAI.

[25]  Bennett A Landman,et al.  Non-local statistical label fusion for multi-atlas segmentation , 2013, Medical Image Anal..

[26]  Arthur W. Toga,et al.  Defining the human hippocampus in cerebral magnetic resonance images—An overview of current segmentation protocols , 2009, NeuroImage.

[27]  Daniel Rueckert,et al.  Segmentation of MR images via discriminative dictionary learning and sparse coding: Application to hippocampus labeling , 2013, NeuroImage.

[28]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[29]  Liana G. Apostolova,et al.  Delphi definition of the EADC-ADNI Harmonized Protocol for hippocampal segmentation on magnetic resonance , 2015, Alzheimer's & Dementia.

[30]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[32]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[33]  Stephen M. Smith,et al.  Enhanced brain extraction improves the accuracy of brain atrophy estimation , 2008, NeuroImage.

[34]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[35]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[36]  Mert R. Sabuncu,et al.  A Generative Model for Image Segmentation Based on Label Fusion , 2010, IEEE Transactions on Medical Imaging.

[37]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[38]  S. Tangaro,et al.  Automated voxel-by-voxel tissue classification for hippocampal segmentation: methods and validation. , 2014, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[39]  Marisa O. Hollinshead,et al.  Identification of common variants associated with human hippocampal and intracranial volumes , 2012, Nature Genetics.

[40]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Abraham Z. Snyder,et al.  A unified approach for morphometric and functional data analysis in young, old, and demented adults using automated atlas-based head size normalization: reliability and validation against manual measurement of total intracranial volume , 2004, NeuroImage.

[42]  Yaozong Gao,et al.  Integration of sparse multi-modality representation and anatomical constraint for isointense infant brain MR image segmentation , 2014, NeuroImage.

[43]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[44]  S. Aurtenetxe,et al.  White Matter Damage Disorganizes Brain Functional Networks in Amnestic Mild Cognitive Impairment , 2014, Brain Connect..

[45]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[46]  Brian B. Avants,et al.  Integrated Graph Cuts for Brain MRI Segmentation , 2006, MICCAI.

[47]  Daniel Rueckert,et al.  Measurements of medial temporal lobe atrophy for prediction of Alzheimer's disease in subjects with mild cognitive impairment , 2013, Neurobiology of Aging.

[48]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[49]  Norbert Schuff,et al.  Automated cross-sectional and longitudinal hippocampal volume measurement in mild cognitive impairment and Alzheimer's disease , 2010, NeuroImage.

[50]  Charles DeCarli,et al.  ACCURACY OF BMAS HIPPOCAMPUS SEGMENTATION USING THE HARMONIZED HIPPOCAMPAL PROTOCOL , 2014, Alzheimer's & Dementia.

[51]  Daoqiang Zhang,et al.  A generative probability model of joint label fusion for multi-atlas based brain segmentation , 2014, Medical Image Anal..

[52]  Marie Chupin,et al.  Automatic classi fi cation of patients with Alzheimer ' s disease from structural MRI : A comparison of ten methods using the ADNI database , 2010 .

[53]  Pierrick Coupé,et al.  An Optimized Blockwise Nonlocal Means Denoising Filter for 3-D Magnetic Resonance Images , 2008, IEEE Transactions on Medical Imaging.

[54]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[55]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[56]  D. Louis Collins,et al.  Brain templates and atlases , 2012, NeuroImage.

[57]  D. Louis Collins,et al.  The EADC-ADNI Harmonized Protocol for manual hippocampal segmentation on magnetic resonance: Evidence of validity , 2015, Alzheimer's & Dementia.

[58]  C. Jack,et al.  Comparison of different MRI brain atrophy rate measures with clinical disease progression in AD , 2004, Neurology.

[59]  Josien P. W. Pluim,et al.  Evaluation of Optimization Methods for Nonrigid Medical Image Registration Using Mutual Information and B-Splines , 2007, IEEE Transactions on Image Processing.

[60]  D. Louis Collins,et al.  An Optimized PatchMatch for multi-scale and multi-feature label fusion , 2016, NeuroImage.

[61]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[62]  Sandra E. Black,et al.  A direct morphometric comparison of five labeling protocols for multi-atlas driven automatic segmentation of the hippocampus in Alzheimer's disease , 2013, NeuroImage.