Combining patch-based strategies and non-rigid registration-based label fusion methods

The objective of this study is to develop a patch-based labeling method that cooperates with a label fusion using non-rigid registrations. We present a novel patch-based label fusion method, whose selected patches and their weights are calculated from a combination of similarity measures between patches using intensity-based distances and labeling-based distances, where a previous labeling of the target image is inferred through a label fusion method using non-rigid registrations. These combined similarity measures result in better selection of the patches, and their weights are more robust, which improves the segmentation results compared to other label fusion methods, including the conventional patch-based labeling method. To evaluate the performance and the robustness of the proposed label fusion method, we employ two available databases of T1-weighted (T1W) magnetic resonance imaging (MRI) of human brains. We compare our approach with other label fusion methods in the automatic hippocampal segmentation from T1W-MRI. Our label fusion method yields mean Dice coefficients of 0.847 and 0.798 for the two databases used with mean times of approximately 180 and 320 seconds, respectively. The collaboration between the patch-based labeling method and the label fusion using non-rigid registrations is given in the several levels: (a) The pre-selection of the patches in the atlases are improved, (b) The weights of our selected patches are also more robust, (c) our approach imposes geometrical restrictions, such as shape priors, and (d) the work-flow is very efficient. We show that the proposed approach is very competitive with respect to recently reported methods.

[1]  Carlos Ortiz-de-Solorzano,et al.  Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data , 2009, IEEE Transactions on Medical Imaging.

[2]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[3]  Carlos Platero,et al.  A label fusion method using conditional random fields with higher-order potentials: Application to hippocampal segmentation , 2015, Artif. Intell. Medicine.

[4]  Konstantinos G. Derpanis,et al.  Three-dimensional nth derivative of Gaussian separable steerable filters , 2005, IEEE International Conference on Image Processing 2005.

[5]  Daoqiang Zhang,et al.  A generative probability model of joint label fusion for multi-atlas based brain segmentation , 2014, Medical Image Anal..

[6]  Mert R. Sabuncu,et al.  A Generative Model for Image Segmentation Based on Label Fusion , 2010, IEEE Transactions on Medical Imaging.

[7]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[8]  Brian B. Avants,et al.  Integrated Graph Cuts for Brain MRI Segmentation , 2006, MICCAI.

[9]  Norbert Schuff,et al.  Automated cross-sectional and longitudinal hippocampal volume measurement in mild cognitive impairment and Alzheimer's disease , 2010, NeuroImage.

[10]  J. Barnes,et al.  A comparison of methods for the automated calculation of volumes and atrophy rates in the hippocampus , 2008, NeuroImage.

[11]  Daniel Rueckert,et al.  Automatic anatomical brain MRI segmentation combining label propagation and decision fusion , 2006, NeuroImage.

[12]  Bennett A Landman,et al.  Non-local statistical label fusion for multi-atlas segmentation , 2013, Medical Image Anal..

[13]  Max A. Viergever,et al.  Adaptive local multi-atlas segmentation: Application to the heart and the caudate nucleus , 2010, Medical Image Anal..

[14]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[15]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[16]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[17]  Pierrick Coupé,et al.  An Optimized Blockwise Nonlocal Means Denoising Filter for 3-D Magnetic Resonance Images , 2008, IEEE Transactions on Medical Imaging.

[18]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[19]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[20]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[21]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[22]  W. Eric L. Grimson,et al.  Logarithm Odds Maps for Shape Representation , 2006, MICCAI.

[23]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[24]  Stefan Klein,et al.  Automatic segmentation of the prostate in 3D MR images by atlas matching using localized mutual information. , 2008, Medical physics.

[25]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[26]  Torsten Rohlfing,et al.  Quo Vadis, Atlas-Based Segmentation? , 2005 .

[27]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[28]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[30]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[31]  Sandra E. Black,et al.  A direct morphometric comparison of five labeling protocols for multi-atlas driven automatic segmentation of the hippocampus in Alzheimer's disease , 2013, NeuroImage.

[32]  Daniel Rueckert,et al.  Measurements of medial temporal lobe atrophy for prediction of Alzheimer's disease in subjects with mild cognitive impairment , 2013, Neurobiology of Aging.

[33]  Xiao Han,et al.  Atlas Renormalization for Improved Brain MR Image Segmentation Across Scanner Platforms , 2007, IEEE Transactions on Medical Imaging.

[34]  Jyrki Lötjönen,et al.  Multi-class brain segmentation using atlas propagation and EM-based refinement , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[35]  D. Louis Collins,et al.  The EADC-ADNI Harmonized Protocol for manual hippocampal segmentation on magnetic resonance: Evidence of validity , 2015, Alzheimer's & Dementia.

[36]  Wiro J. Niessen,et al.  Hippocampus segmentation in MR images using atlas registration, voxel classification, and graph cuts , 2008, NeuroImage.

[37]  Josien P. W. Pluim,et al.  Evaluation of Optimization Methods for Nonrigid Medical Image Registration Using Mutual Information and B-Splines , 2007, IEEE Transactions on Image Processing.

[38]  Dinggang Shen,et al.  Construction of multi-region-multi-reference atlases for neonatal brain MRI segmentation , 2010, NeuroImage.

[39]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[40]  Arthur W. Toga,et al.  Fusing adaptive atlas and informative features for robust 3D brain image segmentation , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[41]  Hamid Soltanian-Zadeh,et al.  Dataset of Magnetic Resonance Images of Nonepileptic Subjects and Temporal Lobe Epilepsy Patients for Validation of Hippocampal Segmentation Techniques , 2011, Neuroinformatics.

[42]  Juha Koikkalainen,et al.  Fast and robust multi-atlas segmentation of brain magnetic resonance images , 2010, NeuroImage.

[43]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[44]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[45]  D. Louis Collins,et al.  Towards accurate, automatic segmentation of the hippocampus and amygdala from MRI by augmenting ANIMAL with a template library and label fusion , 2010, NeuroImage.

[46]  Roberto Cipolla,et al.  Semantic texton forests for image categorization and segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Daniel Rueckert,et al.  An evaluation of four automatic methods of segmenting the subcortical structures in the brain , 2009, NeuroImage.

[48]  Jyrki Lötjönen,et al.  Measurement of hippocampal atrophy using 4D graph-cut segmentation: Application to ADNI , 2010, NeuroImage.

[49]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Colin Studholme,et al.  A Supervised Patch-Based Approach for Human Brain Labeling , 2011, IEEE Transactions on Medical Imaging.

[51]  Sunil Arya,et al.  ANN: library for approximate nearest neighbor searching , 1998 .

[52]  Stephen M. Smith,et al.  Enhanced brain extraction improves the accuracy of brain atrophy estimation , 2008, NeuroImage.

[53]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[54]  Carlos Platero,et al.  A Multiatlas Segmentation Using Graph Cuts with Applications to Liver Segmentation in CT Scans , 2014, Comput. Math. Methods Medicine.

[55]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[56]  Daniel Rueckert,et al.  Segmentation of MR images via discriminative dictionary learning and sparse coding: Application to hippocampus labeling , 2013, NeuroImage.

[57]  Paul M. Thompson,et al.  Brain Anatomical Structure Segmentation by Hybrid Discriminative/Generative Models , 2008, IEEE Transactions on Medical Imaging.

[58]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[59]  D. Louis Collins,et al.  Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation , 2011, NeuroImage.