Robust 3D Convolutional Neural Network With Boundary Correction for Accurate Brain Tissue Segmentation

The morphology, symmetry, and volume of brain tissue are good indicators for measuring the central nervous system disease progression. The objective of this paper is to segment cerebrospinal fluid (CSF), gray matter (GM), and white matter (WM) automatically with multi-modality magnetic resonance scans. A novel coarse-to-fine method is proposed to segment CSF, GM, and WM using two cascade 3D convolutional neural networks. The first densely connected fully convolutional network (DC-FCN) is designed with feature reuse, which can take full advantage of the spatial information and alleviate computer memory limitation. The second 6-CNN is designed to correct boundary voxel, which can further reduce computational cost while improving the segmentation accuracy. As of today, our method ranks the 3rd on the MRBrainS13 challenge, outperforming most of the participant methods when using available input modalities (T1, T1-IR, and T2-FLAIR). In addition, we also verify the proposed framework on the IBSR dataset, which demonstrates the effectiveness of the boundary correction strategy. Through accurate segmentation of brain tissue, neuroimaging physicians can be assisted in assessing disease progression and even localizing lesions.

[1]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[2]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[3]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Lakhdar Sais,et al.  Fuzzy generalized fast marching method for 3D segmentation of brain structures , 2017, Int. J. Imaging Syst. Technol..

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  Mohammad Reza Daliri,et al.  Automated Diagnosis of Alzheimer Disease using the Scale-Invariant Feature Transforms in Magnetic Resonance Images , 2012, Journal of Medical Systems.

[8]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[9]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[10]  Yaozong Gao,et al.  LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images , 2015, NeuroImage.

[11]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Paul A. Yushkevich,et al.  Multi-atlas segmentation with joint label fusion and corrective learning—an open source implementation , 2013, Front. Neuroinform..

[13]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Colin Studholme,et al.  A Supervised Patch-Based Approach for Human Brain Labeling , 2011, IEEE Transactions on Medical Imaging.

[16]  Mohammad Reza Daliri,et al.  Brain MR Image Segmentation Methods and Applications , 2014 .

[17]  Peter A. Calabresi,et al.  A topology-preserving approach to the segmentation of brain images with multiple sclerosis lesions , 2010, NeuroImage.

[18]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[19]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[20]  Andrea Ciarmiello,et al.  Brain white-matter volume loss and glucose hypometabolism precede the clinical symptoms of Huntington's disease. , 2006, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[21]  Albert C. S. Chung,et al.  Multi-scale structured CNN with label consistency for brain MR image segmentation , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[22]  Hong-xin Zhang,et al.  Research on SVM-based MRI image segmentation , 2011 .

[23]  Neda Bernasconi,et al.  Multimodal MRI profiling of focal cortical dysplasia type II , 2017, Neurology.

[24]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[25]  Min Zhang,et al.  A prior feature SVM-MRF based method for mouse brain segmentation , 2012, NeuroImage.

[26]  M. Helfroush,et al.  Variational level set combined with Markov random field modeling for simultaneous intensity non-uniformity correction and segmentation of MR images , 2012, Journal of Neuroscience Methods.

[27]  Mohammad Reza Daliri,et al.  Software Tools for the Analysis of Functional Magnetic Resonance Imaging , 2012 .

[28]  Arnau Oliver,et al.  A review on brain structures segmentation in magnetic resonance imaging , 2016, Artif. Intell. Medicine.

[29]  Shiri Gordon,et al.  Atlas of Classifiers for Brain MRI Segmentation , 2017, MLMI@MICCAI.

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[31]  Thomas Brox,et al.  Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Amir Alansary,et al.  MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans , 2015, Comput. Intell. Neurosci..

[33]  Rachel M. Brouwer,et al.  Can structural MRI aid in clinical classification? A machine learning study in two independent samples of patients with schizophrenia, bipolar disorder and healthy subjects , 2014, NeuroImage.

[34]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[35]  J. A. Noble,et al.  Investigation of the Role of Feature Selection and Weighted Voting in Random Forests for 3-D Volumetric Segmentation , 2014, IEEE Transactions on Medical Imaging.

[36]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[37]  R. Rudick,et al.  Gray matter atrophy in multiple sclerosis: A longitudinal study , 2008, Annals of neurology.

[38]  Wen-June Wang,et al.  Multispectral MR images segmentation based on fuzzy knowledge and modified seeded region growing. , 2012, Magnetic resonance imaging.

[39]  Max A. Viergever,et al.  Automatic segmentation of MR brain images of preterm infants using supervised classification , 2015, NeuroImage.

[40]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[42]  Hao Chen,et al.  VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images , 2017, NeuroImage.

[43]  Stefan Carlsson,et al.  Multispectral MRI segmentation of age related white matter changes using a cascade of support vector machines , 2012, Journal of the Neurological Sciences.

[44]  D. Kennedy,et al.  The young adult human brain: an MRI-based morphometric analysis. , 1994, Cerebral cortex.

[45]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[46]  Ivo D Dinov,et al.  Brain MRI tissue classification based on local Markov random fields. , 2010, Magnetic resonance imaging.

[47]  Reza Azmi,et al.  Brain tissue segmentation in MR images based on a hybrid of MRF and social algorithms , 2012, Medical Image Anal..

[48]  Meritxell Bach Cuadra,et al.  A review of atlas-based segmentation for magnetic resonance brain images , 2011, Comput. Methods Programs Biomed..

[49]  Yaozong Gao,et al.  Fully convolutional networks for multi-modality isointense infant brain image segmentation , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[50]  Carlos Alberto Silva,et al.  Automatic brain tissue segmentation in MR images using Random Forests and Conditional Random Fields , 2016, Journal of Neuroscience Methods.

[51]  Snehashis Roy,et al.  Consistent segmentation using a Rician classifier , 2012, Medical Image Anal..

[52]  Hong Yan,et al.  Current Methods in the Automatic Tissue Segmentation of 3D Magnetic Resonance Brain Images , 2006 .

[53]  Daniel Rueckert,et al.  A Probabilistic Patch-Based Label Fusion Model for Multi-Atlas Segmentation With Registration Refinement: Application to Cardiac MR Images , 2013, IEEE Transactions on Medical Imaging.

[54]  H. Boyaci,et al.  Statistical Analysis Methods for the fMRI Data , 2011 .