Deep MRI brain extraction: A 3D convolutional neural network for skull stripping

Brain extraction from magnetic resonance imaging (MRI) is crucial for many neuroimaging workflows. Current methods demonstrate good results on non-enhanced T1-weighted images, but struggle when confronted with other modalities and pathologically altered tissue. In this paper we present a 3D convolutional deep learning architecture to address these shortcomings. In contrast to existing methods, we are not limited to non-enhanced T1w images. When trained appropriately, our approach handles an arbitrary number of modalities including contrast-enhanced scans. Its applicability to MRI data, comprising four channels: non-enhanced and contrast-enhanced T1w, T2w and FLAIR contrasts, is demonstrated on a challenging clinical data set containing brain tumors (N=53), where our approach significantly outperforms six commonly used tools with a mean Dice score of 95.19. Further, the proposed method at least matches state-of-the-art performance as demonstrated on three publicly available data sets: IBSR, LPBA40 and OASIS, totaling N=135 volumes. For the IBSR (96.32) and LPBA40 (96.96) data set the convolutional neuronal network (CNN) obtains the highest average Dice scores, albeit not being significantly different from the second best performing method. For the OASIS data the second best Dice (95.02) results are achieved, with no statistical difference in comparison to the best performing tool. For all data sets the highest average specificity measures are evaluated, whereas the sensitivity displays about average results. Adjusting the cut-off threshold for generating the binary masks from the CNN's probability output can be used to increase the sensitivity of the method. Of course, this comes at the cost of a decreased specificity and has to be decided application specific. Using an optimized GPU implementation predictions can be achieved in less than one minute. The proposed method may prove useful for large-scale studies and clinical trials.

[1]  Jürgen Schmidhuber,et al.  A fast learning algorithm for image segmentation with max-pooling convolutional networks , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Alan C. Evans,et al.  Automated 3-D Extraction of Inner and Outer Surfaces of Cerebral Cortex from MRI , 2000, NeuroImage.

[3]  Fred A. Hamprecht,et al.  Multi-modal Brain Tumor Segmentation using Deep Convolutional Neural Networks , 2014 .

[4]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[5]  Dinggang Shen,et al.  Knowledge-Guided Robust MRI Brain Extraction for Diverse Large-Scale Neuroimaging Studies on Humans and Non-Human Primates , 2014, PloS one.

[6]  Razvan Pascanu,et al.  Theano: new features and speed improvements , 2012, ArXiv.

[7]  Satrajit S. Ghosh,et al.  Evaluation of volume-based and surface-based brain image registration methods , 2010, NeuroImage.

[8]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[9]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[10]  Gregory G. Brown,et al.  Quantitative evaluation of automated skull‐stripping methods applied to contemporary and legacy images: Effects of diagnosis, bias correction, and slice location , 2006, Human brain mapping.

[11]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[12]  D. Selkoe Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[13]  R. Leahy,et al.  Magnetic Resonance Image Tissue Classification Using a Partial Volume Model , 2001, NeuroImage.

[14]  Jerry L. Prince,et al.  Cortical reconstruction using implicit surface evolution: Accuracy and precision analysis , 2006, NeuroImage.

[15]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[16]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[17]  D. Louis Collins,et al.  Symmetric Atlasing and Model Based Segmentation: An Application to the Hippocampus in Older Adults , 2006, MICCAI.

[18]  Ulla Ruotsalainen,et al.  Automatic cerebral and cerebellar hemisphere segmentation in 3D MRI: Adaptive disconnection algorithm , 2010, Medical Image Anal..

[19]  Vince D. Calhoun,et al.  Deep learning for neuroimaging: a validation study , 2013, Front. Neurosci..

[20]  William M. Wells,et al.  Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation , 2004, IEEE Transactions on Medical Imaging.

[21]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[22]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[23]  Paul M. Thompson,et al.  Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods , 2011, IEEE Transactions on Medical Imaging.

[24]  Ullrich Köthe,et al.  Ilastik: Interactive learning and segmentation toolkit , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[25]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[26]  Wiro J. Niessen,et al.  Accuracy and reproducibility study of automatic MRI brain tissue segmentation methods , 2010, NeuroImage.

[27]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[28]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[29]  Li Wang,et al.  Level set segmentation of brain magnetic resonance images based on local Gaussian distribution fitting energy , 2010, Journal of Neuroscience Methods.

[30]  R. Woods,et al.  Cortical change in Alzheimer's disease detected with a disease-specific population-based brain atlas. , 2001, Cerebral cortex.

[31]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[33]  D. Louis Collins,et al.  BEaST: Brain extraction based on nonlocal segmentation technique , 2012, NeuroImage.

[34]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[35]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[36]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[37]  A. M. Dale,et al.  A hybrid approach to the skull stripping problem in MRI , 2004, NeuroImage.

[38]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .

[39]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[40]  Zhuowen Tu,et al.  Robust Skull Stripping of Clinical Glioblastoma Multiforme Data , 2011, MICCAI.

[41]  John G. Csernansky,et al.  Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults , 2007, Journal of Cognitive Neuroscience.

[42]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[43]  J. Whitwell,et al.  Alzheimer's disease neuroimaging , 2018, Current opinion in neurology.

[44]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[45]  Arthur W. Toga,et al.  Online resource for validation of brain segmentation methods , 2009, NeuroImage.

[46]  Claudio A. Perez,et al.  An accurate skull stripping method based on simplex meshes and histogram analysis for magnetic resonance images , 2012, Journal of Neuroscience Methods.

[47]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[48]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[49]  Arthur W. Toga,et al.  A meta-algorithm for brain extraction in MRI , 2004, NeuroImage.