Automated brain extraction of multisequence MRI using artificial neural networks

Brain extraction is a critical preprocessing step in the analysis of neuroimaging studies conducted with magnetic resonance imaging (MRI) and influences the accuracy of downstream analyses. The majority of brain extraction algorithms are, however, optimized for processing healthy brains and thus frequently fail in the presence of pathologically altered brain or when applied to heterogeneous MRI datasets. Here we introduce a new, rigorously validated algorithm (termed HD-BET) relying on artificial neural networks that aim to overcome these limitations. We demonstrate that HD-BET outperforms six popular, publicly available brain extraction algorithms in several large-scale neuroimaging datasets, including one from a prospective multicentric trial in neuro-oncology, yielding state-of-the-art performance with median improvements of +1.16 to +2.50 points for the Dice coefficient and -0.66 to -2.51 mm for the Hausdorff distance. Importantly, the HD-BET algorithm, which shows robust performance in the presence of pathology or treatment-induced tissue alterations, is applicable to a broad range of MRI sequence types and is not influenced by variations in MRI hardware and acquisition parameters encountered in both research and clinical practice. For broader accessibility, the HD-BET prediction algorithm is made freely available (www.neuroAI-HD.org) and may become an essential component for robust, automated, high-throughput processing of MRI neuroimaging data.

[1]  Peter König,et al.  Data augmentation instead of explicit regularization , 2018, ArXiv.

[2]  Heinz-Otto Peitgen,et al.  The Skull Stripping Problem in MRI Solved by a Single 3D Watershed Transform , 2000, MICCAI.

[3]  H. Prosper.  Bayesian Analysis , 2000, hep-ph/0006356.

[4]  Jian Chen,et al.  Brain extraction using the watershed transform from markers , 2013, Front. Neuroinform..

[5]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[6]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[7]  Fang Liu,et al.  Bayesian convolutional neural network based MRI brain extraction on nonhuman primates , 2018, NeuroImage.

[8]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[9]  Patrick van der Smagt,et al.  CNN-based Segmentation of Medical Imaging Data , 2017, ArXiv.

[10]  Guido Gerig,et al.  Elastic model-based segmentation of 3-D neuroradiological data sets , 1999, IEEE Transactions on Medical Imaging.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[13]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[14]  Klaus H. Maier-Hein,et al.  Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge , 2017, BrainLes@MICCAI.

[15]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[16]  P. Kalavathi,et al.  Methods on Skull Stripping of MRI Head Scan Images—a Review , 2016, Journal of Digital Imaging.

[17]  Paul M. Thompson,et al.  Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods , 2011, IEEE Transactions on Medical Imaging.

[18]  Richard M. Leahy,et al.  BrainSuite: An Automated Cortical Surface Identification Tool , 2000, MICCAI.

[19]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[20]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[21]  W. A. Hanson,et al.  Interactive 3D segmentation of MRI and CT volumes using morphological operations. , 1992, Journal of computer assisted tomography.

[22]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[23]  Richard Frayne,et al.  An open, multi-vendor, multi-field-strength brain MR dataset and analysis of publicly available skull stripping methods agreement , 2017, NeuroImage.

[24]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[25]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[26]  D. Louis Collins,et al.  BEaST: Brain extraction based on nonlocal segmentation technique , 2012, NeuroImage.

[27]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.