QuickNAT: A fully convolutional network for quick and accurate segmentation of neuroanatomy

&NA; Whole brain segmentation from structural magnetic resonance imaging (MRI) is a prerequisite for most morphological analyses, but is computationally intense and can therefore delay the availability of image markers after scan acquisition. We introduce QuickNAT, a fully convolutional, densely connected neural network that segments a MRI brain scan in 20 s. To enable training of the complex network with millions of learnable parameters using limited annotated data, we propose to first pre‐train on auxiliary labels created from existing segmentation software. Subsequently, the pre‐trained model is fine‐tuned on manual labels to rectify errors in auxiliary labels. With this learning strategy, we are able to use large neuroimaging repositories without manual annotations for training. In an extensive set of evaluations on eight datasets that cover a wide age range, pathology, and different scanners, we demonstrate that QuickNAT achieves superior segmentation accuracy and reliability in comparison to state‐of‐the‐art methods, while being orders of magnitude faster. The speed up facilitates processing of large data repositories and supports translation of imaging biomarkers by making them available within seconds for fast clinical decision making.

[1]  Deanna Greenstein,et al.  Prenatal growth in humans and postnatal brain maturation into late adolescence , 2012, Proceedings of the National Academy of Sciences.

[2]  Jessica A. Turner,et al.  MultiCenter Reliability of Diffusion Tensor Imaging , 2012, Brain Connect..

[3]  Paul A. Yushkevich,et al.  Multi-atlas segmentation with joint label fusion and corrective learning—an open source implementation , 2013, Front. Neuroinform..

[4]  T. Bartsch,et al.  The hippocampus in aging and disease: From plasticity to vulnerability , 2015, Neuroscience.

[5]  Nassir Navab,et al.  Inherent Brain Segmentation Quality Control from Fully ConvNet Monte Carlo Sampling , 2018, MICCAI.

[6]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[7]  Nassir Navab,et al.  Error Corrective Boosting for Learning Fully Convolutional Networks with Limited Data , 2017, MICCAI.

[8]  Alan C. Evans,et al.  Intellectual ability and cortical development in children and adolescents , 2006, Nature.

[9]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[10]  Alan C. Evans,et al.  Brain development during childhood and adolescence: a longitudinal MRI study , 1999, Nature Neuroscience.

[11]  Bennett A. Landman,et al.  Formulating Spatially Varying Performance in the Statistical Fusion Framework , 2012, IEEE Transactions on Medical Imaging.

[12]  Bogdan Draganski,et al.  Neuroplasticity: Changes in grey matter induced by training , 2004, Nature.

[13]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[14]  Hao Chen,et al.  VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images , 2017, NeuroImage.

[15]  Christian Wachinger,et al.  DeepNAT: Deep convolutional neural network for segmenting neuroanatomy , 2017, NeuroImage.

[16]  S. Vos,et al.  Reliability of brain volume measurements: A test-retest dataset , 2014, Scientific Data.

[17]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  D. Selkoe Alzheimer's disease. , 2011, Cold Spring Harbor perspectives in biology.

[20]  Stephen M. Smith,et al.  A Bayesian model of shape and appearance for subcortical brain segmentation , 2011, NeuroImage.

[21]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[22]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Torsten Rohlfing,et al.  Quo Vadis, Atlas-Based Segmentation? , 2005 .

[24]  C. Jack,et al.  Tracking pathophysiological processes in Alzheimer's disease: an updated hypothetical model of dynamic biomarkers , 2013, The Lancet Neurology.

[25]  Vince D. Calhoun,et al.  Almost instant brain atlas segmentation for large-scale studies , 2017, ArXiv.

[26]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[27]  Karol Miller,et al.  Medical Image Computing and Computer Assisted Intervention Conference (MICCAI 2006) , 2006 .

[28]  Olaf B. Paulson,et al.  MR-based automatic delineation of volumes of interest in human brain PET images using probability maps , 2005, NeuroImage.

[29]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[30]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[31]  Alex Rovira,et al.  Improving automated multiple sclerosis lesion segmentation with a cascaded 3D convolutional neural network approach , 2017, NeuroImage.

[32]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[34]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[35]  A. Dale,et al.  Whole Brain Segmentation Automated Labeling of Neuroanatomical Structures in the Human Brain , 2002, Neuron.

[36]  H. Fukuda,et al.  Segmentation of the hippocampus by transferring algorithmic knowledge for large cohort processing , 2018, Medical Image Anal..

[37]  Elena Marchiori,et al.  Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities , 2016, Scientific Reports.

[38]  D. Louis Collins,et al.  Training labels for hippocampal segmentation based on the EADC-ADNI harmonized hippocampal protocol , 2015, Alzheimer's & Dementia.

[39]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[40]  John G. Csernansky,et al.  Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults , 2007, Journal of Cognitive Neuroscience.

[41]  Steven C. R. Williams,et al.  A comprehensive testing protocol for MRI neuroanatomical segmentation techniques: Evaluation of a novel lateral ventricle segmentation method , 2011, NeuroImage.

[42]  D. Salat,et al.  Whole-brain analysis reveals increased neuroanatomical asymmetries in dementia for hippocampus and amygdala. , 2016, Brain : a journal of neurology.

[43]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[44]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[45]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[47]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[48]  T. Paus,et al.  Studying neuroanatomy using MRI , 2017, Nature Neuroscience.

[49]  David N. Kennedy,et al.  CANDIShare: A Resource for Pediatric Neuroimaging Data , 2011, Neuroinformatics.

[50]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[51]  Jose Dolz,et al.  3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study , 2016, NeuroImage.

[52]  E. Bullmore,et al.  Imaging structural co-variance between human brain regions , 2013, Nature Reviews Neuroscience.