Convolutional Neural Net Learning Can Achieve Production-Level Brain Segmentation in Structural Magnetic Resonance Imaging

Deep learning implementations using convolutional neural nets have recently demonstrated promise in many areas of medical imaging. In this article we lay out the methods by which we have achieved consistently high quality, high throughput computation of intra-cranial segmentation from whole head magnetic resonance images, an essential but typically time-consuming bottleneck for brain image analysis. We refer to this output as “production-level” because it is suitable for routine use in processing pipelines. Training and testing with an extremely large archive of structural images, our segmentation algorithm performs uniformly well over a wide variety of separate national imaging cohorts, giving Dice metric scores exceeding those of other recent deep learning brain extractions. We describe the components involved to achieve this performance, including size, variety and quality of ground truth, and appropriate neural net architecture. We demonstrate the crucial role of appropriately large and varied datasets, suggesting a less prominent role for algorithm development beyond a threshold of capability.

[1]  Alexander Knaack,et al.  APPLICATIONS OF DEEP LEARNING TO BRAIN SEGMENTATION AND LABELING OF MRI BRAIN STRUCTURES , 2020 .

[2]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[3]  D. Harvey,et al.  Measures of brain morphology and infarction in the framingham heart study: establishing what is normal , 2005, Neurobiology of Aging.

[4]  Evan Fletcher,et al.  Early Brain Loss in Circuits Affected by Alzheimer’s Disease is Predicted by Fornix Microstructure but may be Independent of Gray Matter , 2014, Front. Aging Neurosci..

[5]  Nico Karssemeijer,et al.  Deep multi-scale location-aware 3D convolutional neural networks for automated detection of lacunes of presumed vascular origin , 2016, NeuroImage: Clinical.

[6]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[7]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[8]  D. Harvey,et al.  Brain Volume Change and Cognitive Trajectories in Aging , 2018, Neuropsychology.

[9]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[10]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[11]  C. Rowe,et al.  Amyloid β deposition, neurodegeneration, and cognitive decline in sporadic Alzheimer's disease: a prospective cohort study , 2013, The Lancet Neurology.

[12]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[13]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[14]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[15]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[16]  Arthur W. Toga,et al.  Online resource for validation of brain segmentation methods , 2009, NeuroImage.

[17]  Leo Joskowicz,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2016 , 2016, Lecture Notes in Computer Science.

[18]  Chen Sun,et al.  Revisiting Unreasonable Effectiveness of Data in Deep Learning Era , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Sébastien Ourselin,et al.  Brain MAPS: An automated, accurate and robust brain extraction technique using a template library , 2011, NeuroImage.

[20]  Paul M. Thompson,et al.  Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods , 2011, IEEE Transactions on Medical Imaging.

[21]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[22]  Daniel P. Huttenlocher,et al.  Comparing images using the Hausdorff distance under translation , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Charles DeCarli,et al.  Maximal brain size remains an important predictor of cognition in old age, independent of current brain pathology , 2012, Neurobiology of Aging.

[24]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[25]  Deniz Erdogmus,et al.  Auto-Context Convolutional Neural Network (Auto-Net) for Brain Extraction in Magnetic Resonance Imaging , 2017, IEEE Transactions on Medical Imaging.

[26]  Hai Su,et al.  Recent Advances in the Applications of Convolutional Neural Networks to Medical Image Contour Detection , 2017, ArXiv.

[27]  M. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network. , 2016, IEEE transactions on medical imaging.

[28]  D. Harvey,et al.  Association of vascular brain injury, neurodegeneration, amyloid, and cognitive trajectory , 2020, Neurology.

[29]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[30]  Evan Fletcher,et al.  Effects of systolic blood pressure on white-matter integrity in young adults in the Framingham Heart Study: a cross-sectional study , 2012, The Lancet Neurology.

[31]  John G. Csernansky,et al.  Open Access Series of Imaging Studies: Longitudinal MRI Data in Nondemented and Demented Older Adults , 2010, Journal of Cognitive Neuroscience.

[32]  Elena Marchiori,et al.  Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities , 2016, Scientific Reports.

[33]  D. Louis Collins,et al.  BEaST: Brain extraction based on nonlocal segmentation technique , 2012, NeuroImage.

[34]  C. Jack,et al.  Selective worsening of brain injury biomarker abnormalities in cognitively normal elderly persons with β-amyloidosis. , 2013, JAMA neurology.

[35]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[36]  Christos Davatzikos,et al.  Harmonization of large MRI datasets for the analysis of brain imaging patterns throughout the lifespan , 2019, NeuroImage.

[37]  C. Jack,et al.  Tracking pathophysiological processes in Alzheimer's disease: an updated hypothetical model of dynamic biomarkers , 2013, The Lancet Neurology.

[38]  David J. Kriegman,et al.  Dense Volume-to-Volume Vascular Boundary Detection , 2016, MICCAI.