Image Based Brain Segmentation: From Multi-Atlas Fusion to Deep Learning.

BACKGROUND This review aims to identify the development of the algorithms for brain tissue and structure segmentation in MRI images. DISCUSSION Starting from the results of the Grand Challenges on brain tissue and structure segmentation held in Medical Image Computing and Computer-Assisted Intervention (MICCAI), this review analyses the development of the algorithms and discusses the tendency from multi-atlas label fusion to deep learning. The intrinsic characteristics of the winners' algorithms on the Grand Challenges from the year 2012 to 2018 are analyzed and the results are compared carefully. CONCLUSION Although deep learning has got higher rankings in the challenge, it has not yet met the expectations in terms of accuracy. More effective and specialized work should be done in the future.

[1]  Wilfried Philips,et al.  MRI Segmentation of the Human Brain: Challenges, Methods, and Applications , 2015, Comput. Math. Methods Medicine.

[2]  Xin Yu,et al.  Distinguishing bipolar and major depressive disorders by brain structural morphometry: a pilot study , 2015, BMC Psychiatry.

[3]  Xavier Lladó,et al.  Quantitative Analysis of Patch-Based Fully Convolutional Neural Networks for Tissue Segmentation on Brain Magnetic Resonance Imaging , 2018, IEEE Access.

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Vijayan K. Asari,et al.  The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches , 2018, ArXiv.

[6]  Hao Chen,et al.  VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain Segmentation , 2016, ArXiv.

[7]  Yaozong Gao,et al.  LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images , 2015, NeuroImage.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Örjan Smedby,et al.  Automatic brain segmentation using artificial neural networks with shape context , 2018, Pattern Recognit. Lett..

[11]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[12]  Benoit M. Macq,et al.  Effect of inter-subject variation on the accuracy of atlas-based segmentation applied to human brain structures , 2010, Medical Imaging.

[13]  I. Melle,et al.  Subcortical brain volume abnormalities in 2028 individuals with schizophrenia and 2540 healthy controls via the ENIGMA consortium , 2016, Molecular Psychiatry.

[14]  Elena Marchiori,et al.  Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities , 2016, Scientific Reports.

[15]  John G. Csernansky,et al.  Open Access Series of Imaging Studies: Longitudinal MRI Data in Nondemented and Demented Older Adults , 2010, Journal of Cognitive Neuroscience.

[16]  Kyong Hwan Jin,et al.  Fast and robust segmentation of the striatum using deep convolutional neural networks , 2016, Journal of Neuroscience Methods.

[17]  D. Rueckert,et al.  White matter hyperintensity and stroke lesion segmentation and differentiation using convolutional neural networks , 2017, NeuroImage: Clinical.

[18]  Seyed-Ahmad Ahmadi,et al.  Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound , 2016, Comput. Vis. Image Underst..

[19]  John G. Csernansky,et al.  Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults , 2007, Journal of Cognitive Neuroscience.

[20]  Carlos Alberto Silva,et al.  Automatic brain tissue segmentation in MR images using Random Forests and Conditional Random Fields , 2016, Journal of Neuroscience Methods.

[21]  M. Herbert,et al.  Motor stereotypies and volumetric brain alterations in children with Autistic Disorder. , 2013, Research in autism spectrum disorders.

[22]  Amir Alansary,et al.  MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans , 2015, Comput. Intell. Neurosci..

[23]  Xavier Lladó,et al.  Automated sub‐cortical brain structure segmentation combining spatial and deep convolutional features , 2017, Medical Image Anal..

[24]  Christian Wachinger,et al.  DeepNAT: Deep convolutional neural network for segmenting neuroanatomy , 2017, NeuroImage.

[25]  Bennett A Landman,et al.  Non-local statistical label fusion for multi-atlas segmentation , 2013, Medical Image Anal..

[26]  Xavier Lladó,et al.  Automated tissue segmentation of MR brain images in the presence of white matter lesions , 2017, Medical Image Anal..

[27]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[28]  Yong-Ku Kim,et al.  Application of machine learning classification for structural brain MRI in mood disorders: Critical review from a clinical perspective , 2018, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[29]  Ben Glocker,et al.  NeuroNet: Fast and Robust Reproduction of Multiple Brain Image Segmentation Pipelines , 2018, ArXiv.

[30]  K. Ashkan,et al.  Subcortical Structure Volumes and Correlation to Clinical Variables in Parkinson's Disease , 2015, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[31]  Lawrence J. Mazlack,et al.  Detecting brain structural changes as biomarker from magnetic resonance images using a local feature based SVM approach , 2014, Journal of Neuroscience Methods.

[32]  Maximilien Vermandel,et al.  Segmentation algorithms of subcortical brain structures on MRI for radiotherapy and radiosurgery: A survey , 2015 .

[33]  Sébastien Ourselin,et al.  AdaPT: An adaptive preterm segmentation algorithm for neonatal brain MRI , 2013, NeuroImage.

[34]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[35]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[37]  Albert C. S. Chung,et al.  Multi-scale structured CNN with label consistency for brain MR image segmentation , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[38]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[39]  Hao Chen,et al.  VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images , 2017, NeuroImage.

[40]  Max A. Viergever,et al.  Evaluation of an automatic brain segmentation method developed for neonates on adult MR brain images , 2015, Medical Imaging.

[41]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[42]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[43]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[44]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[45]  N. De Stefano,et al.  Clinical use of brain volumetry , 2013, Journal of magnetic resonance imaging : JMRI.

[46]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[47]  Laura Gui,et al.  Morphology-driven automatic segmentation of MR images of the neonatal brain , 2012, Medical Image Anal..

[48]  Paul M. Thompson,et al.  Heritability analysis of surface-based cortical thickness estimation on a large twin cohort , 2015, Medical Imaging.

[49]  J. Pluim,et al.  Evaluation of a deep learning approach for the segmentation of brain tissues and white matter hyperintensities of presumed vascular origin in MRI , 2017, NeuroImage: Clinical.

[50]  Xavier Lladó,et al.  Comparison of 10 brain tissue segmentation methods using revisited IBSR annotations , 2015, Journal of magnetic resonance imaging : JMRI.

[51]  Jose Dolz,et al.  3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study , 2016, NeuroImage.