Multi-Site Infant Brain Segmentation Algorithms: The iSeg-2019 Challenge

To better understand early brain development in health and disorder, it is critical to accurately segment infant brain magnetic resonance (MR) images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). Deep learning-based methods have achieved state-of-the-art performance; h owever, one of the major limitations is that the learning-based methods may suffer from the multi-site issue, that is, the models trained on a dataset from one site may not be applicable to the datasets acquired from other sites with different imaging protocols/scanners. To promote methodological development in the community, the iSeg-2019 challenge (http://iseg2019.web.unc.edu) provides a set of 6-month infant subjects from multiple sites with different protocols/scanners for the participating methods. T raining/validation subjects are from UNC (MAP) and testing subjects are from UNC/UMN (BCP), Stanford University, and Emory University. By the time of writing, there are 30 automatic segmentation methods participated in the iSeg-2019. In this article, 8 top-ranked methods were reviewed by detailing their pipelines/implementations, presenting experimental results, and evaluating performance across different sites in terms of whole brain, regions of interest, and gyral landmark curves. We further pointed out their limitations and possible directions for addressing the multi-site issue. We find that multi-site consistency is still an open issue. We hope that the multi-site dataset in the iSeg-2019 and this review article will attract more researchers to address the challenging and critical multi-site issue in practice.

[1]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[2]  Toan Duc Bui,et al.  Skip-connected 3D DenseNet for volumetric infant brain MRI segmentation , 2019, Biomed. Signal Process. Control..

[3]  Bastian Leibe,et al.  Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[5]  Laura Gui,et al.  Morphology-driven automatic segmentation of MR images of the neonatal brain , 2012, Medical Image Anal..

[6]  T. Sejnowski,et al.  A universal scaling law between gray matter and white matter of cerebral cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Hao Chen,et al.  Unsupervised Cross-Modality Domain Adaptation of ConvNets for Biomedical Image Segmentations with Adversarial Loss , 2018, IJCAI.

[8]  Sijie Niu,et al.  Semi-supervised Transfer Learning for Infant Cerebellum Tissue Segmentation , 2020, MLMI@MICCAI.

[9]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Kate Saenko,et al.  Strong-Weak Distribution Alignment for Adaptive Object Detection , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yunzhou Zhang,et al.  Infant brain MRI segmentation with dilated convolution pyramid downsampling and self-attention , 2019, ArXiv.

[12]  Alan C. Evans,et al.  Brain volume findings in 6-month-old infants at high familial risk for autism. , 2012, The American journal of psychiatry.

[13]  Dinggang Shen,et al.  Volume-Based Analysis of 6-Month-Old Infant Brain MRI for Autism Biomarker Identification and Early Diagnosis , 2018, MICCAI.

[14]  Nassir Navab,et al.  Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networks , 2018, MICCAI.

[15]  J. Gilmore,et al.  Longitudinally guided level sets for consistent tissue segmentation of neonates , 2013, Human brain mapping.

[16]  Patrick Pérez,et al.  ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[18]  Alan C. Evans,et al.  Maturation of white matter in the human brain: a review of magnetic resonance studies , 2001, Brain Research Bulletin.

[19]  S K Hilal,et al.  Contrast manipulation in NMR imaging. , 1984, Magnetic resonance imaging.

[20]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[21]  P. Ellen Grant,et al.  Infant FreeSurfer: An automated segmentation and surface extraction pipeline for T1-weighted neuroimaging data of infants 0–2 years , 2020, NeuroImage.

[22]  Daniel Rueckert,et al.  The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction , 2017, NeuroImage.

[23]  Richard M. Leahy,et al.  BrainSuite: An Automated Cortical Surface Identification Tool , 2000, MICCAI.

[24]  Dinggang Shen,et al.  Anatomy‐guided joint tissue segmentation and topological correction for 6‐month infant brain MRI with risk of autism , 2018, Human brain mapping.

[25]  Klaus H. Maier-Hein,et al.  Automated Design of Deep Learning Methods for Biomedical Image Segmentation , 2019 .

[26]  R. Kuzniecky,et al.  A developmental and genetic classification for malformations of cortical development: update 2012 , 2012, Brain : a journal of neurology.

[27]  Quinn Jones,et al.  Few-Shot Adversarial Domain Adaptation , 2017, NIPS.

[28]  Dinggang Shen,et al.  journal homepage: www.elsevier.com/locate/ynimg , 2022 .

[29]  Trevor Darrell,et al.  Simultaneous Deep Transfer Across Domains and Tasks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[30]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[31]  Kate Saenko,et al.  Return of Frustratingly Easy Domain Adaptation , 2015, AAAI.

[32]  Dianna D. Cody,et al.  AAPM/RSNA physics tutorial for residents , 2002 .

[33]  D B Plewes The AAPM/RSNA physics tutorial for residents. Contrast mechanisms in spin-echo MR imaging. , 1994, Radiographics : a review publication of the Radiological Society of North America, Inc.

[34]  Sergio Escalera,et al.  Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation: The M&Ms Challenge , 2021, IEEE Transactions on Medical Imaging.

[35]  Weili Lin,et al.  Brain functional development separates into three distinct time periods in the first two years of life , 2019, NeuroImage.

[36]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[37]  Gang Li,et al.  Benchmark on Automatic Six-Month-Old Infant Brain Segmentation Algorithms: The iSeg-2017 Challenge , 2019, IEEE Transactions on Medical Imaging.

[38]  Shunxing Bao,et al.  3D whole brain segmentation using spatially localized atlas network tiles , 2019, NeuroImage.

[39]  Klaus H. Maier-Hein,et al.  nnU-Net: Breaking the Spell on Successful Medical Image Segmentation , 2019, ArXiv.

[40]  Xiaoou Tang,et al.  Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net , 2018, ECCV.

[41]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[42]  Florian Jung,et al.  Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge , 2014, Medical Image Anal..

[43]  Simon K. Warfield,et al.  Automatic segmentation of newborn brain MRI , 2009, NeuroImage.

[44]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[45]  Dinggang Shen,et al.  Measuring the dynamic longitudinal cortex development in infants by reconstruction of temporally consistent cortical surfaces , 2014, NeuroImage.

[46]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[47]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.