Multi-Site Infant Brain Segmentation Algorithms: The iSeg-2019 Challenge

To better understand early brain development in health and disorder, it is critical to accurately segment infant brain magnetic resonance (MR) images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). Deep learning-based methods have achieved state-of-the-art performance; h owever, one of the major limitations is that the learning-based methods may suffer from the multi-site issue, that is, the models trained on a dataset from one site may not be applicable to the datasets acquired from other sites with different imaging protocols/scanners. To promote methodological development in the community, the iSeg-2019 challenge (http://iseg2019.web.unc.edu) provides a set of 6-month infant subjects from multiple sites with different protocols/scanners for the participating methods. T raining/validation subjects are from UNC (MAP) and testing subjects are from UNC/UMN (BCP), Stanford University, and Emory University. By the time of writing, there are 30 automatic segmentation methods participated in the iSeg-2019. In this article, 8 top-ranked methods were reviewed by detailing their pipelines/implementations, presenting experimental results, and evaluating performance across different sites in terms of whole brain, regions of interest, and gyral landmark curves. We further pointed out their limitations and possible directions for addressing the multi-site issue. We find that multi-site consistency is still an open issue. We hope that the multi-site dataset in the iSeg-2019 and this review article will attract more researchers to address the challenging and critical multi-site issue in practice.

[1]  S K Hilal,et al.  Contrast manipulation in NMR imaging. , 1984, Magnetic resonance imaging.

[2]  D B Plewes The AAPM/RSNA physics tutorial for residents. Contrast mechanisms in spin-echo MR imaging. , 1994, Radiographics : a review publication of the Radiological Society of North America, Inc.

[3]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[4]  T. Sejnowski,et al.  A universal scaling law between gray matter and white matter of cerebral cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Alan C. Evans,et al.  Maturation of white matter in the human brain: a review of magnetic resonance studies , 2001, Brain Research Bulletin.

[6]  Dianna D. Cody,et al.  AAPM/RSNA physics tutorial for residents , 2002 .

[7]  Richard M. Leahy,et al.  BrainSuite: An Automated Cortical Surface Identification Tool , 2000, MICCAI.

[8]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[9]  Simon K. Warfield,et al.  Automatic segmentation of newborn brain MRI , 2009, NeuroImage.

[10]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[11]  Dinggang Shen,et al.  journal homepage: www.elsevier.com/locate/ynimg , 2022 .

[12]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[13]  Laura Gui,et al.  Morphology-driven automatic segmentation of MR images of the neonatal brain , 2012, Medical Image Anal..

[14]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[15]  R. Kuzniecky,et al.  A developmental and genetic classification for malformations of cortical development: update 2012 , 2012, Brain : a journal of neurology.

[16]  Alan C. Evans,et al.  Brain volume findings in 6-month-old infants at high familial risk for autism. , 2012, The American journal of psychiatry.

[17]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[18]  J. Gilmore,et al.  Longitudinally guided level sets for consistent tissue segmentation of neonates , 2013, Human brain mapping.

[19]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[20]  Dinggang Shen,et al.  Measuring the dynamic longitudinal cortex development in infants by reconstruction of temporally consistent cortical surfaces , 2014, NeuroImage.

[21]  Florian Jung,et al.  Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge , 2014, Medical Image Anal..

[22]  Trevor Darrell,et al.  Simultaneous Deep Transfer Across Domains and Tasks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[24]  Kate Saenko,et al.  Return of Frustratingly Easy Domain Adaptation , 2015, AAAI.

[25]  Bastian Leibe,et al.  Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Quinn Jones,et al.  Few-Shot Adversarial Domain Adaptation , 2017, NIPS.

[27]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  K. Hongo,et al.  !"# $%&'( , 2018, GIS.

[29]  Hao Chen,et al.  Unsupervised Cross-Modality Domain Adaptation of ConvNets for Biomedical Image Segmentations with Adversarial Loss , 2018, IJCAI.

[30]  Dinggang Shen,et al.  Anatomy‐guided joint tissue segmentation and topological correction for 6‐month infant brain MRI with risk of autism , 2018, Human brain mapping.

[31]  Daniel Rueckert,et al.  The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction , 2017, NeuroImage.

[32]  Nassir Navab,et al.  Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networks , 2018, MICCAI.

[33]  Xiaoou Tang,et al.  Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net , 2018, ECCV.

[34]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[35]  Dinggang Shen,et al.  Volume-Based Analysis of 6-Month-Old Infant Brain MRI for Autism Biomarker Identification and Early Diagnosis , 2018, MICCAI.

[36]  Patrick Pérez,et al.  ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[38]  Simon A. A. Kohl,et al.  Automated Design of Deep Learning Methods for Biomedical Image Segmentation , 2019 .

[39]  Kate Saenko,et al.  Strong-Weak Distribution Alignment for Adaptive Object Detection , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Toan Duc Bui,et al.  Skip-connected 3D DenseNet for volumetric infant brain MRI segmentation , 2019, Biomed. Signal Process. Control..

[41]  Gang Li,et al.  Benchmark on Automatic Six-Month-Old Infant Brain Segmentation Algorithms: The iSeg-2017 Challenge , 2019, IEEE Transactions on Medical Imaging.

[42]  Infant brain MRI segmentation with dilated convolution pyramid downsampling and self-attention , 2019, ArXiv.

[43]  Weili Lin,et al.  Brain functional development separates into three distinct time periods in the first two years of life , 2019, NeuroImage.

[44]  Shunxing Bao,et al.  3D whole brain segmentation using spatially localized atlas network tiles , 2019, NeuroImage.

[45]  Klaus H. Maier-Hein,et al.  nnU-Net: Breaking the Spell on Successful Medical Image Segmentation , 2019, ArXiv.

[46]  Sijie Niu,et al.  Semi-supervised Transfer Learning for Infant Cerebellum Tissue Segmentation , 2020, MLMI@MICCAI.

[47]  P. Ellen Grant,et al.  Infant FreeSurfer: An automated segmentation and surface extraction pipeline for T1-weighted neuroimaging data of infants 0–2 years , 2020, NeuroImage.

[48]  Sergio Escalera,et al.  Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation: The M&Ms Challenge , 2021, IEEE Transactions on Medical Imaging.