A Deep Spatial Context Guided Framework for Infant Brain Subcortical Segmentation

Accurate subcortical segmentation of infant brain magnetic resonance (MR) images is crucial for studying early subcortical structural growth patterns and related diseases diagnosis. However, dynamic intensity changes, low tissue contrast, and small subcortical size of infant brain MR images make subcortical segmentation a challenging task. In this paper, we propose a spatial context guided, coarse-to-fine deep convolutional neural network (CNN) based framework for accurate infant subcortical segmentation. At the coarse stage, we propose a signed distance map (SDM) learning UNet (SDM-UNet) to predict SDMs from the original multi-modal images, including T1w, T2w, and T1w/T2w images. By doing this, the spatial context information, including the relative position information across different structures and the shape information of the segmented structures contained in the ground-truth SDMs, is used for supervising the SDM-UNet to remedy the bad influence from the low tissue contrast in infant brain MR images and generate high-quality SDMs. To improve the robustness to outliers, a Correntropy based loss is introduced in SDM-UNet to penalize the difference between the ground-truth SDMs and predicted SDMs in training. At the fine stage, the predicted SDMs, which contains spatial context information of subcortical structures, are combined with the multi-modal images, and then fed into a multi-source and multi-path UNet (M2-UNet) for delivering refined segmentation. We validate our method on an infant brain MR image dataset with 24 scans by evaluating the Dice ratio between our segmentation and the manual delineation. Compared to four state-of-the-art methods, our method consistently achieves better performances in both qualitative and quantitative evaluations.

[1]  Bruce Crosson,et al.  Subcortical functions in language and memory , 1992 .

[2]  C. Büchel,et al.  Subcortical structures involved in pain processing: evidence from single-trial fMRI , 2002, PAIN.

[3]  Xiaowei Hu,et al.  ψ-Net: Stacking Densely Convolutional LSTMs for Sub-Cortical Brain Structure Segmentation , 2020, IEEE Transactions on Medical Imaging.

[4]  Yue Zhang,et al.  A Joint 3D+2D Fully Convolutional Framework for Subcortical Segmentation , 2019, MICCAI.

[5]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[6]  Guoyan Zheng,et al.  Multi-stream 3D FCN with multi-scale deep supervision for multi-modality isointense infant brain MR image segmentation , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[7]  Yaozong Gao,et al.  LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images , 2015, NeuroImage.

[8]  Ruth A. Carper,et al.  Unusual brain growth patterns in early life in patients with autistic disorder , 2001, Neurology.

[9]  Daniel Rueckert,et al.  Tracking developmental changes in subcortical structures of the preterm brain using multi-modal MRI , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[10]  Dinggang Shen,et al.  Anatomy‐guided joint tissue segmentation and topological correction for 6‐month infant brain MRI with risk of autism , 2018, Human brain mapping.

[11]  Xavier Lladó,et al.  Automated sub‐cortical brain structure segmentation combining spatial and deep convolutional features , 2017, Medical Image Anal..

[12]  Chao Li,et al.  Shared Predictive Cross-Modal Deep Quantization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Richard A. Newcombe,et al.  DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Jose Dolz,et al.  3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study , 2016, NeuroImage.

[15]  Yoshifusa Ito,et al.  Approximation Capability of Layered Neural Networks with Sigmoid Units on Two Layers , 1994, Neural Computation.

[16]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[17]  Dinggang Shen,et al.  Computational neuroanatomy of baby brains: A review , 2019, NeuroImage.

[18]  Badong Chen,et al.  Efficient and robust deep learning with Correntropy-induced loss function , 2016, Neural Computing and Applications.

[19]  D. V. van Essen,et al.  Mapping Human Cortical Areas In Vivo Based on Myelin Content as Revealed by T1- and T2-Weighted MRI , 2011, The Journal of Neuroscience.

[20]  Dinggang Shen,et al.  The UNC/UMN Baby Connectome Project (BCP): An overview of the study design and protocol development , 2019, NeuroImage.

[21]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[22]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[23]  Anqi Qiu,et al.  Morphology and microstructure of subcortical structures at birth: A large-scale Asian neonatal neuroimaging study , 2013, NeuroImage.

[24]  Chunfeng Lian,et al.  A Longitudinal MRI Study of Amygdala and Hippocampal Subfields for Infants with Risk of Autism , 2019, GLMI@MICCAI.

[25]  Dinggang Shen,et al.  Volume-Based Analysis of 6-Month-Old Infant Brain MRI for Autism Biomarker Identification and Early Diagnosis , 2018, MICCAI.

[26]  Sébastien Ourselin,et al.  DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[28]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.