Dual dense context-aware network for hippocampal segmentation

Abstract The morphological analysis of hippocampus based on magnetic resonance imaging is significant for computer-aided neurological disease diagnosis. The segmentation of the hippocampus is a prerequisite for calculating its volume and measuring its shape. In this study, we propose a dual dense context-aware network (DDCNet) for automatic hippocampal segmentation, mainly including a multi-scale input approach and multi-resolution feature fusion. First, considering that a single-scale network cannot accurately segment the hippocampus and background with large difference in volume, we design a multi-scale input module (MSIM) to extract the hippocampus features of different receptive fields. Specifically, large scales are used to learn spatial dependencies, while smaller scales are used to learn more hippocampal details. Taking advantage of the fact that the features from different resolution layers offer semantically different information for segmentation, we develop a multi-resolution feature fusion module (MRFFM) to effectively aggregate complementary features and to simultaneously utilize the high-resolution features from the encoder to guide the low-resolution hippocampus edge segmentation in the decoder phase. In addition, many dense connections are introduced to further extend the feature fusion and contextual information of various resolutions between the encoder and decoder. The proposed approach achieves state-of-the-art performance, outperforming existing hippocampal segmentation approaches on the ADNI dataset.

[1]  Tianzi Jiang,et al.  Local label learning (LLL) for subcortical structure segmentation: Application to hippocampus segmentation , 2014, Human brain mapping.

[2]  Carlos Ortiz-de-Solorzano,et al.  Combination Strategies in Multi-Atlas Image Segmentation: Application to Brain MR Data , 2009, IEEE Transactions on Medical Imaging.

[3]  Qianjin Feng,et al.  Cascade of multi-scale convolutional neural networks for bone suppression of chest radiographs in gradient domain , 2017, Medical Image Anal..

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Nick C Fox,et al.  Automatic calculation of hippocampal atrophy rates using a hippocampal template and the boundary shift integral , 2007, Neurobiology of Aging.

[6]  Paul M. Matthews,et al.  Functional segmentation of the hippocampus in the healthy human brain and in Alzheimer's disease , 2013, NeuroImage.

[7]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Daoqiang Zhang,et al.  Robust multi-atlas label propagation by deep sparse representation , 2017, Pattern Recognit..

[9]  Xiaogang Wang,et al.  Context Encoding for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  S. Duchesne,et al.  Appearance-Based Segmentation of Medial Temporal Lobe Structures , 2002, NeuroImage.

[11]  Xiaoxiao Li,et al.  Semantic Image Segmentation via Deep Parsing Network , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[12]  Kun Yu,et al.  DenseASPP for Semantic Segmentation in Street Scenes , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[15]  Gustavo Carneiro,et al.  Deep Learning and Structured Prediction for the Segmentation of Mass in Mammograms , 2015, MICCAI.

[16]  Ronald M. Summers,et al.  DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation , 2015, MICCAI.

[17]  Nicos Maglaveras,et al.  Hippocampus segmentation through gradient based reliability maps for local blending of ACM energy terms , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[18]  Michael Weiner,et al.  Nearly automatic segmentation of hippocampal subfields in in vivo focal T2-weighted MRI , 2010, NeuroImage.

[19]  Dinggang Shen,et al.  Scalable joint segmentation and registration framework for infant brain images , 2017, Neurocomputing.

[20]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[21]  M. Mallar Chakravarty,et al.  Multi-atlas segmentation of the whole hippocampus and subfields using multiple automatically generated templates , 2014, NeuroImage.

[22]  Dinggang Shen,et al.  Scalable High-Performance Image Registration Framework by Unsupervised Deep Feature Representations Learning , 2016, IEEE Transactions on Biomedical Engineering.

[23]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Kilian Q. Weinberger,et al.  Deep Networks with Stochastic Depth , 2016, ECCV.

[25]  Gang Yu,et al.  Learning a Discriminative Feature Network for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Shutao Li,et al.  Segmentation of hippocampus based on ROI atlas registration , 2011, 2011 IEEE International Symposium on IT in Medicine and Education.

[27]  Dinggang Shen,et al.  journal homepage: www.elsevier.com/locate/ynimg , 2022 .

[28]  Daoqiang Zhang,et al.  A generative probability model of joint label fusion for multi-atlas based brain segmentation , 2014, Medical Image Anal..

[29]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  D. Louis Collins,et al.  Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation , 2011, NeuroImage.

[32]  Dinggang Shen,et al.  Estimating myocardial motion by 4D image warping , 2009, Pattern Recognit..

[33]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Paul M. Thompson,et al.  Atlas-based hippocampus segmentation in Alzheimer's disease and mild cognitive impairment , 2005, NeuroImage.

[35]  Juha Koikkalainen,et al.  Fast and robust multi-atlas segmentation of brain magnetic resonance images , 2010, NeuroImage.

[36]  Mert R. Sabuncu,et al.  A Generative Model for Image Segmentation Based on Label Fusion , 2010, IEEE Transactions on Medical Imaging.

[37]  D. Louis Collins,et al.  Appearance-based modeling for segmentation of hippocampus and amygdala using multi-contrast MR imaging , 2011, NeuroImage.

[38]  Dinggang Shen,et al.  Image registration by local histogram matching , 2007, Pattern Recognit..

[39]  Hao Chen,et al.  Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[40]  John Pluta,et al.  In vivo analysis of hippocampal subfield atrophy in mild cognitive impairment via semi-automatic segmentation of T2-weighted MRI. , 2012, Journal of Alzheimer's disease : JAD.

[41]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[42]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.