Do not Treat Boundaries and Regions Differently: An Example on Heart Left Atrial Segmentation

Atrial fibrillation is the most common heart rhythm disease. Due to a lack of understanding in matter of underlying atrial structures, current treatments are still not satisfying. Recently, with the popularity of deep learning, many segmentation methods based on fully convolutional networks have been proposed to analyze atrial structures, especially from late gadolinium-enhanced magnetic resonance imaging. However, two problems still occur: 1) segmentation results include the atrial-like background; 2) boundaries are very hard to segment. Most segmentation approaches design a specific network that mainly focuses on the regions, to the detriment of the boundaries. Therefore, this paper proposes an attention full convolutional network framework based on the ResNet-101 architecture, which focuses on boundaries as much as on regions. The additional attention module is added to have the network pay more attention on regions and then to reduce the impact of the misleading similarity of neighboring tissues. We also use a hybrid loss composed of a region loss and a boundary loss to treat boundaries and regions at the same time. We demonstrate the efficiency of the proposed approach on the MICCAI 2018 Atrial Segmentation Challenge public dataset.

[1]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[2]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[3]  Ganapathy Krishnamurthi,et al.  Fully convolutional multi‐scale residual DenseNets for cardiac segmentation and automated cardiac diagnosis using ensemble of classifiers , 2018, Medical Image Anal..

[4]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[5]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[6]  Changqun Xia,et al.  Selectivity or Invariance: Boundary-Aware Salient Object Detection , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[7]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[8]  Zhiyong Yuan,et al.  RIANet: Recurrent interleaved attention network for cardiac MRI segmentation , 2019, Comput. Biol. Medicine.

[9]  Zhou Zhao,et al.  Left Atrial Segmentation in a Few Seconds Using Fully Convolutional Network and Transfer Learning , 2018, STACOM@MICCAI.

[10]  Bensheng Qiu,et al.  Multiple Attention Fully Convolutional Network For Automated Ventricle Segmentation in Cardiac Magnetic Resonance Imaging , 2019, J. Medical Imaging Health Informatics.

[11]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[12]  Leyun Pan,et al.  Multi-Path Dilated Residual Network for Nuclei Segmentation and Detection , 2019, Cells.

[13]  Ashish Sinha,et al.  Multi-scale guided attention for medical image segmentation , 2019, ArXiv.

[14]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[15]  Mert R. Sabuncu,et al.  Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels , 2018, NeurIPS.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Pengfei Xiong,et al.  Pyramid Attention Network for Semantic Segmentation , 2018, BMVC.

[18]  Ronald A. Rensink.  The Dynamic Representation of Scenes , 2000 .

[19]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[20]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[21]  Isabelle Bloch,et al.  From neonatal to adult brain MR image segmentation in a few seconds using 3D-like fully convolutional network and transfer learning , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[22]  Dong Ni,et al.  Left Ventricle Segmentation and Quantification with Attention-Enhanced Segmentation and Shape Correction , 2019, ISICDM.

[23]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[25]  Chao Gao,et al.  BASNet: Boundary-Aware Salient Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Qiong Wang,et al.  Attention Based Hierarchical Aggregation Network for 3D Left Atrial Segmentation , 2018, STACOM@MICCAI.

[27]  Jose Dolz,et al.  Boundary loss for highly unbalanced segmentation , 2018, MIDL.

[28]  Huchuan Lu,et al.  Deep gated attention networks for large-scale street-level scene segmentation , 2019, Pattern Recognit..

[29]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Ben Glocker,et al.  Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images , 2018, Medical Image Anal..

[31]  Xin Yang,et al.  Deep Attentional Features for Prostate Segmentation in Ultrasound , 2018, MICCAI.

[32]  Yi Yang,et al.  Attention to Scale: Scale-Aware Semantic Image Segmentation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Geoffrey E. Hinton,et al.  Learning to combine foveal glimpses with a third-order Boltzmann machine , 2010, NIPS.

[34]  Yunchao Wei,et al.  Concealed Object Detection for Activate Millimeter Wave Image , 2019, IEEE Transactions on Industrial Electronics.

[35]  Yinghuan Shi,et al.  Cross-Modal Attention-Guided Convolutional Network for Multi-modal Cardiac Segmentation , 2019, MLMI@MICCAI.

[36]  Daniel Rueckert,et al.  Learning Shape Priors for Robust Cardiac MR Segmentation from Multi-view Images , 2019, MICCAI.

[37]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[38]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.