FOANet: A Focus of Attention Network with Application to Myocardium Segmentation

In myocardium segmentation of cardiac magnetic resonance images, ambiguities often appear near the boundaries of the target domains due to tissue similarities. To address this issue, we propose a new architecture, called FOANet, which can be decomposed in three main steps: a localization step, a Gaussian-based contrast enhancement step, and a segmentation step. This architecture is supplied with a hybrid loss function that guides the FOANet to study the transformation relationship between the input image and the corresponding label in a three-level hierarchy (pixel-, patch- and map-level), which is helpful to improve segmentation and recovery of the boundaries. We demonstrate the efficiency of our approach on two public datasets in terms of regional and boundary segmentations.

[1]  Guang Yang,et al.  Evaluation of algorithms for Multi-Modality Whole Heart Segmentation: An open-access grand challenge , 2019, Medical Image Anal..

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Guang Yang,et al.  Bayesian VoxDRN: A Probabilistic Deep Voxelwise Dilated Residual Network for Whole Heart Segmentation from 3D MR Images , 2018, MICCAI.

[4]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[5]  Horst Bischof,et al.  Multi-label Whole Heart Segmentation Using CNNs and Anatomical Label Configurations , 2017, STACOM@MICCAI.

[6]  Mattias P. Heinrich,et al.  MRI Whole Heart Segmentation Using Discrete Nonlinear Registration and Fast Non-local Fusion , 2017, STACOM@MICCAI.

[7]  Wufeng Xue,et al.  Full Quantification of Left Ventricle via Deep Multitask Learning Network Respecting Intra- and Inter-Task Relatedness , 2017, MICCAI.

[8]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Gang Li,et al.  Benchmark on Automatic Six-Month-Old Infant Brain Segmentation Algorithms: The iSeg-2017 Challenge , 2019, IEEE Transactions on Medical Imaging.

[10]  Ziv Yaniv,et al.  A Distance Map Regularized CNN for Cardiac Cine MR Image Segmentation , 2019, Medical physics.

[11]  Antonio Torralba,et al.  Contextual Priming for Object Detection , 2003, International Journal of Computer Vision.

[12]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[13]  Mert R. Sabuncu,et al.  Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels , 2018, NeurIPS.

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[16]  Simon Andermatt,et al.  Standardized Assessment of Automatic Segmentation of White Matter Hyperintensities and Results of the WMH Segmentation Challenge , 2019, IEEE Transactions on Medical Imaging.

[17]  Xiahai Zhuang,et al.  Multi-scale patch and multi-modality atlases for whole heart segmentation of MRI , 2016, Medical Image Anal..

[18]  Isabelle Bloch,et al.  From neonatal to adult brain MR image segmentation in a few seconds using 3D-like fully convolutional network and transfer learning , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[19]  Dongqing Zhang,et al.  A multi-level convolutional LSTM model for the segmentation of left ventricle myocardium in infarcted porcine cine MR images , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[20]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[21]  Eranga Ukwatta,et al.  Fully automated segmentation of left ventricular myocardium from 3D late gadolinium enhancement magnetic resonance images using a U-net convolutional neural network-based model , 2019, Medical Imaging.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Lisheng Xu,et al.  Multi-Scale Feature Fusion Convolutional Neural Network for Concurrent Segmentation of Left Ventricle and Myocardium in Cardiac MR Images , 2020 .

[25]  Zhou Zhao,et al.  A Two-Stage Temporal-Like Fully Convolutional Network Framework for Left Ventricle Segmentation and Quantification on MR Images , 2019, STACOM@MICCAI.

[26]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[27]  Yi Guo,et al.  Accuracy, uncertainty, and adaptability of automatic myocardial ASL segmentation using deep CNN , 2018, Magnetic resonance in medicine.

[28]  Wufeng Xue,et al.  Full left ventricle quantification via deep multitask relationships learning , 2018, Medical Image Anal..

[29]  Zhou Zhao,et al.  Left Atrial Segmentation in a Few Seconds Using Fully Convolutional Network and Transfer Learning , 2018, STACOM@MICCAI.