BMAnet: Boundary Mining With Adversarial Learning for Semi-Supervised 2D Myocardial Infarction Segmentation

Automatic segmentation of myocardial infarction (MI) regions in late gadolinium-enhanced cardiac magnetic resonance images is an essential step in the computed diagnosis of myocardial infarction. Most of the current myocardial infarction region segmentation methods are based on fully supervised deep learning. However, cardiologists' annotation of myocardial infarction regions in cardiac magnetic resonance images during the diagnosis process is time-consuming and expensive. This paper proposes a semi-supervised myocardial infarction segmentation. It consists of two models: 1) a boundary mining model and 2) an adversarial learning model. The boundary mining model can solve the boundary ambiguity problem by enlarging the gap between the foreground and background features, thus segmenting the myocardial infarction region accurately. The adversarial learning model can make the boundary mining model learn from additional unlabeled data by evaluating the segmentation performance and providing pseudo supervision, which significantly increases the robustness of the boundary mining model. We conduct extensive experiments on an in-house myocardial magnetic resonance dataset. The experimental results on six evaluation metrics demonstrate that our method achieves excellent results in myocardial infarction segmentation and outperforms the state-of-the-art semi-supervised methods.

[1]  Javier Del Ser,et al.  Data harmonisation for information fusion in digital healthcare: A state-of-the-art systematic review, meta-analysis and future research directions , 2022, Inf. Fusion.

[2]  Yuhui Yuan,et al.  Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Xiaopeng Wei,et al.  Camouflaged Object Segmentation with Distraction Mining , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Yang Liu,et al.  Semi-supervised Cardiac Image Segmentation via Label Propagation and Style Transfer , 2020, M&Ms and EMIDEC/STACOM@MICCAI.

[5]  Yichi Zhang,et al.  Cascaded Convolutional Neural Network for Automatic Myocardial Infarction Segmentation from Delayed-Enhancement Cardiac MRI , 2020, M&Ms and EMIDEC/STACOM@MICCAI.

[6]  Yinan Chen,et al.  Efficient Semi-supervised Gross Target Volume of Nasopharyngeal Carcinoma Segmentation via Uncertainty Rectified Pyramid Consistency , 2020, MICCAI.

[7]  Nikolaos V. Tsekos,et al.  Myocardial Infarction Segmentation in Late Gadolinium Enhanced MRI Images using Data Augmentation and Chaining Multiple U-Net , 2020, 2020 IEEE 20th International Conference on Bioinformatics and Bioengineering (BIBE).

[8]  Xuming He,et al.  Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images , 2020, MICCAI.

[9]  Raphaël Couturier,et al.  Myocardial Infarction Segmentation From Late Gadolinium Enhancement MRI By Neural Networks and Prior Information , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[10]  Luc Duong,et al.  Semi-supervised generative adversarial networks for the segmentation of the left ventricle in pediatric MRI , 2020, Comput. Biol. Medicine.

[11]  C. Hudelot,et al.  Semi-Supervised Semantic Segmentation With Cross-Consistency Training , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Qingming Huang,et al.  ASIF-Net: Attention Steered Interweave Fusion Network for RGB-D Salient Object Detection , 2020, IEEE Transactions on Cybernetics.

[13]  Nan Xi,et al.  Semi-supervised Attentive Mutual-info Generative Adversarial Network for Brain Tumor Segmentation , 2019, 2019 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[14]  Guang Yang,et al.  Automatic Prostate Zonal Segmentation Using Fully Convolutional Network With Feature Pyramid Attention , 2019, IEEE Access.

[15]  Gadi Wollstein,et al.  Uncertainty Guided Semi-supervised Segmentation of Retinal Layers in OCT Images , 2019, MICCAI.

[16]  Marleen de Bruijne,et al.  Semi-supervised Medical Image Segmentation via Learning Consistency Under Transformations , 2019, MICCAI.

[17]  Chi-Wing Fu,et al.  Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentation , 2019, MICCAI.

[18]  Nan Feng Zhang,et al.  Deep Learning for Diagnosis of Chronic Myocardial Infarction on Nonenhanced Cardiac Cine MRI. , 2019, Radiology.

[19]  Stephen Lin,et al.  GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[20]  Jizong Peng,et al.  Deep Co-Training for Semi-Supervised Image Segmentation , 2019, Pattern Recognit..

[21]  Yoshua Bengio,et al.  Interpolation Consistency Training for Semi-Supervised Learning , 2019, IJCAI.

[22]  Yiming Li,et al.  Semi-Supervised Brain Lesion Segmentation with an Adapted Mean Teacher Model , 2019, IPMI.

[23]  Yuhao Wang,et al.  Dense Semantic Labeling with Atrous Spatial Pyramid Pooling and Decoder for High-Resolution Remote Sensing Imagery , 2018, Remote. Sens..

[24]  Huafeng Liu,et al.  Direct delineation of myocardial infarction without contrast agents using a joint motion feature learning architecture , 2018, Medical Image Anal..

[25]  Patrick Pérez,et al.  ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Hao Chen,et al.  Semi-supervised Skin Lesion Segmentation via Transformation Consistent Self-ensembling Model , 2018, BMVC.

[27]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[28]  Dinggang Shen,et al.  Semi-supervised learning for pelvic MR image segmentation based on multi-task residual fully convolutional networks , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[29]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Ben Glocker,et al.  Semi-supervised Learning for Network-Based Cardiac MR Image Segmentation , 2017, MICCAI.

[31]  Salety Ferreira Baracho,et al.  A segmentation method for myocardial ischemia/infarction applicable in heart photos , 2017, Comput. Biol. Medicine.

[32]  Deniz Erdogmus,et al.  Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks , 2017, MLMI@MICCAI.

[33]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[34]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[35]  Timo Aila,et al.  Temporal Ensembling for Semi-Supervised Learning , 2016, ICLR.

[36]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).