Boundary-aware Segmentation Network Using Multi-Task Enhancement for Ultrasound Image

Complicated medical image analysis often requires a combination of disease classification, lesion detection and lesion segmentation. However, models designed for different tasks produce inconsistent or non-corresponding predictions and ignore the implicit connections between tasks. We propose a novel framework, which makes full use of the fact that segmentation and detection are mutually beneficial, boosts these three tasks in a unified framework. The proposed Information Enhancement Module uses classification information as a beneficial supplement to locate lesion quickly for segmentation. To further achieve fine segmentation with clear boundaries, we propose a Boundary-aware Loss, which dynamically adjusts supervised signal, so that our model pays more attention to boundary in later stages of training. Through experiments conducted on Thyroid Ultrasound dataset, we have demonstrated the good performance of the proposed method in joint segmentation and detection.

[1]  Qing-Guo Wang,et al.  Integrated Learning via Randomized Forests and Localized Regression With Application to Medical Diagnosis , 2019, IEEE Access.

[2]  Klaus H. Maier-Hein,et al.  Reg R-CNN: Lesion Detection and Grading under Noisy Labels , 2019, UNSURE/CLIP@MICCAI.

[3]  Shu Liu,et al.  Path Aggregation Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Gang Wang,et al.  Graininess-Aware Deep Feature Learning for Pedestrian Detection , 2018, ECCV.

[5]  Nuno Vasconcelos,et al.  Cascade R-CNN: Delving Into High Quality Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Li Fei-Fei,et al.  Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Seung-Hwan Bae,et al.  Object Detection based on Region Decomposition and Assembly , 2019, AAAI.

[10]  Tong Ruan,et al.  Automatic Severity Classification of Coronary Artery Disease via Recurrent Capsule Network , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[11]  Maria Wimmer,et al.  Deep Sequential Segmentation of Organs in Volumetric Medical Scans , 2018, IEEE Transactions on Medical Imaging.

[12]  Kai Chen,et al.  Hybrid Task Cascade for Instance Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Jung Hoon Kim,et al.  Liver Lesion Detection from Weakly-labeled Multi-phase CT Volumes with a Grouped Single Shot MultiBox Detector , 2018, MICCAI.

[15]  Abdollah Amirkhani,et al.  A novel hybrid method based on fuzzy cognitive maps and fuzzy clustering algorithms for grading celiac disease , 2016, Neural Computing and Applications.

[16]  Thomas Brox,et al.  Joint Graph Decomposition & Node Labeling: Problem, Algorithms, Applications , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.