An Improved Dice Loss for Pneumothorax Segmentation by Mining the Information of Negative Areas

The lesion regions of a medical image account for only a small part of the image, and a critical imbalance exists in the distribution of the positive and negative samples, which affects the segmentation performance of the lesion regions. Dice loss is beneficial for the image segmentation involving an extreme imbalance of the positive and negative samples but it ignores the background regions, which also contain a large amount of information. In this work, we propose an improved dice loss that can mine the information in background areas and modify network architecture to improve performance. The improved dice loss called weighted soft dice loss (WSDice loss). Our loss function gives a small weight to the background area of the label, so the background area will be added to the calculation when calculating dice loss. It can also soft the hard label in the lesion area to increase the robustness of the model to noise label. What’s more, we propose to cascade Focal loss and WSDice loss. Focal Loss is a Distribution-based loss function, WSDice Loss is a Region-based loss function, the optimization directions of them are different. The cascaded loss function can make full use of the advantages of both and greatly improve model performance. In addition, we add a simple but effective channel attention module to the decode module of U-net. We experimented on the ChestX-ray8 datasets. Compared with Dice loss, WSDice loss improves the dice coefficient by 1.59%, cascaded loss function can improve dice coefficient by 7.81%. The improved in model architecture can increase the dice coefficient by 1.36%.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Vidur Mahajan,et al.  The Algorithmic Audit: Working with Vendors to Validate Radiology-AI Algorithms-How We Do It. , 2020, Academic radiology.

[3]  Hayit Greenspan,et al.  Pneumothorax detection in chest radiographs using local and global texture signatures , 2015, Medical Imaging.

[4]  Li Yao,et al.  Learning to diagnose from scratch by exploiting dependencies among labels , 2017, ArXiv.

[5]  Yuxiang Xing,et al.  Metal artifact reduction for practical dental computed tomography by improving interpolation-based reconstruction with deep learning. , 2019, Medical physics.

[6]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Liyuan Liu,et al.  On the Variance of the Adaptive Learning Rate and Beyond , 2019, ICLR.

[8]  Graeme P Currie,et al.  Pneumothorax: an update , 2007, Postgraduate Medical Journal.

[9]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.

[12]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[13]  Yuichiro Hayashi,et al.  On the influence of Dice loss function in multi-class organ segmentation of abdominal CT using 3D fully convolutional networks , 2018, ArXiv.

[14]  Keith E. Muller,et al.  Contrast-limited adaptive histogram equalization: speed and effectiveness , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[15]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[16]  J. Mongan,et al.  Automated detection of moderate and large pneumothorax on frontal chest X-rays using deep convolutional neural networks: A retrospective study , 2018, PLoS medicine.

[17]  Quoc V. Le,et al.  Neural Architecture Search with Reinforcement Learning , 2016, ICLR.

[18]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[19]  Hung-Min Sun,et al.  Effective Pneumothorax Detection for Chest X-Ray Images Using Local Binary Pattern and Support Vector Machine , 2018, Journal of healthcare engineering.

[20]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[21]  Wen-Huang Cheng,et al.  Segmenting Hepatic Lesions Using Residual Attention U-Net with an Adaptive Weighted Dice Loss , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[22]  Qun Jin,et al.  Enhanced Diagnosis of Pneumothorax with an Improved Real-Time Augmentation for Imbalanced Chest X-rays Data Based on DCNN , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[23]  Jong Chul Ye,et al.  One Network to Solve All ROIs: Deep Learning CT for Any ROI using Differentiated Backprojection , 2019, Medical physics.

[24]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Olaf Ronneberger,et al.  Invited Talk: U-Net Convolutional Networks for Biomedical Image Segmentation , 2017, Bildverarbeitung für die Medizin.

[26]  Zhiyong Lu,et al.  Automated abnormality classification of chest radiographs using deep convolutional neural networks , 2020, npj Digital Medicine.

[27]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[28]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Wei Wei,et al.  Thoracic Disease Identification and Localization with Limited Supervision , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]  Tae Joon Jun,et al.  Automated diagnosis of pneumothorax using an ensemble of convolutional neural networks with multi-sized chest radiography images , 2018, ArXiv.

[32]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.