2ST-UNet: 2-Stage Training Model using U-Net for Pneumothorax Segmentation in Chest X-Rays

Pneumothorax, also called a collapsed lung, is the presence of the air outside of the lung in the space between the lung and chest wall. It is generally diagnosed using a chest X-ray. However, for some cases, the diagnosis can be difficult as other medical conditions appear similarly. Machine Learning algorithms have been providing great assistance in detecting and locating pneumothorax lately. In this paper, we propose a 2-Stage Training system to segment images with pneumothorax. This system has been built based on U-Net, the state-of-the-art Fully Convolutional Network (FCN) architecture, with a backbone Residual Networks (ResNet-34) that is pre-trained on the ImageNet dataset. In the beginning, we train the network at a lower resolution. Then, we load the trained model weights to retrain the network with a higher resolution. Moreover, we utilize different techniques including Stochastic Weight Averaging (SWA), data augmentation, and Test-Time Augmentation (TTA). We use the chest X-ray dataset that is provided by the 2019 SIIM-ACR Pneumothorax Segmentation Challenge, which contains 12047 training images and 3205 testing images. Our experiments show that 2-Stage Training leads to better and faster network convergence. Our method achieves 0.8356 mean Dice coefficient placing it among the top 9% of competitors with a rank of 124 out of 1475.

[1]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[2]  Tarek Khadir,et al.  Deep Convolutional Neural Networks Using U-Net for Automatic Brain Tumor Segmentation in Multimodal MRI Volumes , 2018, BrainLes@MICCAI.

[3]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[4]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Sebastien Ourselin,et al.  Test-time augmentation with uncertainty estimation for deep learning-based medical image segmentation , 2018 .

[8]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[9]  Frank Hutter,et al.  SGDR: Stochastic Gradient Descent with Warm Restarts , 2016, ICLR.

[10]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[11]  Konstantinos Zarogoulidis,et al.  Pneumothorax: from definition to diagnosis and treatment. , 2014, Journal of thoracic disease.

[12]  Mahmoud Al-Ayyoub,et al.  Performance study of augmentation techniques for HEp2 CNN classification , 2018, 2018 9th International Conference on Information and Communication Systems (ICICS).

[13]  Lu-Cheng Kuo,et al.  Pneumothorax in the ICU: patient outcomes and prognostic factors. , 2002, Chest.

[14]  Ting Li,et al.  Automatic Tissue Image Segmentation Based on Image Processing and Deep Learning , 2018, BiOS.

[15]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Andrew Gordon Wilson,et al.  Averaging Weights Leads to Wider Optima and Better Generalization , 2018, UAI.

[17]  Max A. Viergever,et al.  Interactive segmentation of abdominal aortic aneurysms in CTA images , 2004, Medical Image Anal..

[18]  Nathan Cross,et al.  Deep Learning for Pneumothorax Detection and Localization in Chest Radiographs , 2019, ArXiv.

[19]  Mahmoud Al-Ayyoub,et al.  Will Transfer Learning Enhance ImageNet Classification Accuracy Using ImageNet-Pretrained Models? , 2019, 2019 10th International Conference on Information and Communication Systems (ICICS).

[20]  J. Mongan,et al.  Automated detection of moderate and large pneumothorax on frontal chest X-rays using deep convolutional neural networks: A retrospective study , 2018, PLoS medicine.

[21]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[22]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[24]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Mahmoud Al-Ayyoub,et al.  A detailed comparative study of open source deep learning frameworks , 2019, ArXiv.

[27]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[28]  P. Jaccard THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1 , 1912 .

[29]  C. Strange Pleural complications in the intensive care unit. , 1999, Clinics in chest medicine.

[30]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.