Rib segmentation algorithm for X-ray image based on unpaired sample augmentation and multi-scale network

Rib segmentation based on chest X-ray images is essential in the computer-aided diagnosis systems of lung cancer, which serves as an important step in the quantitative analysis of various types of lung diseases. However, the traditional methods are unable to segment ribs effectively due to the unclear edges and overlapping regions in X-ray images. A novel rib segmentation framework based on Unpaired Sample Augmentation and Multi-Scale Network is presented in this paper, aiming to improve the accuracy of ribs segmentation with limited labeled samples. First, the algorithm learns pneumonia-related texture changes via unpaired chest x-ray images and generates various augmented samples. Then, a multi-scale network attempts to learn hierarchical features using global supervision. Finally, the refined segmentation result of each organ is achieved by using a deep separation module and a comprehensive loss function. Specifically, the hierarchical features can greatly improve the robustness of multi-organ segmentation networks. The complex multi-organ segmentation task with limited labeled data is simplified with the designed deep separation module. We justify the proposed framework through extensive experiments. It achieves good performance with DSC, Precision, Recall, and Jaccard of 88.03, 88.25, 88.36, and 79.02%, respectively. The DSC value increases nearly by 3% compared to other popular methods. The experimental results show that our algorithm presents better segmentation performance for the overlapping region and fuzzy region of multiple organs, which holds research value and prospects for application.

[1]  Jun Feng,et al.  Mixed 2D and 3D convolutional network with multi-scale context for lesion segmentation in breast DCE-MRI , 2021, Biomed. Signal Process. Control..

[2]  Nor Ashidi Mat Isa,et al.  Overlapping Chromosome Segmentation using U-Net: Convolutional Networks with Test Time Augmentation , 2019, KES.

[3]  Anne L. Martel,et al.  Loss odyssey in medical image segmentation , 2021, Medical Image Anal..

[4]  Jaesung Lee,et al.  Segmentation of individual ribs from low-dose chest CT , 2010, Medical Imaging.

[5]  Bo Chen,et al.  Topological Sweep for Multi-Target Detection of Geostationary Space Objects , 2020, IEEE Transactions on Signal Processing.

[6]  Bram van Ginneken,et al.  Automatic delineation of ribs in frontal chest radiographs , 2000, Medical Imaging: Image Processing.

[7]  Qingmao Hu,et al.  An Automatic Rib Segmentation Method on X-Ray Radiographs , 2015, MMM.

[8]  Frédo Durand,et al.  Data augmentation using learned transforms for one-shot medical image segmentation , 2019, ArXiv.

[9]  Joel J. P. C. Rodrigues,et al.  A novel deep learning based framework for the detection and classification of breast cancer using transfer learning , 2019, Pattern Recognit. Lett..

[10]  Yue Zhang,et al.  Task Driven Generative Modeling for Unsupervised Domain Adaptation: Application to X-ray Image Segmentation , 2018, MICCAI.

[11]  Chunhua Shen,et al.  DoDNet: Learning to Segment Multi-Organ and Tumors from Multiple Partially Labeled Datasets , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jingjing Lu,et al.  High-Resolution Chest X-Ray Bone Suppression Using Unpaired CT Structural Priors , 2020, IEEE Transactions on Medical Imaging.

[13]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[14]  Yuling Xi,et al.  Stimulus-driven and concept-driven analysis for image caption generation , 2020, Neurocomputing.

[15]  Jefersson Alex dos Santos,et al.  From 3D to 2D: Transferring knowledge for rib segmentation in chest X-rays , 2020, Pattern Recognit. Lett..

[16]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[17]  Qirong Bu,et al.  MDU-Net: A Convolutional Network for Clavicle and Rib Segmentation from a Chest Radiograph , 2020, Journal of healthcare engineering.

[18]  Xiangjian He,et al.  Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges , 2019, Journal of Digital Imaging.

[19]  Oliver Díaz,et al.  DCGANs for realistic breast mass augmentation in x-ray mammography , 2020, Medical Imaging.

[20]  Genggeng Qin,et al.  Generating Dual-Energy Subtraction Soft-Tissue Images from Chest Radiographs via Bone Edge-Guided GAN , 2020, MICCAI.

[21]  Shuyue Guan,et al.  Breast cancer detection using synthetic mammograms from generative adversarial networks in convolutional neural networks , 2019, Journal of medical imaging.

[22]  Liang Huang,et al.  Data Augmentation for Deep Learning-Based Radio Modulation Classification , 2019, IEEE Access.

[23]  Yu Zhao,et al.  Knowledge-Aided Convolutional Neural Network for Small Organ Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[24]  Qianjin Feng,et al.  Automatic delineation of ribs and clavicles in chest radiographs using fully convolutional DenseNets , 2019, Comput. Methods Programs Biomed..

[25]  Hasan Ogul,et al.  Unsupervised Rib Delineation in Chest Radiographs by an Integrative Approach , 2015, VISAPP.

[26]  Shuai Wang,et al.  Asymmetrical Multi-task Attention U-Net for the Segmentation of Prostate Bed in CT Image , 2020, MICCAI.

[27]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[28]  Seba Susan,et al.  Data Augmentation of Minority Class with Transfer Learning for Classification of Imbalanced Breast Cancer Dataset Using Inception-V3 , 2019, IbPRIA.

[29]  Muhammad Zakarya,et al.  Exploiting dynamic spatio-temporal correlations for citywide traffic flow prediction using attention based neural networks , 2021, Inf. Sci..

[30]  Bram van Ginneken,et al.  Segmentation of the posterior ribs in chest radiographs using iterated contextual pixel classification , 2006, IEEE Transactions on Medical Imaging.

[31]  Gábor Horváth,et al.  Segmentation of Anatomical Structures on Chest Radiographs , 2010 .

[32]  John W. Fisher,et al.  Dreaming More Data: Class-dependent Distributions over Diffeomorphisms for Learned Data Augmentation , 2015, AISTATS.

[33]  S. Tabik,et al.  COVIDGR Dataset and COVID-SDNet Methodology for Predicting COVID-19 Based on Chest X-Ray Images , 2020, IEEE Journal of Biomedical and Health Informatics.

[34]  Matthew B. Blaschko,et al.  The Lovasz-Softmax Loss: A Tractable Surrogate for the Optimization of the Intersection-Over-Union Measure in Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Thomas Canhao Xu,et al.  Segmentation of Lung in Chest Radiographs Using Hull and Closed Polygonal Line Method , 2019, IEEE Access.

[36]  Haibin Cai,et al.  Leveraging Spatio-Temporal Patterns for Predicting Citywide Traffic Crowd Flows Using Deep Hybrid Neural Networks , 2019, 2019 IEEE 25th International Conference on Parallel and Distributed Systems (ICPADS).

[37]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[38]  Muhammad Zakarya,et al.  A data aggregation based approach to exploit dynamic spatio-temporal correlations for citywide crowd flows prediction in fog computing , 2021, Multimedia Tools and Applications.

[39]  Abbas Sharifi,et al.  Diagnosis and detection of infected tissue of COVID-19 patients based on lung x-ray image using convolutional neural network approaches , 2020, Chaos, Solitons & Fractals.

[40]  Jianhua Lu,et al.  Dense Convolutional Networks for Semantic Segmentation , 2019, IEEE Access.

[41]  Ulas Bagci,et al.  Atlas-based rib-bone detection in chest X-rays , 2016, Comput. Medical Imaging Graph..

[42]  Wei Guo,et al.  Rib Segmentation in Chest Radiographs by Support Vector Machine , 2016 .