Cross-Modality Breast Image Translation with Improved Resolution Using Generative Adversarial Networks

Unpaired cross domain medical image translation is a challenging problem as the target image modality cannot be mapped directly from the input data distribution. The best approach used till date, was by Cycle generative adversarial network, which utilized the cycle consistency loss to perform the task. Although efficient, still the resultant image size was small and blurry. Recent trends show that due to change in lifestyle and increased exposure to carcinogens in different forms has increased occurrence of cancer. Statistics show that every one in eight women might develop breast cancer at some stage of her life. Hence, this paper focuses on a combination of two GANs, CycleGAN and Super resolution GAN is used in two stages to obtain translated breast images with improved resolution. The proposed model is tested on images of breast cancer patients to obtain CT Scan using PET scan and vice versa so that the patients are not exposed to an extremely potent dose of radiation. In order to ensure the presence of tumour in the estimated image, a simplified U-net feature extractor is also used. Quantitative studies are carried out for both the stages of simulation to establish the efficiency of the proposed model.

[1]  Ciarán M Lee,et al.  Improving the accuracy of medical diagnosis with causal machine learning , 2020, Nature Communications.

[2]  Hayit Greenspan,et al.  Cross-Modality Synthesis from CT to PET using FCN and GAN Networks for Improved Automated Lesion Detection , 2018, Eng. Appl. Artif. Intell..

[3]  Sotirios A. Tsaftaris,et al.  Adversarial Image Synthesis for Unpaired Multi-modal Cardiac Data , 2017, SASHIMI@MICCAI.

[4]  Hossein Ghayoumi Zadeh,et al.  Breast Cancer Diagnosis Based on Feature Extraction Using Dynamic Models of Thermal Imaging and Deep Autoencoder Neural Networks , 2021 .

[5]  Dimitris N. Metaxas,et al.  StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Dinggang Shen,et al.  Craniomaxillofacial Bony Structures Segmentation from MRI with Deep-Supervision Adversarial Learning , 2018, MICCAI.

[8]  David Dagan Feng,et al.  Synthesis of Positron Emission Tomography (PET) Images via Multi-channel Generative Adversarial Networks (GANs) , 2017, CMMI/RAMBO/SWITCH@MICCAI.

[9]  Ping Tan,et al.  DualGAN: Unsupervised Dual Learning for Image-to-Image Translation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[10]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  R. Preetha,et al.  RETRACTED ARTICLE: Early diagnose breast cancer with PCA-LDA based FER and neuro-fuzzy classification system , 2020, Journal of Ambient Intelligence and Humanized Computing.

[12]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Preliminary study of AI-assisted diagnosis using FDG-PET/CT for axillary lymph node metastasis in patients with breast cancer , 2021, EJNMMI Research.

[14]  D. Trauchessec,et al.  Clinical implementation of PLANET®Dose for dosimetric assessment after [177Lu]Lu-DOTA-TATE: comparison with Dosimetry Toolkit® and OLINDA/EXM® V1.0 , 2020 .

[15]  Su Ruan,et al.  Medical Image Synthesis with Context-Aware Generative Adversarial Networks , 2016, MICCAI.

[16]  Yu Qiao,et al.  ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks , 2018, ECCV Workshops.

[17]  Hamada R. H. Al-Absi,et al.  DiaNet: A Deep Learning Based Architecture to Diagnose Diabetes Using Retinal Images Only , 2021, IEEE Access.

[18]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[19]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[20]  J. Roper,et al.  Synthetic dual-energy CT for MRI-only based proton therapy treatment planning using label-GAN , 2021, Physics in medicine and biology.

[21]  Debashis Nandi,et al.  Filtering Super-Resolution Scan Conversion of Medical Ultrasound Frames , 2020, Wirel. Pers. Commun..

[22]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[23]  Rob Fergus,et al.  Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks , 2015, NIPS.

[24]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[25]  Kehong Yuan,et al.  More Reliable AI Solution: Breast Ultrasound Diagnosis Using Multi-AI Combination , 2021, ArXiv.