Generative Model based Highly Efficient Semantic Communication Approach for Image Transmission

Deep learning (DL) based semantic communication methods have been explored to transmit images efficiently in recent years. In this paper, we propose a generative model based semantic communication to further improve the efficiency of image transmission and protect private information. In particular, the transmitter extracts the interpretable latent representation from the original image by a generative model exploiting the GAN inversion method. We also employ a privacy filter and a knowledge base to erase private information and replace it with natural features in the knowledge base. The simulation results indicate that our proposed method achieves comparable quality of received images while significantly reducing communication costs compared to the existing methods.

[1]  Zhiguo Shi,et al.  Ziv-Zakai Bound for DOAs Estimation , 2022, IEEE Transactions on Signal Processing.

[2]  Zhongwei Si,et al.  Perceptual Learned Source-Channel Coding for High-Fidelity Image Semantic Transmission , 2022, GLOBECOM 2022 - 2022 IEEE Global Communications Conference.

[3]  Jiming Chen,et al.  Wireless Transmission of Images with the Assistance of Multi-level Semantic Information , 2022, 2022 International Symposium on Wireless Communication Systems (ISWCS).

[4]  Xiaohui Shen,et al.  SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editing , 2021, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Xiaoming Tao,et al.  Deep Learning-Based Image Semantic Coding for Semantic Communications , 2021, 2021 IEEE Global Communications Conference (GLOBECOM).

[6]  Deniz Gündüz,et al.  Wireless Image Retrieval at the Edge , 2020, IEEE Journal on Selected Areas in Communications.

[7]  Ivan Kobyzev,et al.  Normalizing Flows: An Introduction and Review of Current Methods , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Yuexian Zou,et al.  Semanticgan: Generative Adversarial Networks For Semantic Image To Photo-Realistic Image Translation , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Lingyun Wu,et al.  MaskGAN: Towards Diverse and Interactive Facial Image Manipulation , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Peter Wonka,et al.  Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space? , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  David Burth Kurka,et al.  Deep Joint Source-Channel Coding for Wireless Image Transmission , 2018, IEEE Transactions on Cognitive Communications and Networking.

[12]  Alexei A. Efros,et al.  The Unreasonable Effectiveness of Deep Features as a Perceptual Metric , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Vincent Dumoulin,et al.  Generative Adversarial Networks: An Overview , 2017, 1710.07035.

[14]  Samy Bengio,et al.  Density estimation using Real NVP , 2016, ICLR.

[15]  Peer,et al.  Privacy–Enhancing Face Biometrics: A Comprehensive Survey , 2021, IEEE Transactions on Information Forensics and Security.