Deep Learning-Based Point Cloud Geometry Coding: RD Control Through Implicit and Explicit Quantization

Deep learning is becoming more and more relevant for multiple multimedia processing tasks, and lately it has raised much interest in the coding arena notably for images and point clouds. While offering near state-of-the-art compression performance, current deep learning-based point cloud coding solutions have a shortcoming since they require training and storing multiple models in order to obtain different rate-distortion trade-offs. This paper proposes a solution that effectively reduces the number of deep learning models that need to be trained and stored by applying explicit quantization to the latent representation, which can be controlled at coding time, to generate varying rate-distortion tradeoffs. The proposed implicit-explicit quantization combination achieves a compression performance that is equivalent or better than the alternative, while significantly reducing the model storage memory requirements.

[1]  Reinhard Klein,et al.  Eurographics Symposium on Point-based Graphics (2006) Octree-based Point-cloud Compression , 2022 .

[2]  Rufael Mekuria,et al.  Emerging MPEG Standards for Point Cloud Compression , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[3]  Valero Laparra,et al.  End-to-end Optimized Image Compression , 2016, ICLR.

[4]  Titus B. Zaharia,et al.  3D Point Cloud Compression: A Survey , 2019, Web3D.

[5]  David Minnen,et al.  Joint Autoregressive and Hierarchical Priors for Learned Image Compression , 2018, NeurIPS.

[6]  Madhukar Budagavi,et al.  Video-Based Point-Cloud-Compression Standard in MPEG: From Evidence Collection to Committee Draft [Standards in a Nutshell] , 2019, IEEE Signal Processing Magazine.

[7]  Touradj Ebrahimi,et al.  JPEG Pleno: Toward an Efficient Representation of Visual Reality , 2016, IEEE MultiMedia.

[8]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Nuno M. M. Rodrigues,et al.  Point Cloud Coding: Adopting a Deep Learning-based Approach , 2019, 2019 Picture Coding Symposium (PCS).

[10]  Nuno M. M. Rodrigues,et al.  Deep Learning-Based Point Cloud Coding: A Behavior and Performance Study , 2019, 2019 8th European Workshop on Visual Information Processing (EUVIP).

[11]  Giuseppe Valenzise,et al.  Learning Convolutional Transforms for Lossy Point Cloud Geometry Compression , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[12]  Dietmar Saupe,et al.  Compression of Point-Based 3D Models by Shape-Adaptive Wavelet Coding of Multi-Height Fields , 2004, PBG.

[13]  Rufael Mekuria,et al.  Point-Cloud Compression: Moving Picture Experts Group's New Standard in 2020 , 2019, IEEE Consumer Electronics Magazine.

[14]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Andreas Nüchter,et al.  3D point cloud compression using conventional image compression for efficient data transmission , 2015, 2015 XXV International Conference on Information, Communication and Automation Technologies (ICAT).

[16]  David Minnen,et al.  Variational image compression with a scale hyperprior , 2018, ICLR.

[17]  Nico Blodow,et al.  Real-time compression of point cloud streams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[18]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.