Transform Coding for Point Clouds Using a Gaussian Process Model

We propose using stationary Gaussian processes (GPs) to model the statistics of the signal on points in a point cloud, which can be considered samples of a GP at the positions of the points. Furthermore, we propose using Gaussian process transforms (GPTs), which are Karhunen–Loève transforms of the GP, as the basis of transform coding of the signal. Focusing on colored 3D point clouds, we propose a transform coder that breaks the point cloud into blocks, transforms the blocks using GPTs, and entropy codes the quantized coefficients. The GPT for each block is derived from both the covariance function of the GP and the locations of the points in the block, which are separately encoded. The covariance function of the GP is parameterized, and its parameters are sent as side information. The quantized coefficients are sorted by the eigenvalues of the GPTs, binned, and encoded using an arithmetic coder with bin-dependent Laplacian models, whose parameters are also sent as side information. Results indicate that transform coding of 3D point cloud colors using the proposed GPT and entropy coding achieves superior compression performance on most of our data sets.

[1]  Olivier Devillers,et al.  Geometric compression for interactive transmission , 2000 .

[2]  Jack Edmonds,et al.  Matching: A Well-Solved Class of Integer Linear Programs , 2001, Combinatorial Optimization.

[3]  Steven J. Gortler,et al.  Geometry images , 2002, SIGGRAPH.

[4]  Pedro V. Sander,et al.  Geometry videos: a new representation for 3D animations , 2003, SCA '03.

[5]  Ashraf A. Kassim,et al.  Registration and partitioning-based compression of 3-D dynamic data , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Dietmar Saupe,et al.  Compression of Point-Based 3D Models by Shape-Adaptive Wavelet Coding of Multi-Height Fields , 2004, PBG.

[7]  T. Matsuyama,et al.  SKIN-OFF: REPRESENTATION AND COMPRESSION SCHEME FOR 3D VIDEO , 2004 .

[8]  C.-C. Jay Kuo,et al.  Technologies for 3D mesh compression: A survey , 2005, J. Vis. Commun. Image Represent..

[9]  Reinhard Klein,et al.  Eurographics Symposium on Point-based Graphics (2006) Octree-based Point-cloud Compression , 2022 .

[10]  David R. Cox,et al.  The Oxford Dictionary of Statistical Terms , 2006 .

[11]  Kiyoharu Aizawa,et al.  Time-Varying Mesh Compression Using an Extended Block Matching Algorithm , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Meenakshisundaram Gopi,et al.  A Generic Scheme for Progressive Point Cloud Coding , 2008, IEEE Transactions on Visualization and Computer Graphics.

[13]  Václav Skala,et al.  Geometry‐Driven Local Neighbourhood Based Predictors for Dynamic Mesh Compression , 2010, Comput. Graph. Forum.

[14]  Nico Blodow,et al.  Real-time compression of point cloud streams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[15]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[16]  Philip A. Chou,et al.  Viewport: A Distributed, Immersive Teleconferencing System with Infrared Dot Pattern , 2013, IEEE MultiMedia.

[17]  Michele Sanna,et al.  A 3D tele-immersion system based on live captured mesh geometry , 2013, MMSys.

[18]  Charles T. Loop,et al.  Real-time high-resolution sparse voxelization with application to image-based modeling , 2013, HPG '13.

[19]  Florian Dörfler,et al.  Kron Reduction of Graphs With Applications to Electrical Networks , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[20]  Charles T. Loop,et al.  Point cloud attribute compression with graph transform , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[21]  Philip A. Chou,et al.  Compression of human body sequences using graph Wavelet Filter Banks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Nadia Magnenat-Thalmann,et al.  Compressing 3-D Human Motions via Keyframe-Based Geometry Videos , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Pascal Frossard,et al.  Graph-based motion estimation and compensation for dynamic 3D point cloud compression , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[24]  Alvaro Collet,et al.  High-quality streamable free-viewpoint video , 2015, ACM Trans. Graph..

[25]  Ricardo L. de Queiroz,et al.  Gaussian process transforms , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[26]  Ricardo L. de Queiroz,et al.  Compression of 3D Point Clouds Using a Region-Adaptive Hierarchical Transform , 2016, IEEE Transactions on Image Processing.

[27]  Philip A. Chou,et al.  Graph Signal Processing – A Probabilistic Framework , 2016 .