A Sub-Partitioning Method for Point Cloud Inter-prediction Coding

In recent years, 3D point clouds have gained more attention with the possibility of applications such as virtual reality, autonomous vehicles and 3D mapping of historical artifacts, among others. However, raw point clouds generate very large amounts of data. Thus, compression is essential to enable emerging 3D systems for communication and storage.This paper presents an inter prediction technique based on the ICP algorithm and variable-size macroblocks that can be used to significantly reduce the number of bits required to represent a point cloud video sequence by inter coding the geometry information. Since consecutive frames in dynamic point cloud sequences are not guaranteed to fill the exact same 3D volume, a spatial alignment step before motion estimation is required to increase the likelihood of good matchings and thus generate a high number of inter-coded macroblocks. A decision step is also included in order to select the most favorable coding mode: intra-coding, inter-coding or inter-coding with macroblock subdivision. The proposed technique was tested in the PCC MPEG reference software and four MPEG test sequences, obtaining average bitrate reductions of about 8% with PSNR gains up to 1dB.

[1]  Nico Blodow,et al.  Real-time compression of point cloud streams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Philip A. Chou,et al.  Motion-Compensated Compression of Dynamic Voxelized Point Clouds , 2016, IEEE Transactions on Image Processing.

[3]  Rufael Mekuria,et al.  Performance assessment of point cloud compression , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[4]  Ricardo L. de Queiroz,et al.  Context-based octree coding for point-cloud video , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[5]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Reinhard Klein,et al.  Eurographics Symposium on Point-based Graphics (2006) Octree-based Point-cloud Compression , 2022 .

[8]  Gauthier Lafruit,et al.  Technical report of the joint ad hoc group for digital representations of light/sound fields for immersive media applications , 2016 .

[9]  Rufael Mekuria,et al.  Design, Implementation, and Evaluation of a Point Cloud Codec for Tele-Immersive Video , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Pascal Frossard,et al.  Graph-based motion estimation and compensation for dynamic 3D point cloud compression , 2015, 2015 IEEE International Conference on Image Processing (ICIP).