Emerging MPEG Standards for Point Cloud Compression

Due to the increased popularity of augmented and virtual reality experiences, the interest in capturing the real world in multiple dimensions and in presenting it to users in an immersible fashion has never been higher. Distributing such representations enables users to freely navigate in multi-sensory 3D media experiences. Unfortunately, such representations require a large amount of data, not feasible for transmission on today’s networks. Efficient compression technologies well adopted in the content chain are in high demand and are key components to democratize augmented and virtual reality applications. Moving Picture Experts Group, as one of the main standardization groups dealing with multimedia, identified the trend and started recently the process of building an open standard for compactly representing 3D point clouds, which are the 3D equivalent of the very well-known 2D pixels. This paper introduces the main developments and technical aspects of this ongoing standardization effort.

[1]  Ricardo L. de Queiroz,et al.  Compression of 3D Point Clouds Using a Region-Adaptive Hierarchical Transform , 2016, IEEE Transactions on Image Processing.

[2]  Henrique S. Malvar Adaptive run-length/Golomb-Rice encoding of quantized generalized Gaussian sources with unknown statistics , 2006, Data Compression Conference (DCC'06).

[3]  Silvio Savarese,et al.  Joint 2D-3D-Semantic Data for Indoor Scene Understanding , 2017, ArXiv.

[4]  Dong Tian,et al.  Trends in efficient representation of 3D point clouds , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[5]  C.-C. Jay Kuo,et al.  Technologies for 3D mesh compression: A survey , 2005, J. Vis. Commun. Image Represent..

[6]  Petros Daras,et al.  On human Time-Varying Mesh compression exploiting activity-related characteristics , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[8]  Rufael Mekuria,et al.  Requirements for point cloud compression , 2016 .

[9]  Reinhard Klein,et al.  Eurographics Symposium on Point-based Graphics (2006) Octree-based Point-cloud Compression , 2022 .

[10]  Rufael Mekuria,et al.  Use cases for point cloud compression (PCC) , 2016 .

[11]  Chris L. Jackins,et al.  Oct-trees and their use in representing three-dimensional objects , 1980 .

[12]  Sangwook Lee,et al.  Comparison of subjective video quality assessment methods for multimedia applications , 2007 .

[13]  Rufael Mekuria,et al.  Low complexity connectivity driven dynamic geometry compression for 3D Tele-Immersion , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Jarek Rossignac,et al.  Edgebreaker: Connectivity Compression for Triangle Meshes , 1999, IEEE Trans. Vis. Comput. Graph..

[15]  Pascal Frossard,et al.  Graph-Based Compression of Dynamic 3D Point Cloud Sequences , 2015, IEEE Transactions on Image Processing.

[16]  Gabriel Taubin,et al.  Geometric compression through topological surgery , 1998, TOGS.

[17]  Charles T. Loop,et al.  Real-time high-resolution sparse voxelization with application to image-based modeling , 2013, HPG '13.

[18]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[19]  Michele Sanna,et al.  A 3D tele-immersion system based on live captured mesh geometry , 2013, MMSys.

[20]  Philip A. Chou,et al.  Motion-Compensated Compression of Dynamic Voxelized Point Clouds , 2016, IEEE Transactions on Image Processing.

[21]  Dong Tian,et al.  Geometric distortion metrics for point cloud compression , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[22]  Ying Chen,et al.  Overview of the Multiview and 3D Extensions of High Efficiency Video Coding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Charles T. Loop,et al.  Point cloud attribute compression with graph transform , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[24]  Rufael Mekuria,et al.  A Basic Geometry Driven Mesh Coding Scheme with Surface Simplification for 3DTI , 2014 .

[25]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[26]  P. S. César Garcia,et al.  Report of the Formal Subjective Assessment Test of the Submission received in response to the Call for Proposals for Point Cloud Compression, Contribution to MPEG, October 2017 , 2017 .

[27]  Meenakshisundaram Gopi,et al.  A Generic Scheme for Progressive Point Cloud Coding , 2008, IEEE Transactions on Visualization and Computer Graphics.

[28]  Rufael Mekuria,et al.  Performance assessment of point cloud compression , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[29]  Nadia Magnenat-Thalmann,et al.  A novel compression framework for 3D time-varying meshes , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[30]  Titus B. Zaharia,et al.  TFAN: A low complexity 3D mesh compression algorithm , 2009, Comput. Animat. Virtual Worlds.

[31]  Craig Gotsman,et al.  Triangle Mesh Compression , 1998, Graphics Interface.

[32]  Pablo Cesar,et al.  Source coding for transmission of reconstructed dynamic geometry: a rate-distortion-complexity analysis of different approaches , 2014, Optics & Photonics - Optical Engineering + Applications.

[33]  Nico Blodow,et al.  Real-time compression of point cloud streams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[34]  Titus B. Zaharia,et al.  FAMC: The MPEG-4 standard for Animated Mesh Compression , 2008, 2008 15th IEEE International Conference on Image Processing.

[35]  Rufael Mekuria,et al.  Design, Implementation, and Evaluation of a Point Cloud Codec for Tele-Immersive Video , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Christian Früh,et al.  Constructing 3D City Models by Merging Aerial and Ground Views , 2003, IEEE Computer Graphics and Applications.