Example-Based Super-Resolution for Point-Cloud Video

We propose a mixed-resolution point-cloud representation and an example-based super-resolution framework, from which several processing tools can be derived, such as compression, denoising and error concealment. By inferring the high-frequency content of low-resolution frames based on the similarities between adjacent full-resolution frames, the proposed framework achieves an average 1.18 dB gain over lowpass versions of the point-cloud, for a projection-based distortion metric [1], [2].

[1]  Charles T. Loop,et al.  Holoportation: Virtual 3D Teleportation in Real-time , 2016, UIST.

[2]  Philip A. Chou,et al.  Distance-Based Probability Model for Octree Coding , 2018, IEEE Signal Processing Letters.

[3]  Vijayan K. Asari,et al.  Dense point-cloud creation using superresolution for a monocular 3D reconstruction system , 2012, Defense + Commercial Sensing.

[4]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[5]  Philip A. Chou,et al.  Motion-Compensated Compression of Dynamic Voxelized Point Clouds , 2016, IEEE Transactions on Image Processing.

[6]  Donald Meagher,et al.  Geometric modeling using octree encoding , 1982, Computer Graphics and Image Processing.

[7]  Edson M. Hung,et al.  Video Super-Resolution Using Codebooks Derived From Key-Frames , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Alvaro Collet,et al.  High-quality streamable free-viewpoint video , 2015, ACM Trans. Graph..

[9]  Uma Mudenagudi,et al.  3D Object Super Resolution using Metric Tensor and Christoffel Symbols , 2014, ICVGIP.

[10]  Ricardo L. de Queiroz,et al.  Context-based octree coding for point-cloud video , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[11]  Dong Tian,et al.  Geometric distortion metrics for point cloud compression , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[12]  Anastasis A. Sofokleous,et al.  Review: H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia , 2005, Comput. J..

[13]  Edson M. Hung,et al.  Example-based Enhancement of Degraded Video , 2014, IEEE Signal Processing Letters.

[14]  Erickson R. Nascimento,et al.  A Methodology for Obtaining Super-Resolution Images and Depth Maps from RGB-D Data , 2015 .

[15]  Ricardo L. de Queiroz,et al.  Compression of 3D Point Clouds Using a Region-Adaptive Hierarchical Transform , 2016, IEEE Transactions on Image Processing.