Local Texture and Geometry Descriptors for Fast Block-Based Motion Estimation of Dynamic Voxelized Point Clouds

Motion estimation in dynamic point cloud analysis or compression is a computationally intensive procedure generally involving a large search space and often complex voxel matching functions. We present an extension and improvement on prior work to speed up block-based motion estimation between temporally adjacent point clouds. We introduce local, or block-based, texture descriptors as a complement to voxel geometry description. Descriptors are organized in an occupancy map which may be efficiently computed and stored. By consulting the map, a point cloud motion estimator may significantly reduce its search space while maintaining prediction distortion at similar quality levels. The proposed texture-based occupancy maps provide significant speedup, an average of 26.9% for the tested data set, with respect to prior work.

[1]  Nico Blodow,et al.  Real-time compression of point cloud streams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Rufael Mekuria,et al.  Emerging MPEG Standards for Point Cloud Compression , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[3]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Alexis M. Tourapis,et al.  Enhanced predictive zonal search for single and multiple frame motion estimation , 2002, IS&T/SPIE Electronic Imaging.

[5]  Rufael Mekuria,et al.  Evaluation criteria for PCC (Point Cloud Compression) , 2016 .

[6]  Sandia Report,et al.  Formulas for Robust, One-Pass Parallel Computation of Covariances and Arbitrary-Order Statistical Moments , 2008 .

[7]  Rufael Mekuria,et al.  Design, Implementation, and Evaluation of a Point Cloud Codec for Tele-Immersive Video , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Camilo C. Dorea,et al.  Block-Based Motion Estimation Speedup for Dynamic Voxelized Point Clouds , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[9]  Charles T. Loop,et al.  Real-time high-resolution sparse voxelization with application to image-based modeling , 2013, HPG '13.

[10]  Pascal Frossard,et al.  Graph-Based Compression of Dynamic 3D Point Cloud Sequences , 2015, IEEE Transactions on Image Processing.

[11]  Ricardo L. de Queiroz,et al.  Compression of 3D Point Clouds Using a Region-Adaptive Hierarchical Transform , 2016, IEEE Transactions on Image Processing.

[12]  Ernest L. Hall,et al.  Three-Dimensional Moment Invariants , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Philip A. Chou,et al.  Motion-Compensated Compression of Dynamic Voxelized Point Clouds , 2016, IEEE Transactions on Image Processing.

[14]  Charles T. Loop,et al.  Point cloud attribute compression with graph transform , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  Touradj Ebrahimi,et al.  A novel methodology for quality assessment of voxelized point clouds , 2018, Optical Engineering + Applications.