Motion-Aware Compression and Transmission of Mesh Animation Sequences

With the increasing demand in using 3D mesh data over networks, supporting effective compression and efficient transmission of meshes has caught lots of attention in recent years. This article introduces a novel compression method for 3D mesh animation sequences, supporting user-defined and progressive transmissions over networks. Our motion-aware approach starts with clustering animation frames based on their motion similarities, dividing a mesh animation sequence into fragments of varying lengths. This is done by a novel temporal clustering algorithm, which measures motion similarity based on the curvature and torsion of a space curve formed by corresponding vertices along a series of animation frames. We further segment each cluster based on mesh vertex coherence, representing topological proximity within an object under certain motion. To produce a compact representation, we perform intra-cluster compression based on Graph Fourier Transform (GFT) and Set Partitioning In Hierarchical Trees (SPIHT) coding. Optimized compression results can be achieved by applying GFT due to the proximity in vertex position and motion. We adapt SPIHT to support progressive transmission and design a mechanism to transmit mesh animation sequences with user-defined quality. Experimental results show that our method can obtain a high compression ratio while maintaining a low reconstruction error.

[1]  Rachida Amjoun,et al.  Compression of static and dynamic three-dimensional meshes , 2009 .

[2]  Konstantinos Moustakas,et al.  Adaptive compression of animated meshes by exploiting orthogonal iterations , 2017, The Visual Computer.

[3]  Jarek Rossignac,et al.  Dynapack: space-time compression of the 3D animations of triangle meshes with fixed connectivity , 2003, SCA '03.

[4]  Jörn Ostermann,et al.  Connectivity-Guided Predictive Compression of Dynamic 3D Meshes , 2006, 2006 International Conference on Image Processing.

[5]  Marc Antonini,et al.  Temporal wavelet-based compression for 3D animated models , 2007, Comput. Graph..

[6]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[7]  Rynson W. H. Lau,et al.  Game-on-demand:: An online game engine based on geometry streaming , 2011, TOMCCAP.

[8]  Céline Hudelot,et al.  Taylor Prediction for Mesh Geometry Compression , 2011, Comput. Graph. Forum.

[9]  Bin Shyan Jong,et al.  Representing Progressive Dynamic 3D Meshes and Applications , 2010, 2010 18th Pacific Conference on Computer Graphics and Applications.

[10]  Andrei Khodakovsky,et al.  Wavelet compression of parametrically coherent mesh sequences , 2004, SCA '04.

[11]  N. Stefanoski,et al.  Frame-based compression of animated meshes in MPEG-4 , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[12]  Václav Skala,et al.  Geometry‐Driven Local Neighbourhood Based Predictors for Dynamic Mesh Compression , 2010, Comput. Graph. Forum.

[13]  Wolfgang Straßer,et al.  Compression of Complex Animated Meshes , 2006, Computer Graphics International.

[14]  Libor V ´ ÿ Geometry-Driven Local Neighbourhood Based Predictors for Dynamic Mesh Compression , 2010 .

[15]  Aljoscha Smolic,et al.  Rate-Distortion Optimization in Dynamic Mesh Compression , 2006, 2006 International Conference on Image Processing.

[16]  Sang Uk Lee,et al.  Progressive coding of 3D dynamic mesh sequences using spatiotemporal decomposition , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[17]  Václav Skala,et al.  COBRA: Compression of the Basis for PCA Represented Animations , 2009, Comput. Graph. Forum.

[18]  Konrad Polthier,et al.  FreeLence ‐ Coding with Free Valences , 2005, Comput. Graph. Forum.

[19]  Jörn Ostermann,et al.  SPC: Fast and Efficient Scalable Predictive Coding of Animated Meshes , 2010, Comput. Graph. Forum.

[20]  Hoseyn Sayyaadi,et al.  Thermoeconomic optimization of multi effect distillation desalination systems , 2010 .

[21]  Ashraf A. Kassim,et al.  Compression of Dynamic 3D Geometry Data Using Iterative Closest Point Algorithm , 2002, Comput. Vis. Image Underst..

[22]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[23]  Rémy Prost,et al.  3-D mesh sequence compression using wavelet-based multi-resolution analysis , 2010, Appl. Math. Comput..

[24]  Libor Vása,et al.  Perceptual Metrics for Static and Dynamic Triangle Meshes , 2013, Eurographics.

[25]  Gozde Bozdagi Akar,et al.  Improved prediction methods for scalable predictive animated mesh compression , 2011, J. Vis. Commun. Image Represent..

[26]  Wolfgang Straßer,et al.  Single-rate near lossless compression of animated geometry , 2009, Comput. Aided Des..

[27]  Ralf Sarlette,et al.  Simple and efficient compression of animation sequences , 2005, SCA '05.

[28]  Subramanian Ramanathan,et al.  Impact of vertex clustering on registration-based 3D dynamic mesh coding , 2008, Image Vis. Comput..

[29]  Marc Antonini,et al.  Wavelet-based Compression of 3D Mesh Sequences , 2005 .

[30]  Scott Hauck,et al.  SPIHT image compression on FPGAs , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Peter Eisert,et al.  Predictive compression of dynamic 3D meshes , 2005, IEEE International Conference on Image Processing 2005.

[32]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[33]  Mike M. Chow Optimized geometry compression for real-time rendering , 1997 .

[34]  Guoliang Luo,et al.  Compression of 3D mesh sequences by temporal segmentation , 2013, Comput. Animat. Virtual Worlds.

[35]  Valerio Pascucci,et al.  Single Resolution Compression of Arbitrary Triangular Meshes with Properties , 1999, Data Compression Conference.

[36]  Francoise Preteux,et al.  A skinning approach for dynamic 3D mesh compression: Research Articles , 2006 .

[37]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[38]  Jan Dvorák,et al.  Error propagation control in Laplacian mesh compression , 2018, Comput. Graph. Forum.

[39]  Titus B. Zaharia,et al.  A skinning approach for dynamic 3D mesh compression , 2006, Comput. Animat. Virtual Worlds.

[40]  Chang-Su Kim,et al.  Efficient Fine-Granular Scalable Coding of 3D Mesh Sequences , 2013, IEEE Transactions on Multimedia.

[41]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Wolfgang Straßer,et al.  Real time compression of triangle mesh connectivity , 1998, SIGGRAPH.

[43]  F. Gurgen,et al.  Compressing Mesh Geometry using Spectral Methods and a Set Partitioning Approach , 2006, 2006 IEEE 14th Signal Processing and Communications Applications.

[44]  Jed Lengyel,et al.  Compression of time-dependent geometry , 1999, SI3D.

[45]  Marco Attene,et al.  SwingWrapper: Retiling triangle meshes for better edgebreaker compression , 2003, TOGS.

[46]  L. Vasa,et al.  Exploiting Connectivity to Improve the Tangential Part of Geometry Prediction , 2013, IEEE Transactions on Visualization and Computer Graphics.