Compressed dynamic mesh sequence for progressive streaming

Dynamic mesh sequence (DMS) is a simple and accurate representation for precisely recording a 3D animation sequence. Despite its simplicity, this representation is typically large in data size, making storage and transmission expensive. This paper presents a novel framework that allows effective DMS compression and progressive streaming by eliminating spatial and temporal redundancy. To explore temporal redundancy, we propose a temporal frame‐clustering algorithm to organize DMS frames by their motion trajectory changes, eliminating intracluster redundancy by principal component analysis dimensionality reduction. To eliminate spatial redundancy, we propose an algorithm to transform the coordinates of mesh vertex trajectory into a decorrelated trajectory space, generating a new spatially nonredundant trajectory representation. We finally apply a spectral graph wavelet transform with color set partitioning embedded block encoding to turn the resultant DMS into a multiresolution representation to support progressive streaming. Experiment results show that our method outperforms several existing methods in terms of storage requirement and reconstruction quality.

[1]  Marc Antonini,et al.  Motion-Based Geometry Compensation for DWT Compression of 3D mesh Sequences , 2007, 2007 IEEE International Conference on Image Processing.

[2]  Steven J. Gortler,et al.  Geometry images , 2002, SIGGRAPH.

[3]  Rynson W. H. Lau,et al.  Game-on-demand:: An online game engine based on geometry streaming , 2011, TOMCCAP.

[4]  Sheng-Fuu Lin,et al.  Hybrid Image Compression Based on Set-Partitioning Embedded Block Coder and Residual Vector Quantization , 2010, J. Inf. Sci. Eng..

[5]  Guoliang Luo,et al.  Compression of 3D mesh sequences by temporal segmentation , 2013, Comput. Animat. Virtual Worlds.

[6]  Marc Antonini,et al.  Wavelet-based Compression of 3D Mesh Sequences , 2005 .

[7]  Shakeel Ahmad,et al.  Optimal Packet Loss Protection of Progressively Compressed 3-D Meshes , 2009, IEEE Transactions on Multimedia.

[8]  Ghassan Al-Regib,et al.  Multistreaming of 3-D Scenes With Optimized Transmission and Rendering Scalability , 2007, IEEE Transactions on Multimedia.

[9]  Rémy Prost,et al.  3-D Dynamic Mesh Compression using Wavelet-Based Multiresolution Analysis , 2006, 2006 International Conference on Image Processing.

[10]  Libor Vása,et al.  Compressing dynamic meshes with geometric laplacians , 2014, Comput. Graph. Forum.

[11]  Libor Vása Optimised mesh traversal for dynamic mesh compression , 2011, Graph. Model..

[12]  Lap-Pui Chau,et al.  A Fuzzy Clustering Algorithm for Virtual Character Animation Representation , 2011, IEEE Transactions on Multimedia.

[13]  Roberto Marcondes Cesar Junior,et al.  Shape Analysis Using the Spectral Graph Wavelet Transform , 2013, e-Science.

[14]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[15]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[16]  Bing Zhou,et al.  An Efficient Method of Crowd Aggregation Computation in Public Areas , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Héctor M. Briceño,et al.  New representation for 3D animations , 2003 .

[18]  Jed Lengyel,et al.  Compression of time-dependent geometry , 1999, SI3D.

[19]  Bin Yu,et al.  Feature learning based on SAE-PCA network for human gesture recognition in RGBD images , 2015, Neurocomputing.

[20]  Ralf Sarlette,et al.  Simple and efficient compression of animation sequences , 2005, SCA '05.

[21]  Yin Yang,et al.  Interactive mechanism modeling from multi-view images , 2016, ACM Trans. Graph..

[22]  Rémy Prost,et al.  3-D mesh sequence compression using wavelet-based multi-resolution analysis , 2010, Appl. Math. Comput..

[23]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[24]  Wolfgang Straßer,et al.  Efficient Compression of 3D Dynamic Mesh Sequences , 2007, J. WSCG.

[25]  L. Vasa,et al.  CODDYAC: Connectivity Driven Dynamic Mesh Compression , 2007, 2007 3DTV Conference.

[26]  Michele Sanna,et al.  Enabling Geometry-Based 3-D Tele-Immersion With Fast Mesh Compression and Linear Rateless Coding , 2014, IEEE Transactions on Multimedia.

[27]  Xun Wang,et al.  Visual saliency guided textured model simplification , 2016, The Visual Computer.

[28]  Jörn Ostermann,et al.  SPC: Fast and Efficient Scalable Predictive Coding of Animated Meshes , 2010, Comput. Graph. Forum.

[29]  Václav Skala,et al.  Geometry‐Driven Local Neighbourhood Based Predictors for Dynamic Mesh Compression , 2010, Comput. Graph. Forum.

[30]  Roger W. Barnard,et al.  Preservation of local dynamics when applying central difference methods: application to SIR model , 2007 .

[31]  Rémy Prost,et al.  A 3-D Mesh Sequence Coding Using the Combination of Spatial and Temporal Wavelet Analysis , 2007, MIRAGE.

[32]  Xuelong Li,et al.  Lazy Random Walks for Superpixel Segmentation , 2014, IEEE Transactions on Image Processing.

[33]  Yücel Altunbasak,et al.  An unequal error protection method for progressively transmitted 3D models , 2005, IEEE Transactions on Multimedia.

[34]  Rongrong Ji,et al.  Learning-Based Shadow Recognition and Removal From Monochromatic Natural Images , 2017, IEEE Transactions on Image Processing.

[35]  Ling Shao,et al.  Real-Time Superpixel Segmentation by DBSCAN Clustering Algorithm , 2016, IEEE Transactions on Image Processing.

[36]  Chang-Su Kim,et al.  Efficient Fine-Granular Scalable Coding of 3D Mesh Sequences , 2013, IEEE Transactions on Multimedia.

[37]  Irene Cheng,et al.  Perceptually Guided Fast Compression of 3-D Motion Capture Data , 2011, IEEE Transactions on Multimedia.

[38]  Erkki Oja,et al.  The nonlinear PCA learning rule in independent component analysis , 1997, Neurocomputing.

[39]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[40]  Andrei Khodakovsky,et al.  Wavelet compression of parametrically coherent mesh sequences , 2004, SCA '04.

[41]  Jarek Rossignac,et al.  Dynapack: space-time compression of the 3D animations of triangle meshes with fixed connectivity , 2003, SCA '03.