NLME: a nonlinear motion estimation-based compression method for animated mesh sequence

This paper proposes an efficient compression algorithm for animated three-dimensional meshes by introducing nonlinear transformations to model the motion field of deforming patches. First, a segmentation process is applied to separate the 3D model into different patches which have similar motion patterns through the sequence. Next, the motion of the resulting patches is accurately described by a nonlinear motion estimation model. The main idea is to exploit the temporal coherence of the geometry component by using a nonlinear predictor in order to get better approximation of vertex locations. Nonlinear motion transforms are computed at previous frame to match the subsequent ones. Moreover, an adaptive bit allocation algorithm is employed to determine the near-optimal number of bits for quantizing the prediction errors. The number of quantization bits for each segmented patch is determined by analyzing the geometry complexity of the patch and the statistical properties of the prediction errors. Finally, an extensive experimental study has been conducted to evaluate the coding efficiency of the proposed compression scheme. Simulation results demonstrate that the proposed method is very efficient in terms of rate-distortion performance, particularly for the animated models with non-rigid deformations, and outperforms the state-of-the-art methods.

[1]  William Puech,et al.  Segmentation-based compression scheme for 3D animated models , 2016, Signal Image Video Process..

[2]  Guillaume Lavoué,et al.  Rate-distortion optimization for progressive compression of 3D mesh with color attributes , 2011, The Visual Computer.

[3]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[4]  Jed Lengyel,et al.  Compression of time-dependent geometry , 1999, SI3D.

[5]  Konstantinos Moustakas,et al.  Adaptive compression of animated meshes by exploiting orthogonal iterations , 2017, The Visual Computer.

[6]  Andrei Khodakovsky,et al.  Wavelet compression of parametrically coherent mesh sequences , 2004, SCA '04.

[7]  Wojciech Matusik,et al.  Articulated mesh animation from multi-view silhouettes , 2008, ACM Trans. Graph..

[8]  Heiko Schwarz,et al.  Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  Hossein Ebrahimnezhad,et al.  Eigenspace compression: dynamic 3D mesh compression by restoring fine geometry to deformed coarse models , 2017, Multimedia Tools and Applications.

[10]  Peter Eisert,et al.  Predictive compression of dynamic 3D meshes , 2005, IEEE International Conference on Image Processing 2005.

[11]  Yo-Sung Ho,et al.  Motion-compensated compression of 3D animation models , 2001 .

[12]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[13]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[14]  Wolfgang Straßer,et al.  Efficient Compression of 3D Dynamic Mesh Sequences , 2007, J. WSCG.

[15]  Dehui Kong,et al.  Connectivity-preserving geometry images , 2014, The Visual Computer.

[16]  Titus B. Zaharia,et al.  A skinning approach for dynamic 3D mesh compression , 2006, Comput. Animat. Virtual Worlds.

[17]  Václav Skala,et al.  A Perception Correlated Comparison Method for Dynamic Meshes , 2011, IEEE Transactions on Visualization and Computer Graphics.

[18]  Pedro V. Sander,et al.  Geometry videos: a new representation for 3D animations , 2003, SCA '03.

[19]  Jörn Ostermann,et al.  Connectivity-Guided Predictive Compression of Dynamic 3D Meshes , 2006, 2006 International Conference on Image Processing.

[20]  Jinghua Zhang,et al.  Octree-based animated geometry compression , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.

[21]  Wei Liu,et al.  A survey on image-based continuum-body motion estimation , 2011, Image Vis. Comput..

[22]  Libor Vása,et al.  Compressing dynamic meshes with geometric laplacians , 2014, Comput. Graph. Forum.

[23]  Craig Gotsman,et al.  Triangle Mesh Compression , 1998, Graphics Interface.

[24]  Touradj Ebrahimi,et al.  MESH: measuring errors between surfaces using the Hausdorff distance , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[25]  Sang Uk Lee,et al.  Compression of 3-D triangle mesh sequences based on vertex-wise motion vector prediction , 2002, IEEE Trans. Circuits Syst. Video Technol..

[26]  Gozde Bozdagi Akar,et al.  Improved prediction methods for scalable predictive animated mesh compression , 2011, J. Vis. Commun. Image Represent..

[27]  Marc Antonini,et al.  Wavelet-based Compression of 3D Mesh Sequences , 2005 .

[28]  Jarek Rossignac,et al.  Dynapack: space-time compression of the 3D animations of triangle meshes with fixed connectivity , 2003, SCA '03.

[29]  Marc Antonini,et al.  Temporal wavelet-based compression for 3D animated models , 2007, Comput. Graph..

[30]  Peter Eisert,et al.  Rate-distortion-optimized predictive compression of dynamic 3D mesh sequences , 2006, Signal Process. Image Commun..

[31]  L. Vasa,et al.  CODDYAC: Connectivity Driven Dynamic Mesh Compression , 2007, 2007 3DTV Conference.

[32]  Hujun Bao,et al.  Cloth compression using local cylindrical coordinates , 2017, The Visual Computer.

[33]  N. Stefanoski,et al.  Scalable Linear Predictive Coding of Time-Consistent 3D Mesh Sequences , 2007, 2007 3DTV Conference.

[34]  Hossein Ebrahimnezhad,et al.  Predictive compression of animated 3D models by optimized weighted blending of key‐frames , 2016, Comput. Animat. Virtual Worlds.

[35]  Jörn Ostermann,et al.  SPC: Fast and Efficient Scalable Predictive Coding of Animated Meshes , 2010, Comput. Graph. Forum.

[36]  Wolfgang Straßer,et al.  Compression of Complex Animated Meshes , 2006, Computer Graphics International.

[37]  Titus B. Zaharia,et al.  Multi-Chart Geometry Video: A Compact Representation for 3D Animations , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[38]  Chen Lei,et al.  Context-Based Adaptive Binary Arithmetic Coding in the H.264/AVC , 2004 .

[39]  Jian-Jun Zhang,et al.  Adaptive motion synthesis for virtual characters: a survey , 2014, The Visual Computer.

[40]  Jinghua Zhang,et al.  Octree-based animated geometry compression , 2007, Comput. Graph..

[41]  Bin Shyan Jong,et al.  3D Animation Compression Using Affine Transformation Matrix and Principal Component Analysis , 2007, IEICE Trans. Inf. Syst..

[42]  Titus B. Zaharia,et al.  FAMC: The MPEG-4 standard for Animated Mesh Compression , 2008, 2008 15th IEEE International Conference on Image Processing.