The New MPEG-4/FAMC Standard for Animated 3D Mesh Compression

This paper presents a new compression technique for 3D dynamic meshes, referred to as FAMC - Frame-based Animated Mesh Compression, recently promoted within the MPEG-4 standard as Amen-dement 2 of part 16 (AFX -Animation Framework extension). The FAMC approach combines a model-based motion-compensation strategy with transform/predictive coding of residual errors. First, a skinning motion-compensation model is automatically derived from a frame-based representation. Subsequently, either 1) DCT/lifting wavelets or 2) layer-based predictive coding is employed to exploit remaining spatio-temporal correlations in the residual signal. Both motion model parameters and residual signal components are finally encoded by using context-based adaptive binary arithmetic coding (CABAC). The proposed FAMC encoder offers high compression performance with gains of 60% in terms of bit-rate savings relative to previous MPEG-4 technology and of 20% to 40% relative to state-of-the-art techniques. FAMC is well suited for compressing both geometric and photometric (normal vectors, colors...) attributes. In addition, FAMC also supports a rich set of functionalities including streaming, scalability (spatial, temporal and quality) and progressive transmission.

[1]  James D. K. Kim,et al.  Interpolator data compression for MPEG-4 animation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Titus B. Zaharia,et al.  Multi-Chart Geometry Video: A Compact Representation for 3D Animations , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[3]  Francoise Preteux,et al.  A preliminary evaluation of 3D mesh animation coding techniques , 2005, SPIE Optics + Photonics.

[4]  Titus B. Zaharia,et al.  A skinning approach for dynamic 3D mesh compression , 2006, Comput. Animat. Virtual Worlds.

[5]  Jörn Ostermann,et al.  Layered Predictive Coding of Time-Consistent Dynamic 3D Meshes using a Non-Linear Predictor , 2007, 2007 IEEE International Conference on Image Processing.

[6]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[7]  Heiko Schwarz,et al.  Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Iso/iec 14496-2 Information Technology — Coding of Audio-visual Objects — Part 2: Visual , 2022 .

[9]  Detlev Marpe,et al.  Efficient representation and coding of prediction residuals and parameters in frame-based animated mesh compression , 2008, 2008 15th IEEE International Conference on Image Processing.

[10]  Aljoscha Smolic,et al.  Rate-Distortion Optimization in Dynamic Mesh Compression , 2006, 2006 International Conference on Image Processing.

[11]  Ralf Sarlette,et al.  Simple and efficient compression of animation sequences , 2005, SCA '05.

[12]  L. Vasa,et al.  CODDYAC: Connectivity Driven Dynamic Mesh Compression , 2007, 2007 3DTV Conference.

[13]  Jed Lengyel,et al.  Compression of time-dependent geometry , 1999, SI3D.

[14]  Marc Antonini,et al.  Motion-Based Geometry Compensation for DWT Compression of 3D mesh Sequences , 2007, 2007 IEEE International Conference on Image Processing.

[15]  I. Daubechies,et al.  Wavelet Transforms That Map Integers to Integers , 1998 .

[16]  Adrian Hilton,et al.  A Rigid Transform Basis for Animation Compression and Level of Detail , 2005 .