Compression Techniques for 3D Video Mesh Sequences

This paper approaches the problem of compressing temporally consistent 3D video mesh sequences with the aim of reducing the storage cost. We present an evaluation of compression techniques which apply Principal Component Analysis to the representation of the mesh in different domain spaces, and demonstrate the applicability of mesh deformation algorithms for compression purposes. A novel layered mesh representation is introduced for compression of 3D video sequences with an underlying articulated motion, such as a person with loose clothing. Comparative evaluation on captured mesh sequences of people demonstrates that this representation achieves a significant improvement in compression compared to previous techniques. Results show a compression ratio of 8-15 for an RMS error of less than 5mm.

[1]  Adrian Hilton,et al.  Global temporal registration of multiple non-rigid surface sequences , 2011, CVPR 2011.

[2]  Peter Eisert,et al.  Predictive compression of dynamic 3D meshes , 2005, IEEE International Conference on Image Processing 2005.

[3]  David Levin,et al.  Progressive Compression of Arbitrary Triangular Meshes , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[4]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[5]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[6]  Wolfgang Straßer,et al.  Efficient Compression of 3D Dynamic Mesh Sequences , 2007, J. WSCG.

[7]  O. Sorkine.  Differential Representations for Mesh Processing , 2006 .

[8]  Olga Sorkine-Hornung,et al.  On Linear Variational Surface Deformation Methods , 2008, IEEE Transactions on Visualization and Computer Graphics.

[9]  Jarek Rossignac,et al.  Dynapack: space-time compression of the 3D animations of triangle meshes with fixed connectivity , 2003, SCA '03.

[10]  Jörn Ostermann,et al.  SPC: Fast and Efficient Scalable Predictive Coding of Animated Meshes , 2010, Comput. Graph. Forum.

[11]  Craig Gotsman,et al.  Spectral compression of mesh geometry , 2000, EuroCG.

[12]  Michael Garland,et al.  Free-form motion processing , 2008, TOGS.

[13]  Kun Zhou,et al.  Gradient domain editing of deforming mesh sequences , 2007, SIGGRAPH 2007.

[14]  Ralf Sarlette,et al.  Simple and efficient compression of animation sequences , 2005, SCA '05.

[15]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..

[16]  Jovan Popović,et al.  Mesh-based inverse kinematics , 2005, SIGGRAPH 2005.

[17]  Andrei Khodakovsky,et al.  Progressive geometry compression , 2000, SIGGRAPH.

[18]  Adrian Hilton,et al.  Spatio-temporal fusion of multiple view video rate 3D surfaces , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[19]  Adrian Hilton,et al.  Space-time Editing of 3D Video Sequences , 2011, 2011 Conference for Visual Media Production.

[20]  Hans-Peter Seidel,et al.  Free-viewpoint video of human actors , 2003, ACM Trans. Graph..

[21]  Jed Lengyel,et al.  Compression of time-dependent geometry , 1999, SI3D.

[22]  Adrian Hilton,et al.  A Rigid Transform Basis for Animation Compression and Level of Detail , 2005 .

[23]  Hugues Hoppe,et al.  Displaced subdivision surfaces , 2000, SIGGRAPH.

[24]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[25]  Ilya Baran,et al.  Automatic rigging and animation of 3D characters , 2007, SIGGRAPH 2007.

[26]  Adrian Hilton,et al.  Surface Capture for Performance-Based Animation , 2007, IEEE Computer Graphics and Applications.

[27]  Hans-Peter Seidel,et al.  A volumetric approach to interactive shape editing , 2007 .

[28]  Valerio Pascucci,et al.  Multi-resolution dynamic meshes with arbitrary deformations , 2000 .

[29]  Hans-Peter Seidel,et al.  Performance capture from sparse multi-view video , 2008, SIGGRAPH 2008.

[30]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[31]  Hans-Peter Seidel,et al.  Performance Capture from Multi-View Video , 2010, Image and Geometry Processing for 3-D Cinematography.