Bit allocation of vertices and colors for patch-based coding in time-varying meshes

This paper discusses bit-rate assignments for vertices, color, reference frames, and target frames in the patch-based compression method for time-varying meshes (TVMs). TVMs are nonisomorphic 3D mesh sequences of the real-world objects generated from multiview images. Experimental results demonstrate that the bit rate for vertices greatly affects the visual quality of the rendered 3D model, whereas the bit rate for color does not contribute to quality improvement. Therefore, as many bits as possible should be assigned to vertices, with 8–10 bits per vertex (bpv) per frame being sufficient for color. For interframe coding, the visual quality is improved in proportion to the bit rate of both vertices and color. However, it is demonstrated that the use of fewer bits (5∼6 bpv) is sufficient to achieve a visual quality that matches the intraframe visual quality.

[1]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[2]  Heung-Yeung Shum,et al.  Image-Based Rendering and Synthesis , 2007, IEEE Signal Processing Magazine.

[3]  Kiyoharu Aizawa,et al.  Geometry compression for time-varying meshes using coarse and fine levels of quantization and run-length encoding , 2008, 2008 15th IEEE International Conference on Image Processing.

[4]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[5]  Kiyoharu Aizawa,et al.  Time-Varying Mesh Compression Using an Extended Block Matching Algorithm , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  T. Matsuyama,et al.  SKIN-OFF: REPRESENTATION AND COMPRESSION SCHEME FOR 3D VIDEO , 2004 .

[7]  Kiyoharu Aizawa,et al.  Patch-based compression for Time-Varying Meshes , 2010, 2010 IEEE International Conference on Image Processing.

[8]  Takashi Matsuyama,et al.  Simultaneous super-resolution and 3D video using graph-cuts , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Adrian Hilton,et al.  Surface Capture for Performance-Based Animation , 2007, IEEE Computer Graphics and Applications.

[10]  Craig Gotsman,et al.  Spectral compression of mesh geometry , 2000, EuroCG.

[11]  Hans-Peter Seidel,et al.  Performance capture from sparse multi-view video , 2008, SIGGRAPH 2008.

[12]  Yuichi Iwadate,et al.  Algorithm for dynamic 3D object generation from multi-viewpoint images , 2004, SPIE Optics East.