Streaming 3D meshes using spectral geometry images

The transmission of 3D models in the form of Geometry Images (GI) is an emerging and appealing concept due to the reduction in complexity from R3 to image space and wide availability of mature image processing tools and standards. However, geometry images often suffer from the artifacts and error during compression and transmission. Thus, there is a need to address the artifact reduction, error resilience and protection of such data information during the transmission across an error prone network. In this paper, we introduce a new concept, called Spectral Geometry Images (SGI), which naturally combines the powerful spectral analysis with geometry images. We show that SGI is more effective than GI to generate visually pleasing shapes at high compression rates. Furthermore, by coupling SGI to the proposed error protection scheme, we are able to ensure the smooth delivery of 3D model across error networks for different packet loss rate simulated using the two-state Markov model.

[1]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[2]  Renato Pajarola,et al.  Compressed Progressive Meshes , 2000, IEEE Trans. Vis. Comput. Graph..

[3]  Andrei Khodakovsky,et al.  Progressive geometry compression , 2000, SIGGRAPH.

[4]  Craig Gotsman,et al.  Spectral compression of mesh geometry , 2000, EuroCG.

[5]  B. Chow,et al.  COMBINATORIAL RICCI FLOWS ON SURFACES , 2002, math/0211256.

[6]  Steven J. Gortler,et al.  Geometry images , 2002, SIGGRAPH.

[7]  S. Yau,et al.  Global conformal surface parameterization , 2003 .

[8]  Shing-Tung Yau,et al.  Global Conformal Parameterization , 2003, Symposium on Geometry Processing.

[9]  C.-C. Jay Kuo,et al.  Optimized mesh and texture multiplexing for progressive textured model transmission , 2004, MULTIMEDIA '04.

[10]  Christian Rössl,et al.  Differential coordinates for interactive mesh editing , 2004, Proceedings Shape Modeling Applications, 2004..

[11]  Yücel Altunbasak,et al.  An unequal error protection method for progressively transmitted 3D models , 2005, IEEE Transactions on Multimedia.

[12]  Yücel Altunbasak,et al.  Bit allocation for joint source and channel coding of progressively compressed 3-D models , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Yücel Altunbasak,et al.  3TP: an application-Layer protocol for streaming 3-D models , 2005, IEEE Transactions on Multimedia.

[14]  Hugues Hoppe,et al.  Shape Compression using Spherical Geometry Images , 2005, Advances in Multiresolution for Geometric Modelling.

[15]  Yücel Altunbasak,et al.  Error-resilient transmission of 3D models , 2005, TOGS.

[16]  S. Mallat,et al.  Surface compression with geometric bandelets , 2005, ACM Trans. Graph..

[17]  Gozde Bozdagi Akar,et al.  Multiple Description Scalar Quantization Based 3D Mesh Coding , 2006, 2006 International Conference on Image Processing.

[18]  Hui Li,et al.  Middleware for streaming 3D progressive meshes over lossy networks , 2006, TOMCCAP.

[19]  Bruno Lévy,et al.  Laplace-Beltrami Eigenfunctions Towards an Algorithm That "Understands" Geometry , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[20]  Stéphane Mallat,et al.  A review of Bandlet methods for geometrical image representation , 2007, Numerical Algorithms.

[21]  Wei Tsang Ooi,et al.  An analytical model for progressive mesh streaming , 2007, ACM Multimedia.

[22]  Hong Qin,et al.  Ricci Flow for 3 D Shape Analysis , 2007 .

[23]  Raif M. Rustamov,et al.  Laplace-Beltrami eigenfunctions for deformation invariant shape representation , 2007 .

[24]  Hao Zhang,et al.  Spectral Methods for Mesh Processing and Analysis , 2007, Eurographics.

[25]  G.B. Akar,et al.  Multiple Description Coding of 3D Geometrywith Forward Error Correction Codes , 2007, 2007 3DTV Conference.

[26]  Bing-Yu Chen,et al.  3D Model Streaming Based on JPEG 2000 , 2007, IEEE Transactions on Consumer Electronics.

[27]  Wei Zeng,et al.  Ricci Flow for 3D Shape Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[28]  Hong Qin,et al.  Polycube splines , 2007, Comput. Aided Des..

[29]  Gozde Bozdagi Akar,et al.  Packet Loss Resilient Transmission of 3D Models , 2007, 2007 IEEE International Conference on Image Processing.

[30]  Xiaohu Guo,et al.  Spectral mesh deformation , 2008, The Visual Computer.

[31]  B. Prabhakaran,et al.  A robust spectral approach for blind watermarking of manifold surfaces , 2008, MM&Sec '08.

[32]  Wei Cheng.  Streaming of 3D progressive meshes , 2008, ACM Multimedia.

[33]  Bruno Lévy,et al.  Spectral Geometry Processing with Manifold Harmonics , 2008, Comput. Graph. Forum.

[34]  Wei Tsang Ooi,et al.  Streaming of plants in distributed virtual environments , 2008, ACM Multimedia.

[35]  Chi-Wing Fu,et al.  A divide-and-conquer approach for automatic polycube map construction , 2009, Comput. Graph..