Adaptive online transmission of 3D TexMesh using scale-space analysis

Efficient online visualization of 3D mesh and photo realistic texture is essential for a variety of applications, such as museum exhibits and medical images. In these applications synthetic texture and a predefined set of views is not an option. We propose using a mesh simplification algorithm based on scale-space analysis of the feature point distribution, combined with an associated analysis of the surface texture, to address the needs of adaptive online transmission of high quality 3D objects. The premise of the proposed textured mesh (TexMesh) simplification is the following: minor variations in texture can be ignored in relatively smooth regions of a 3D surface, without significantly affecting human perception. Statistics on 3D feature point distribution and their associated texture fragments are gathered during preprocessing. Online transmission is based on these statistics, which can be retrieved in constant time. Based on monitored bandwidth a scaled mesh is first transmitted. Starting from a default texture quality, we apply an efficient harmonic time compensation algorithm based on the current bandwidth and a time limit, to adaptively adjust the texture quality of the next fragment. Properties of the algorithm are proved. Experimental results show the usefulness of our approach.

[1]  Olli Jokinen,et al.  Intrinsic Filtering of Range Images Using a Physically Based Noise Model , 2002 .

[2]  Irene Cheng,et al.  Optimal adaptive bandwidth monitoring for QoS based retrieval , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[3]  Pedro V. Sander,et al.  Texture mapping progressive meshes , 2001, SIGGRAPH.

[4]  Tony Lindeberg,et al.  A scale selection principle for estimating image deformations , 1998, Image Vis. Comput..

[5]  Jihad El-Sana,et al.  Adaptive Real-Time Level-of-Detail-Based Rendering for Polygonal Models , 1997, IEEE Trans. Vis. Comput. Graph..

[6]  Greg Turk,et al.  Re-tiling polygonal surfaces , 1992, SIGGRAPH.

[7]  Yibo Zhang,et al.  QoS specification and adaptive bandwidth monitoring for multimedia delivery , 2001, EUROCON'2001. International Conference on Trends in Communications. Technical Program, Proceedings (Cat. No.01EX439).

[8]  Ronald Peikert,et al.  Vortex Tracking in Scale-Space , 2002, VisSym.

[9]  Irene Cheng.  Efficient 3D object simplification and fragmented texture scaling for online visualization , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[10]  Fan Wu,et al.  A Developer's Survey of Polygonal Simplification algorithms , 2005 .

[11]  Benjamin Watson,et al.  Model Simplification Through Refinement , 2000, Graphics Interface.

[12]  Michael Garland,et al.  Simplifying surfaces with color and texture using quadric error metrics , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[13]  Irene Cheng,et al.  Scale-space 3D TexMesh simplification , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[14]  Greg Turk,et al.  Image-driven simplification , 2000, TOGS.

[15]  Dinesh Manocha,et al.  Simplification envelopes , 1996, SIGGRAPH.

[16]  Tsuhan Chen,et al.  Joint geometry/texture progressive coding of 3D models , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[17]  Daniel Cohen-Or,et al.  Deep compression for streaming texture intensive animations , 1999, SIGGRAPH.

[18]  Michael Garland,et al.  Efficient adaptive simplification of massive meshes , 2001, Proceedings Visualization, 2001. VIS '01..

[19]  Marc Rioux,et al.  A texture-mapping approach for the compression of colored 3D triangulations , 1996, The Visual Computer.

[20]  Luc Florack,et al.  Logical Filtering in Scale Space , 2002 .

[21]  Dinesh Manocha,et al.  Appearance-preserving simplification , 1998, SIGGRAPH.

[22]  Gabriel Taubin,et al.  Space‐Optimized Texture Maps , 2002 .

[23]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[24]  Greg Turk,et al.  Generating textures on arbitrary surfaces using reaction-diffusion , 1991, SIGGRAPH.