3D Model Streaming Based on JPEG 2000

For PC and even mobile device, video and image streaming technologies, such as H.264 and JPEG/JPEG 2000, are already mature. However, the streaming technology for 3D model or so-called mesh data is still far from practical use. Therefore, in this paper, we propose a mesh streaming method based on JPEG 2000 standard and integrate it into an existed multimedia streaming server, so that our mesh streaming method can directly benefit from current image and video streaming technologies. In this method, the mesh data of a 3D model is first converted into a JPEG 2000 image, and then based on the JPEG 2000 streaming technique, the mesh data can then be transmitted over the Internet as a mesh streaming. Furthermore, we also extend this mesh streaming method for deforming meshes as the extension from a JPEG 2000 image to a motion JPEG 2000 video, so that our mesh streaming method is not only for transmitting a static 3D model but also a 3D animation model. To increase the usability of our method, the mesh stream can also be inserted into a X3D scene as an extension node of X3D. Moreover, since this method is based on the JPEG 2000 standard, our system is much suitable to be integrated into any existed client-server or peer-to-peer multimedia streaming system.

[1]  Dani Lischinski,et al.  Streaming of Complex 3D Scenes for Remote Walkthroughs , 2001, Comput. Graph. Forum.

[2]  Tomoyuki Nishita,et al.  Multiresolution streaming mesh with shape preserving and QoS-like controlling , 2002, Web3D '02.

[3]  Ting-Hao Huang,et al.  3D Model Streaming based on a JPEG 2000 Image , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[4]  C.-C. Jay Kuo,et al.  A progressive view-dependent technique for interactive 3-D mesh transmission , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Robert Prandolini,et al.  Architecture, philosophy, and performance of JPIP: internet protocol standard for JPEG2000 , 2003, Visual Communications and Image Processing.

[6]  Michael S. Floater,et al.  Parametrization and smooth approximation of surface triangulations , 1997, Comput. Aided Geom. Des..

[7]  Bing-Yu Chen,et al.  Progressive deforming meshes based on deformation oriented decimation and dynamic connectivity updating , 2006, SCA '06.

[8]  Wenjun Zeng,et al.  Scalable streaming of JPEG2000 images using hypertext transfer protocol , 2001, MULTIMEDIA '01.

[9]  Michael Garland,et al.  Progressive multiresolution meshes for deforming surfaces , 2005, SCA '05.

[10]  Steven J. Gortler,et al.  Geometry images , 2002, SIGGRAPH.

[11]  Pedro V. Sander,et al.  Geometry videos: a new representation for 3D animations , 2003, SCA '03.

[12]  Shun-Yun Hu,et al.  A Case for Peer-to-Peer 3D Streaming , 2006 .

[13]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[14]  Martin Isenburg,et al.  Streaming meshes , 2005, VIS 05. IEEE Visualization, 2005..

[15]  Marc Levoy,et al.  Streaming QSplat: a viewer for networked visualization of large, dense models , 2001, I3D '01.