A point-based rendering approach for real-time interaction on mobile devices

Mobile device is an important interactive platform. Due to the limitation of computation, memory, display area and energy, how to realize the efficient and real-time interaction of 3D models based on mobile devices is an important research topic. Considering features of mobile devices, this paper adopts remote rendering mode and point models, and then, proposes a transmission and rendering approach that could interact in real time. First, improved simplification algorithm based on MLS and display resolution of mobile devices is proposed. Then, a hierarchy selection of point models and a QoS transmission control strategy are given based on interest area of operator, interest degree of object in the virtual environment and rendering error. They can save the energy consumption. Finally, the rendering and interaction of point models are completed on mobile devices. The experiments show that our method is efficient.

[1]  David S. Ebert,et al.  Interactive Illustrative Rendering on Mobile Devices , 2007, IEEE Computer Graphics and Applications.

[2]  Azzedine Boukerche,et al.  Implementation, Measurement, and Analysis of an Image-Based Virtual Environment Streaming Protocol for Wireless Mobile Devices , 2008, IEEE Transactions on Instrumentation and Measurement.

[3]  Markus H. Gross,et al.  Efficient simplification of point-sampled surfaces , 2002, IEEE Visualization, 2002. VIS 2002..

[4]  Andrea Sanna,et al.  A Streaming-Based Solution for Remote Visualization of 3D Graphics on Mobile Devices , 2007, IEEE Transactions on Visualization and Computer Graphics.

[5]  Sang Uk Lee,et al.  Rate-distortion optimized compression and view-dependent transmission of 3-D normal meshes , 2005, IEEE Trans. Circuits Syst. Video Technol..

[6]  Glenn P. Forney,et al.  Understanding Fire and Smoke Flow Through Modeling and Visualization , 2003, IEEE Computer Graphics and Applications.

[7]  George Drettakis,et al.  Flexible point-based rendering on mobile devices , 2004, IEEE Computer Graphics and Applications.

[8]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[9]  Yoshitaka Shibata,et al.  Scalable collaborative virtual environment considering user's interest information , 2006, 20th International Conference on Advanced Information Networking and Applications - Volume 1 (AINA'06).

[10]  Rynson W. H. Lau,et al.  CyberWalk: a web-based distributed virtual walkthrough environment , 2003, IEEE Trans. Multim..

[11]  Benjamin.  Adaptive Graphics , 2002 .

[12]  Yoshitaka Shibata,et al.  QoS control function based on user's information on the 3D virtual shared space , 2004, 18th International Conference on Advanced Information Networking and Applications, 2004. AINA 2004..

[13]  Zhigeng Pan,et al.  Accelerated Rendering of Vector Graphics on Mobile Devices , 2007, HCI.

[14]  Tao Zheng,et al.  Vector Graphics Rendering on Mobile Device , 2009, 2009 WRI International Conference on Communications and Mobile Computing.

[15]  Pavel Slavík,et al.  Non-Photorealistic Walkthroughs Using Flash , 2004, WSCG.

[16]  Matthias Zwicker,et al.  Surface splatting , 2001, SIGGRAPH.

[17]  Azzedine Boukerche,et al.  A 3D image-based rendering technique for mobile handheld devices , 2006, 2006 International Symposium on a World of Wireless, Mobile and Multimedia Networks(WoWMoM'06).

[18]  Jinxiang Dong,et al.  Non-Photorealistic Rendering in Customizable Styles for Mobile Collaboration , 2007, 2007 11th International Conference on Computer Supported Cooperative Work in Design.

[19]  Jiejie Zhu,et al.  Virtual Avatar Enhanced Nonverbal Communication from Mobile Phones to PCs , 2008, Edutainment.

[20]  Hiroaki Nishino,et al.  A Ubiquitous 3D Graphics Modeler for Mobile Devices , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing with Applications.

[21]  M. Falchetto,et al.  Sort Middle Pipeline Architecture for Efficient 3D Rendering , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[22]  Marc Alexa,et al.  Computing and Rendering Point Set Surfaces , 2003, IEEE Trans. Vis. Comput. Graph..

[23]  Hideyuki Tamura,et al.  Gaze-directed adaptive rendering for interacting with virtual space , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[24]  Yanli Sun.  3D TerraFly: Quality of service management for online interactive 3D geographic information system , 2004 .

[25]  Marc Stamminger,et al.  Sequential point trees , 2003, ACM Trans. Graph..

[26]  Leif Kobbelt,et al.  Optimized Sub‐Sampling of Point Sets for Surface Splatting , 2004, Comput. Graph. Forum.

[27]  Dani Lischinski,et al.  Streaming of Complex 3D Scenes for Remote Walkthroughs , 2001, Comput. Graph. Forum.

[28]  Leif Kobbelt,et al.  Efficient High Quality Rendering of Point Sampled Geometry , 2002, Rendering Techniques.

[29]  Daniel Thalmann,et al.  The mobile animator: interactive character animation in collaborative virtual environments , 2004 .

[30]  Chun-Fa Chang,et al.  Enhancing 3D Graphics on Mobile Devices by Image-Based Rendering , 2002, IEEE Pacific Rim Conference on Multimedia.

[31]  Xun Wang,et al.  An Effective Error Resilient Packetization Scheme for Progressive Mesh Transmission over Unreliable Networks , 2008, Journal of Computer Science and Technology.

[32]  Matthias Zwicker,et al.  Surfels: surface elements as rendering primitives , 2000, SIGGRAPH.

[33]  Ioana M. Boier-Martin.  Adaptive Graphics , 2003, IEEE Computer Graphics and Applications.

[34]  Amitabh Varshney,et al.  Statistical Point Geometry , 2003, Symposium on Geometry Processing.

[35]  Daniel Cohen-Or,et al.  Streaming Scenes to MPEG-4 Video-Enabled Devices , 2003, IEEE Computer Graphics and Applications.

[36]  Marc Levoy,et al.  Streaming QSplat: a viewer for networked visualization of large, dense models , 2001, I3D '01.

[37]  Thomas Ertl,et al.  Remote line rendering for mobile devices , 2004 .

[38]  Marc Levoy,et al.  The Use of Points as a Display Primitive , 2000 .

[39]  Shen Xu-kun.  Feature-preserving Contour-based Remote Rendering Algorithm , 2009 .

[40]  Sang Uk Lee,et al.  Rate-distortion optimized compression and view-dependent transmission of 3-D normal meshes , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Renato Pajarola,et al.  Efficient Level-of-details for Point based Rendering , 2003, Computer Graphics and Imaging.

[42]  L.L. Lai,et al.  Strategies of Enhancing the Performance of Embedded 3D Graphics Applications , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[43]  Rynson W. H. Lau,et al.  An adaptive multi-resolution modeling technique based on viewing and animation parameters , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.