Cloud Baking

We propose Cloud Baking, a collaborative rendering architecture for dynamic Web3D scenes. In our architecture, the cloud renderer renders the scene with the global illumination (GI) information in a GI map; the web-based client renderer renders the scene with ambient lighting only and blends it with the GI map received from the cloud for the final scene. This approach allows the users to interact with the web scene and change the scene dynamically through the web interface end, yet move the computationally heavy tasks of global illumination computation to the cloud. A challenge we face is the interaction delay that causes the frames rendered on the cloud and the client to go out of sync. We propose to use 3D warping and a hole-filling algorithm designed for GI map to predict the late GI map. We show both quantitatively and visually the quality of the GI map produced using our method. Our prediction algorithm allows us to further reduce the frequency at which the GI map is computed and sent from the server, reducing both computational needs and bandwidth usage.

[1]  Wei Tsang Ooi,et al.  Towards peer-assisted rendering in networked virtual environments , 2011, MM '11.

[2]  Toshiaki Fujii,et al.  View Generation with 3D Warping Using Depth Information for FTV , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[3]  Liwei Hsu,et al.  Web 3D simulation-based application in tourism education: A case study with Second Life , 2012 .

[4]  Elmar Eisemann,et al.  Interactive Indirect Illumination Using Voxel Cone Tracing , 2011, Comput. Graph. Forum.

[5]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[6]  Chun-Ying Huang,et al.  Measuring the latency of cloud gaming systems , 2011, ACM Multimedia.

[7]  Glen Rhodes,et al.  Flash Game Development: In a Social, Mobile and 3D World , 2013 .

[8]  Oliver Hohlfeld,et al.  Impact of frame rate and resolution on objective QoE metrics , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[9]  Gwendal Simon,et al.  The brewing storm in cloud gaming: A measurement study on cloud to end-user latency , 2012, 2012 11th Annual Workshop on Network and Systems Support for Games (NetGames).

[10]  Marc Levoy,et al.  Protected interactive 3D graphics via remote rendering , 2004, SIGGRAPH 2004.

[11]  E. Wes Bethel,et al.  Chromium Renderserver: Scalable and Open Remote Rendering Infrastructure , 2008, IEEE Transactions on Visualization and Computer Graphics.

[12]  D. Gourlay,et al.  Remote walkthrough over mobile networks using 3-D image warping and streaming , 2004 .

[13]  Aljoscha Smolic,et al.  Intermediate view interpolation based on multiview video plus depth for advanced 3D video systems , 2008, 2008 15th IEEE International Conference on Image Processing.

[14]  Anton Kaplanyan,et al.  Cascaded light propagation volumes for real-time indirect illumination , 2010, I3D '10.

[15]  Kajal T. Claypool,et al.  Latency and player actions in online games , 2006, CACM.

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  George Drettakis,et al.  Flexible point-based rendering on mobile devices , 2004, IEEE Computer Graphics and Applications.

[18]  Peter-Pike J. Sloan,et al.  CloudLight: A system for amortizing indirect lighting in real-time rendering , 2013 .

[19]  Klara Nahrstedt,et al.  A real-time remote rendering system for interactive mobile graphics , 2012, TOMCCAP.

[20]  Jinyuan Jia,et al.  Client-Driven Strategy of Large-Scale Scene Streaming , 2016, MMM.

[21]  Carsten Dachsbacher,et al.  Reflective shadow maps , 2005, I3D '05.

[22]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[23]  Chandrajit L. Bajaj,et al.  Distributed and collaborative visualization , 1994, Computer.

[24]  Leonard McMillan,et al.  Post-rendering 3D warping , 1997, SI3D.

[25]  Fiona Fui-Hoon Nah,et al.  A study on tolerable waiting time: how long are Web users willing to wait? , 2004, AMCIS.

[26]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[27]  Shuang Liang,et al.  LPM: lightweight progressive meshes towards smooth transmission of Web3D media over internet , 2014, VRCAI '14.

[28]  Alec Wolman,et al.  Outatime: Using Speculation to Enable Low-Latency Continuous Interaction for Mobile Cloud Gaming , 2015, MobiSys.

[29]  Luca Chittaro,et al.  Web3D technologies in learning, education and training: Motivations, issues, opportunities , 2007, Comput. Educ..

[30]  Emilio Camahort,et al.  Interactive three-dimensional rendering on mobile computer devices , 2005, ACE '05.