LiveRender: A Cloud Gaming System Based on Compressed Graphics Streaming

In cloud gaming systems, the game program runs at servers in the cloud, while clients access game services by sending input events to the servers and receiving game scenes via video streaming. In this paradigm, servers are responsible for all performance-intensive operations, and thus suffer from poor scalability. An alternative paradigm is called graphics streaming, in which graphics commands and data are offloaded to the clients for local rendering, thereby mitigating the server's burden and allowing more concurrent game sessions. Unfortunately, this approach is bandwidth-consuming, due to large amounts of graphic commands and geometry data. In this paper, we present LiveRender, an open-source gaming system that remedies the problem by implementing a suite of bandwidth optimization techniques including intraframe compression, interframe compression, and caching, establishing what we call compressed graphics streaming. Experiments results show that the new approach is able to reduce bandwidth consumption by 52%-73% compared to raw graphics streaming, with no perceptible difference in video quality and reduced response delay. Compared to the video streaming approach, LiveRender achieves a traffic reduction of 40%-90% with even improved video quality and substantially smaller response delay, while enabling higher concurrency at the server.

[1]  C.-C. Jay Kuo,et al.  Technologies for 3D mesh compression: A survey , 2005, J. Vis. Commun. Image Represent..

[2]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[3]  Andrea Sanna,et al.  A Streaming-Based Solution for Remote Visualization of 3D Graphics on Mobile Devices , 2007, IEEE Transactions on Visualization and Computer Graphics.

[4]  Dinesh Manocha,et al.  Simplification envelopes , 1996, SIGGRAPH.

[5]  Jason Nieh,et al.  THINC: a virtual display architecture for thin-client computing , 2005, SOSP '05.

[6]  Qinping Zhao,et al.  A point-based rendering approach for real-time interaction on mobile devices , 2009, Science in China Series F: Information Sciences.

[7]  Gordon Stoll,et al.  WireGL: a scalable graphics system for clusters , 2001, SIGGRAPH.

[8]  Klara Nahrstedt,et al.  Real-time parallel remote rendering for mobile devices using graphics processing units , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[9]  Massimo Bergamasco,et al.  Real-Time Network Streaming of Dynamic 3D Content with In-frame and Inter-frame Compression , 2011, 2011 IEEE/ACM 15th International Symposium on Distributed Simulation and Real Time Applications.

[10]  Alessandro De Gloria,et al.  Platform for Distributed 3D Gaming , 2009, Int. J. Comput. Games Technol..

[11]  Klara Nahrstedt,et al.  A real-time remote rendering system for interactive mobile graphics , 2012, TOMCCAP.

[12]  Cheng-Hsin Hsu,et al.  GamingAnywhere: an open cloud gaming system , 2013, MMSys.

[13]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[14]  Greg Humphreys,et al.  Chromium: a stream-processing framework for interactive rendering on clusters , 2002, SIGGRAPH.

[15]  Azzedine Boukerche,et al.  Implementation, Measurement, and Analysis of an Image-Based Virtual Environment Streaming Protocol for Wireless Mobile Devices , 2008, IEEE Transactions on Instrumentation and Measurement.

[16]  Philip Ross Cloud Computing's Killer App: Gaming , 2009, IEEE Spectrum.

[17]  Peter Eisert,et al.  Low delay streaming of computer graphics , 2008, 2008 15th IEEE International Conference on Image Processing.

[18]  David P. Luebke,et al.  A Developer's Survey of Polygonal Simplification Algorithms , 2001, IEEE Computer Graphics and Applications.

[19]  I. Lazar,et al.  The state of the Internet , 2000 .

[20]  David P. Luebke,et al.  View-dependent simplification of arbitrary polygonal environments , 1997, SIGGRAPH.

[21]  Ryan Shea,et al.  Cloud gaming: architecture and performance , 2013, IEEE Network.