Multiplayer cloud gaming system with cooperative video sharing

Mobile cloud-based video gaming (MCVG) is an emerging trend in moving the online entertainment industry into the cloud era. In MCVG, the game engines are hosted in the cloud, and the rendered gaming videos are transmitted over wireless networks to the mobile devices. In reverse, game players' interactions on screens are sent to the cloud server over the same networks. How to compress and transmit the real-time gaming video, so that during the gaming session, the expected server transmission rate over the bandwidth-limited wireless network is minimized while satisfying the quality of experience demanded by the players, is a great technical challenge that is addressed in this paper in a multi-player gaming context. We exploit the correlations between the gaming videos for distinct players in the same gaming scene to propose a cloud gaming system with cooperative video sharing, in which the cloud game server is able to efficiently encode and transmit multiple video streams to a group of players, while those players are able to decode their video in a cooperative manner by sharing contents via a secondary network such as ad hoc wireless local area network. Experimental results show that the expected server transmission rate can be significantly reduced compared to the conventional video encoding schemes for cloud games.

[1]  LeeJeehong,et al.  Adaptive Intra-Frame Assignment and Bit-Rate Estimation for Variable GOP Length in H.264 , 2006 .

[2]  Antonio Ortega,et al.  Optimized frame structure using distributed source coding for interactive multiview video streaming , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Antonio Ortega,et al.  Distributed source coding techniques for interactive multiview video streaming , 2009, 2009 Picture Coding Symposium.

[4]  Il-hong Shin,et al.  Adaptive Intra-Frame Assignment and Bit-Rate Estimation for Variable GOP Length in H.264 , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Sujit Dey,et al.  Rendering Adaptation to Address Communication and Computation Constraints in Cloud Mobile Gaming , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[7]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[8]  Wei Cai,et al.  Optimized frame structure for interactive light field streaming with cooperative caching , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[9]  Ngai-Man Cheung,et al.  Generation of redundant frame structure for interactive multiview streaming , 2009, 2009 17th International Packet Video Workshop.

[10]  Kun Yang,et al.  On effective offloading services for resource-constrained mobile devices running heavier mobile Internet applications , 2008, IEEE Communications Magazine.

[11]  Sujit Dey,et al.  Modeling and Characterizing User Experience in a Cloud Server Based Mobile Gaming Approach , 2009, GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference.