MPEG-4-based adaptive remote rendering for video games

This paper proposes a complete framework for remote rendering of 3D and complex 2D applications. The retained approach is based on standardized video encoding and interactivity streaming methods and was developed within the framework of the Kusanagi project. The complete architecture of the gaming platform is described and especially we have developed an advanced "lobby server" which acts as an interface between the users and the applications and manages the resources sharing. This server component is also designed in order to build a strongly pervasive environment allowing users to run their 3D applications everywhere and on every device. In this perspective, the MPEG-4 format support is one of the main features that permits to diffuse easily and rapidly our solution. In addition, our gaming platform has been tested by a panel of beta testers. The users experience feedbacks are summarized and give relevant information for the future works. To improve the adaptability of our system, an optimized encoding an streaming method is proposed and the simulation results show that we can significantly improve the user QoE without adding complexity on the server side.

[1]  Thomas Ertl,et al.  Remote line rendering for mobile devices , 2004 .

[2]  I. Nave,et al.  Games@large graphics streaming architecture , 2008, 2008 IEEE International Symposium on Consumer Electronics.

[3]  N.A. Nijdam,et al.  A context-aware adaptive rendering system for user-centric pervasive computing environments , 2010, Melecon 2010 - 2010 15th IEEE Mediterranean Electrotechnical Conference.

[4]  Thomas Bashford-Rogers,et al.  A physically-based client-server rendering solution for mobile devices , 2007, MUM.

[5]  C.-C. Jay Kuo,et al.  Mesh segmentation schemes for error resilient coding of 3-D graphic models , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Greg Humphreys,et al.  Chromium: a stream-processing framework for interactive rendering on clusters , 2002, SIGGRAPH.

[7]  Claudio Zunino,et al.  An accelerated remote graphics architecture for PDAS , 2003, Web3D '03.

[8]  Cyril Concolato,et al.  GPAC: open source multimedia framework , 2007, ACM Multimedia.

[9]  Giuditta De Prato,et al.  Born Digital / Grown Digital: Assessing the Future Competitiveness of the EU Video Games Software Industry , 2010 .

[10]  Antti Nurminen,et al.  Mobile, hardware-accelerated urban 3D maps in 3G networks , 2007, Web3D '07.

[11]  Gordon Stoll,et al.  WireGL: a scalable graphics system for clusters , 2001, SIGGRAPH.

[12]  P. Simoens,et al.  Design and implementation of a hybrid remote display protocol to optimize multimedia experience on thin client devices , 2008, 2008 Australasian Telecommunication Networks and Applications Conference.

[13]  Yücel Altunbasak,et al.  Bit allocation for joint source and channel coding of progressively compressed 3-D models , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Alessandro De Gloria,et al.  Platform for Distributed 3D Gaming , 2009, Int. J. Comput. Games Technol..

[15]  Thomas Ertl,et al.  Remote line rendering for mobile devices , 2004, Proceedings Computer Graphics International, 2004..

[16]  C.-C.J. Kuo,et al.  Mesh segmentation schemes for error resilient coding of 3-D graphic models , 2005 .

[17]  Xavier Granier,et al.  Using expressive rendering for remote visualization of large city models , 2006, Web3D '06.