Low-Level Frame-Buffer Scraping for GPUs in the Cloud

We describe and evaluate a software-only implementation of a novel mechanism for accessing and streaming GPU-rendered content from the cloud to low-end user devices. The unique properties of our implementation enable the trivial cloud-deployment of graphics-intensive applications, even ones that were not originally intended to run in the cloud. We achieve this goal by creating virtual GPU nodes that appear to the application like hardware devices, but that do not incur the overhead of virtualization. The low-level access to the frame buffer maximizes the number of applications that work out-of-the-box without the system imposing any specific display manager or windowing system.

[1]  Cheng-Hsin Hsu,et al.  GamingAnywhere: The first open source cloud gaming system , 2014, TOMCCAP.

[2]  Bernd Girod,et al.  Optimal slice size for streaming regions of high resolution video with virtual pan/tilt/zoom functionality , 2007, 2007 15th European Signal Processing Conference.

[3]  Andy Hopper,et al.  Virtual Network Computing , 1998, IEEE Internet Comput..

[4]  Sotirios A. Tsaftaris,et al.  2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA) , 2013 .

[5]  Simon Stegmaier,et al.  A Generic Solution for Hardware-Accelerated Remote Visualization , 2002, VisSym.

[6]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Jason Nieh,et al.  THINC: a virtual display architecture for thin-client computing , 2005, SOSP '05.

[8]  Peter Eisert,et al.  Low delay streaming of computer graphics , 2008, 2008 15th IEEE International Conference on Image Processing.

[9]  James Gettys,et al.  The X window system, version 11 , 1990, Softw. Pract. Exp..

[10]  Chong Luo,et al.  Multimedia Cloud Computing , 2011, IEEE Signal Processing Magazine.

[11]  Thomas Ertl,et al.  Widening the remote visualization bottleneck , 2003, 3rd International Symposium on Image and Signal Processing and Analysis, 2003. ISPA 2003. Proceedings of the.