Interactive Screen Video Streaming-Based Pervasive Mobile Workstyle

In this paper, we develop an interactive screen video streaming-based system to enable the ubiquitous mobile workstyle, which is referred to as personal computer to pervasive computing (PC2PC). The desktop screens of virtualized systems are compressed in the PC2PC servers and delivered to remote end users for stream decoding, rendering, and interactions. We have implemented a system from the scratch, where the emerging screen content coding extension of high-efficiency video coding is implemented to compress and stream the desktop screens of the virtualized system in real time. Three core asset channels, system, display, and inputs, are defined to enable systematic end-to-end communication. Compared with Red Hat SPICE virtual desktop infrastructure scheme, the proposed PC2PC could save network bandwidth consumption by a factor of 2, 7, and 4, respectively, in terms of typical video streaming, web browsing, and stationary office applications at the same visual quality. Meanwhile, we have also measured the delays of the system and presented preliminary results on the user experience aspect. A simple network estimation is applied to optimize the quality bandwidth adaptation for both single user and multiuser scenarios to consider the network dynamics.

[1]  Zongpeng Li,et al.  A Geometric Approach to Server Selection for Interactive Video Streaming , 2016, IEEE Transactions on Multimedia.

[2]  Zhan Ma,et al.  Modeling the impact of frame rate on perceptual quality of video , 2008, 2008 15th IEEE International Conference on Image Processing.

[3]  Zhan Ma,et al.  On video source format of screen content compression , 2015, 2015 Visual Communications and Image Processing (VCIP).

[4]  Wei Wang,et al.  Advanced Screen Content Coding Using Color Table and Index Map , 2014, IEEE Transactions on Image Processing.

[5]  Zhan Ma,et al.  Modeling of Rate and Perceptual Quality of Compressed Video as Functions of Frame Rate and Quantization Stepsize and Its Applications , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Nenghai Yu,et al.  A Low-Complexity Screen Compression Scheme for Interactive Screen Sharing , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Sudhir S. Dixit,et al.  Dynamic bandwidth allocation for quality-of-service over Ethernet PONs , 2003, IEEE J. Sel. Areas Commun..

[8]  Cheng-Hsin Hsu,et al.  On the Quality of Service of Cloud Gaming Systems , 2014, IEEE Transactions on Multimedia.

[9]  Shipeng Li,et al.  Virtualized Screen: A Third Element for Cloud-Mobile Convergence , 2011, IEEE Multim..

[10]  Oscar C. Au,et al.  Subpixel rendering: from font rendering to image subsampling [Applications Corner] , 2013, IEEE Signal Processing Magazine.

[11]  Wen Gao,et al.  Utility-Driven Adaptive Preprocessing for Screen Content Video Compression , 2017, IEEE Transactions on Multimedia.

[12]  Abraham Lempel,et al.  Compression of individual sequences via variable-rate coding , 1978, IEEE Trans. Inf. Theory.

[13]  Jeong-Hoon Park,et al.  Block Partitioning Structure in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Tao Lin,et al.  Mixed Chroma Sampling-Rate High Efficiency Video Coding for Full-Chroma Screen Content , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Catherine Rosenberg,et al.  A game theoretic framework for bandwidth allocation and pricing in broadband networks , 2000, TNET.

[17]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Zhan Ma,et al.  Optimization of spatial, temporal and amplitude resolution for rate-constrained video coding and scalable video adaptation , 2012, 2012 19th IEEE International Conference on Image Processing.

[19]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..