High frame rate screen video coding for screen sharing applications

In this paper, we propose a high frame rate screen video compression scheme aiming at improving the interactive user experience on screen sharing applications. The proposed screen video compression is performed as two-layer coding: a base layer coding using the conventional video codec and an enhancement layer coding using the proposed open-loop coding scheme. For efficient frame level layer selection and compression, the content update of each frame is evaluated through global motion detection. The screen frame with significant content update is fed to the conventional video encoder in base layer. In contrast, the frame with little update is compressed in enhancement layer in which the duplicate content is indicated by global motion vector and skip flag while the updated content is encoded by distinct intra modes in terms of inherent local features. The experimental results demonstrate that for the screen video containing interaction, the proposed coding scheme can achieve 3.09ms/frame encoding rate and 2.33ms/frame decoding rate with efficient rate distortion performance.

[1]  Pengwei Hao,et al.  Compound image compression for real-time computer screen image transmission , 2005, IEEE Transactions on Image Processing.

[2]  Feng Wu,et al.  Enable Efficient Compound Image Compression in H.264/AVC Intra Coding , 2007, 2007 IEEE International Conference on Image Processing.

[3]  Alexandre Zaghetto,et al.  Segmentation-Driven Compound Document Coding Based on H.264/AVC-INTRA , 2007, IEEE Transactions on Image Processing.

[4]  Feng Wu,et al.  A high-performanance remote computing platform , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[5]  Klaus E. Schauser,et al.  Fast motion detection for thin client compression , 2002, Proceedings DCC 2002. Data Compression Conference.

[6]  Yoshua Bengio,et al.  High quality document image compression with "DjVu" , 1998, J. Electronic Imaging.

[7]  Wen Gao,et al.  Content-aware layered compound video compression , 2012, 2012 IEEE International Symposium on Circuits and Systems.