A Universal String Matching Approach to Screen Content Coding

This paper proposes a universal string matching (USM) approach to screen content coding (SCC). USM uses a primary reference buffer and a secondary reference buffer for string matching and includes three modes: general string (GS) mode, constrained string 1 (CS1) mode, and constrained string 2 (CS2) mode. The CS1 mode and CS2 mode are constrained cases of the GS mode. Due to the diversity of the screen content, each of the three modes plays an indispensable role in coding some types of screen content. When using USM to code a coding unit (CU), one of the three modes is selected to code the CU. Compared with high-efficiency video coding (HEVC) SCC reference software HM-16.6 + SCM-5.2 of full frame search range for intrablock copy, USM achieves an average Y BD-rate of –28.4% for five text and graphics with motion (TGM) sequences from the audio video coding standard SCC common test condition (CTC) test suite and –5.8% for eight TGM test sequences from the HEVC SCC CTC test suite in all intraconfigurations, with a nearly 10% decrease in encoding runtime and almost the same decoding runtime.

[1]  Baocai Yin,et al.  Screen Content Coding Based on HEVC Framework , 2014, IEEE Transactions on Multimedia.

[2]  Tao Lin,et al.  Arbitrary shape matching for screen content coding , 2013, 2013 Picture Coding Symposium (PCS).

[3]  Tao Lin,et al.  Overview of Screen Content Video Coding: Technologies, Standards, and Beyond , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[4]  Chen Xian-yi,et al.  A New HEVC Intra Mode for Screen Content Coding , 2015 .

[5]  Bin Li,et al.  A unified framework of hash-based matching for screen content coding , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[6]  Tenkasi V. Ramabadran,et al.  A tutorial on CRC computations , 1988, IEEE Micro.

[7]  Xiaoyan Sun,et al.  Cloud-Based Image Coding for Mobile Devices—Toward Thousands to One Compression , 2013, IEEE Transactions on Multimedia.

[8]  Tao Lin,et al.  United coding method for compound image compression , 2012, Multimedia Tools and Applications.

[9]  Rik Van de Walle,et al.  Efficient Bit Rate Transcoding for High Efficiency Video Coding , 2016, IEEE Transactions on Multimedia.

[10]  Tao Lin,et al.  Cloudlet-screen computing: A multi-core-based, cloud-computing-oriented, traditional-computing-compatible parallel computing Paradigm for the masses , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[11]  Tao Lin,et al.  Pseudo 2D String Matching Technique for High Efficiency Screen Content Coding , 2016, IEEE Transactions on Multimedia.

[12]  Bin Li,et al.  $\lambda$-Domain Rate Control Algorithm for HEVC Scalable Extension , 2016, IEEE Transactions on Multimedia.

[13]  Baocai Yin,et al.  Adaptive LZMA-based coding for screen content , 2013, 2013 Picture Coding Symposium (PCS).

[14]  Wenjun Zeng,et al.  An efficient color re-indexing scheme for palette-based compression , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[15]  Baocai Yin,et al.  Hash-Based Block Matching for Screen Content Coding , 2015, IEEE Transactions on Multimedia.

[16]  Wen-Hsiao Peng,et al.  Intra line copy for HEVC screen content coding , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[17]  Detlev Marpe,et al.  Macroblock-Adaptive Residual Color Space Transforms for 4:4:4 Video Coding , 2006, 2006 International Conference on Image Processing.

[18]  Tao Lin,et al.  Pseudo-2D-matching based dual-coder architecture for screen contents coding , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[19]  Wei Wang,et al.  Advanced Screen Content Coding Using Color Table and Index Map , 2014, IEEE Transactions on Image Processing.

[20]  Je-Won Kang,et al.  Efficient Residual DPCM Using an $l_1$ Robust Linear Prediction in Screen Content Video Coding , 2016, IEEE Transactions on Multimedia.

[21]  Yongdong Zhang,et al.  High Efficiency Video Coding: High Efficiency Video Coding , 2014 .

[22]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[23]  Wei Xiang,et al.  Disparity Vector Correction for View Synthesis Prediction-Based 3-D Video Transmission , 2015, IEEE Transactions on Multimedia.

[24]  Tao Lin,et al.  United coding for compound image compression , 2010, 2010 3rd International Congress on Image and Signal Processing.

[25]  Marta Karczewicz,et al.  Color palette for screen content coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[26]  Tao Lin,et al.  Mixed Chroma Sampling-Rate High Efficiency Video Coding for Full-Chroma Screen Content , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Tao Lin,et al.  Cloudlet-screen computing: a client-server architecture with top graphics performance , 2013, Int. J. Ad Hoc Ubiquitous Comput..

[28]  Weisi Lin,et al.  Saliency-Guided Quality Assessment of Screen Content Images , 2016, IEEE Transactions on Multimedia.

[29]  Shuhui Wang,et al.  A Unified LZ and Hybrid Coding for Compound Image Partial-Lossless Compression , 2009, 2009 2nd International Congress on Image and Signal Processing.

[30]  Abraham Lempel,et al.  A universal algorithm for sequential data compression , 1977, IEEE Trans. Inf. Theory.

[31]  Shan Liu,et al.  Intra Block Copy in HEVC Screen Content Coding Extensions , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[32]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  Cai Wenting,et al.  Pixel String Matching for Full-Chroma Screen and Mixed Content Coding in AVS2 , 2018 .

[34]  Tao Lin,et al.  Pseudo-2D-matching based enhancement to high efficiency video coding for screen contents , 2014, Multimedia Tools and Applications.

[35]  Tao Lin,et al.  Compound image compression based on unified LZ and hybrid coding , 2013, IET Image Process..

[36]  Tao Lin,et al.  A Hardware Decoder Architecture for General String Matching Technique , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[37]  Chih-Yang Lin,et al.  Predictive Texture Synthesis-Based Intra Coding Scheme for Advanced Video Coding , 2015, IEEE Transactions on Multimedia.

[38]  Shipeng Li,et al.  Virtualized Screen: A Third Element for Cloud-Mobile Convergence , 2011, IEEE Multim..