Background simplification for ROI-oriented low bitrate video coding

Low-bitrate video compression is a challenging task, particularly with the increasing complexity of video sequences. Re-shaping video data before its compression with modern hybrid encoders has provided interesting results in the low and ultra-low bit rate domains. In this work, we propose a novel saliency guided preprocessing approach, which combines adaptive re-sampling and background texture removal, to achieve efficient ROI-oriented compression. Evaluated with HEVC, we show that our solution improves the ROI encoding over a wide range of resolutions and bit rates whilst maintaining a high background intelligibility level.

[1]  Weisi Lin,et al.  Adaptive downsampling/upsampling for better video compression at low bit rate , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[2]  Ci Wang,et al.  Down-Sampling Based Video Coding Using Super-Resolution Technique , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[4]  Gary J. Sullivan,et al.  High efficiency video coding: the next frontier in video compression [Standards in a Nutshell] , 2013, IEEE Signal Processing Magazine.

[5]  Yael Pritch,et al.  Content-aware compression using saliency-driven image retargeting , 2013, 2013 IEEE International Conference on Image Processing.

[6]  Aggelos K. Katsaggelos,et al.  Region-based super-resolution for compression , 2007, Multidimens. Syst. Signal Process..

[7]  Jan P. Allebach,et al.  Saliency guided adaptive residue pre-processing for perceptually based video compression , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[8]  Houqiang Li,et al.  An adaptive down-sampling based video coding with hybrid super-resolution method , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[9]  Dionysios I. Reisis,et al.  Reduced Complexity Superresolution for Low-Bitrate Video Compression , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Nam Ling,et al.  Compression of HD videos by a contrast-based human attention algorithm , 2014, 2014 IEEE 16th International Workshop on Multimedia Signal Processing (MMSP).

[11]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  Craig Gotsman,et al.  Energy‐Based Image Deformation , 2009, Comput. Graph. Forum.

[13]  Steffen Wulf,et al.  Investigation of distortion-constrained video encoding and its application to visual saliency guided compression , 2014, 2014 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA).

[14]  Pao-Chi Chang,et al.  Adaptive down-sampling video coding , 2010, Electronic Imaging.

[15]  Michael Elad,et al.  Down-Scaling for Better Transform Compression , 2001, Scale-Space.

[16]  Alfred M. Bruckstein,et al.  Improving Low Bit-Rate Video Coding using Spatio-Temporal Down-Scaling , 2014, ArXiv.

[17]  Aggelos K. Katsaggelos,et al.  Toward a new video compression scheme using super-resolution , 2006, Electronic Imaging.

[18]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[19]  Ivan V. Bajic,et al.  Saliency-Aware Video Compression , 2014, IEEE Transactions on Image Processing.

[20]  Olga Sorkine-Hornung,et al.  Robust Image Retargeting via Axis‐Aligned Deformation , 2012, Comput. Graph. Forum.

[21]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[22]  Richard Szeliski,et al.  Multigrid and multilevel preconditioners for computational photography , 2011, ACM Trans. Graph..