Wavelet-based frame video coding algorithms using fovea and SPECK

Abstract Current video coding standards such as the H.264 or Advanced Video Coding (AVC) and the H.265 or High Efficiency Video Coding (HEVC) are based on the Integer Discrete Cosine Transform (IDCT). However, it has been shown that wavelet-based algorithms have better performance than IDCT-based algorithms for still images. Also, exploiting the human visual system characteristics in stationary point of view image and video transmissions like the fovea aliasing can improve the quality of the reconstructed image. In this paper, two wavelet-based video coding approaches called SPECK-based Codec (SP-Codec) and Adaptive Wavelet/Fovea-based Codec (AWFV-Codec) are proposed. The proposed SP-Codec approach applies the Set Partitioned Embedded Block Codec (SPECK) wavelet-based compression algorithm in order to increase the intra-frame coding quality. The second proposed approach AWFV-Codec uses the Adaptive Fovea Set Partitioned Embedded Block Codec (AFV-SPECK) fovea wavelet-based compression algorithm for intra-frame coding. Fovea based compression allows to increase the quality of the reconstructed frames over regions of interest (ROI). A comparison of the proposed algorithms against the HEVC based on IDCT approach shows how the proposed wavelet-based schemes achieve higher compression ratios and higher reconstruction quality. When fixation point of view is stationary, the proposed wavelet/fovea-based algorithm achieves better quality at lower compression ratios than the wavelet-based only proposed algorithm.

[1]  Ee-Chien Chang,et al.  A wavelet approach to foveating images , 1997, SCG '97.

[2]  Tinku Acharya,et al.  JPEG2000 standard for image compression , 2004 .

[3]  Louis D. Silverstein Foundations of Vision, by Brian A. Wandell, Sinauer Associates, Inc., Sunderland, MA, 1995. xvi + 476 pp., hardcover $49.95. , 2008 .

[4]  Mathias Wien,et al.  High Efficiency Video Coding: Coding Tools and Specification , 2014 .

[5]  K. Moskvitch News Briefing: In Num6ers - The Panama Canal goes large , 2016 .

[6]  Daniel A. Keim,et al.  Visual Interaction with Dimensionality Reduction: A Structured Literature Analysis , 2017, IEEE Transactions on Visualization and Computer Graphics.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[9]  L. D. Silverstein FOUNDATIONS OF VISION , 1996 .

[10]  Oleg Starostenko,et al.  Foveated ROI Compression with Hierarchical Trees for Real-Time Video Transmission , 2011, MCPR.

[11]  Alan C. Bovik,et al.  The Essential Guide to Video Processing , 2009, J. Electronic Imaging.

[12]  Andrew K. Chan,et al.  Fundamentals of Wavelets: Theory, Algorithms, and Applications , 2011 .

[13]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Jerome M. Shapiro,et al.  Embedded image coding using zerotrees of wavelet coefficients , 1993, IEEE Trans. Signal Process..

[15]  Kaushal K. Shukla,et al.  Lossy Image Compression - Domain Decomposition-Based Algorithms , 2011, Springer Briefs in Computer Science.

[16]  Michael Gastpar,et al.  Distributed Source Coding - Theory, Algorithms and Applications , 2009 .

[17]  Stphane Mallat,et al.  A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way , 2008 .

[18]  Oleg Starostenko,et al.  Region-of-Interest Coding based on Fovea and Hierarchical Trees , 2013, Inf. Technol. Control..

[19]  William A. Pearlman,et al.  Efficient, low-complexity image coding with a set-partitioning embedded block coder , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Irina E. Bocharova Compression for Multimedia , 2010 .

[21]  William A. Pearlman,et al.  Set Partition Coding: Part II of Set Partition Coding and Image Wavelet Coding Systems , 2008, Found. Trends Signal Process..

[22]  Frederick Walls,et al.  VESA Display Stream Compression for Television and Cinema Applications , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[23]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[24]  Giovanni Motta,et al.  Handbook of Data Compression , 2009 .

[25]  Gary J. Sullivan,et al.  Video Quality Evaluation Methodology and Verification Testing of HEVC Compression Performance , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Alan C. Bovik,et al.  Fast algorithms for foveated video processing , 2003, IEEE Trans. Circuits Syst. Video Technol..

[27]  Paul Dempsey The teardown - Amazon tap portable speaker and assistant [Reviews Consumer Technology] , 2016 .

[28]  Iulian B. Ciocoiu,et al.  ECG signal compression using 2D wavelet foveation , 2009, ICHIT '09.

[29]  Paul Dempsey The Teardown: HTC Vive virtual reality headset , 2016 .

[30]  H. Vincent Poor,et al.  The Likelihood Encoder for Lossy Compression , 2014, IEEE Transactions on Information Theory.