Super-resolution of HEVC videos via convex optimization

Super Resolution (SR) addresses the problem of image and video upscaling. Most of the best performing SR methods do not take into account any compression prior into the degradation model. Consequently, compression artifacts can be undesirably amplified during SR. In the present work, we propose a novel HEVC-dedicated approach for embedding SR results into a domain that closely fits the compressed observation. Our main contribution is the inclusion of HEVC syntax (block size, quantization parameters etc.) into the degradation model. A recent convex optimization approach is used to solve the associated minimization problem. Over a wide range of resolutions and bitrates, we show that our method improves the results obtained with state of the art SR.

[1]  Madhukar Budagavi,et al.  HEVC Transform and Quantization , 2014, High Efficiency Video Coding.

[2]  A. Gouldstone,et al.  Integrated Circuits and Systems , 1999 .

[3]  Luc Van Gool,et al.  A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution , 2014, ACCV.

[4]  Luc Van Gool,et al.  Seven Ways to Improve Example-Based Single Image Super Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Caroline Chaux,et al.  A convex optimization approach for image resolution enhancement from compressed representations , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[6]  H. Schwarz,et al.  Joint Video Team (jvt) of Iso/iec Mpeg & Itu-t Vceg (iso/iec Jtc1/sc29/wg11 and Itu-t Sg16 Q.6) , 2002 .

[7]  R. Keys.  Cubic convolution interpolation for digital image processing , 1981 .

[8]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, SPIE Optics + Photonics.

[9]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[10]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[11]  Chih-Yuan Yang,et al.  Fast Direct Super-Resolution by Simple Functions , 2013, 2013 IEEE International Conference on Computer Vision.

[12]  Luc Van Gool,et al.  Efficient regression priors for reducing image compression artifacts , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[13]  P. L. Combettes,et al.  Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone Operators , 2011, Set-Valued and Variational Analysis.

[14]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Aline Roumy,et al.  Single-Image Super-Resolution via Linear Mapping of Interpolated Self-Examples , 2014, IEEE Transactions on Image Processing.

[16]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[17]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[18]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Patrick L. Combettes,et al.  Image restoration subject to a total variation constraint , 2004, IEEE Transactions on Image Processing.

[20]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.