Video enhancement with convex optimization methods

Video enhancement methods enable to optimize the viewing of video content at the end-user side. Most approaches do not consider the compressed nature of the available content. In the present work, we build upon a recently proposed video enhancement approach that explicitly models a compression stage. To apply the enhancement framework on compressed representations requires to extract specific syntax elements during their decoding. This additional information embeds the enhanced result in a domain that closely fits the observation. We evaluate the framework performance in a single source resolution enhancement scenario, and show the method efficiency with respect to state-of-the-art approaches.

[1]  Patrick L. Combettes,et al.  Image restoration subject to a total variation constraint , 2004, IEEE Transactions on Image Processing.

[2]  Ken Turkowski,et al.  Filters for common resampling tasks , 1990 .

[3]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Luc Van Gool,et al.  Efficient regression priors for reducing image compression artifacts , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[5]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[6]  Youn Jin Kim,et al.  Evaluating super resolution algorithms , 2011, Electronic Imaging.

[7]  Frédéric Dufaux,et al.  Super-resolution of HEVC videos via convex optimization , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  Luc Van Gool,et al.  A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution , 2014, ACCV.

[9]  Saeid Nahavandi,et al.  Performance Evaluation of Multi-Frame Super-Resolution Algorithms , 2012, 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA).

[10]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[11]  Li Tian,et al.  Task-Oriented Evaluation of Super-Resolution Techniques , 2010, 2010 20th International Conference on Pattern Recognition.

[12]  Caroline Chaux,et al.  A convex optimization approach for image resolution enhancement from compressed representations , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[13]  R. Keys.  Cubic convolution interpolation for digital image processing , 1981 .

[14]  P. L. Combettes,et al.  Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone Operators , 2011, Set-Valued and Variational Analysis.

[15]  Cyril Bergeron,et al.  A Convex Optimization Framework for Video Quality and Resolution Enhancement From Multiple Descriptions , 2019, IEEE Transactions on Image Processing.

[16]  Chih-Yuan Yang,et al.  Fast Direct Super-Resolution by Simple Functions , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Peyman Milanfar,et al.  Super-resolution imaging , 2011 .

[18]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Jianle Chen,et al.  Overview of SHVC: Scalable Extensions of the High Efficiency Video Coding Standard , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.