Reducing artifacts of intra-frame video coding via sequential denoising

In this work we propose a new postprocessing method for video sequences compressed using intra-frame coding techniques. The suggested method extends our previously published approach for handling compressed still-images. We rely on the Plug-and-Play Prior framework, which shows that a general inverse problem can be cast as a sequence of Gaussian denoising steps. We formulate the video recovery task as such an inverse problem, with a regularization that leverages on existing state-of-the-art video denoising algorithms. Our method's strength emerges from two origins: (i) the flexibility of using the best available video denoising algorithm; and (ii) the fact that, while intra-coding is treated, an inter-frame force is introduced via the denoising stage. As such, our scheme can be interpreted as belonging to the distributed video coding paradigm with an extended decompression procedure coupled with a relatively simple compression. A prominent part in our approach is a linearization of the nonlinear compression-decompression operation, while leveraging the intra-coding structure to obtain a block-diagonal matrix form. We demonstrate significant quality improvements for video sequences compressed using Motion-JPEG2000.

[1]  Karen O. Egiazarian,et al.  Video denoising using separable 4D nonlocal spatiotemporal transforms , 2011, Electronic Imaging.

[2]  Andrew Leung,et al.  Motion-JPEG2000 standardization and target market , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[3]  Brendt Wohlberg,et al.  Plug-and-Play priors for model based reconstruction , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[4]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[5]  Touradj Ebrahimi,et al.  The JPEG2000 still image coding system: an overview , 2000, IEEE Trans. Consumer Electron..

[6]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[7]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[8]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[9]  Michael Elad,et al.  Postprocessing of Compressed Images via Sequential Denoising , 2015, IEEE Transactions on Image Processing.

[10]  Licheng Jiao,et al.  Image deblocking via sparse representation , 2012, Signal Process. Image Commun..

[11]  Amir Averbuch,et al.  Deblocking of block-transform compressed images using weighted sums of symmetrically aligned pixels , 2005, IEEE Transactions on Image Processing.