Video Enhancement from Multiple Compressed Copies in Transform Domain

Increasingly, we can obtain more than one compressed copy of the same video content with different levels of visual quality over the Internet. As the original source video is not always available, how to choose or derive a video of the best quality from these copies becomes a challenging and interesting problem. In this paper, we address this new research problem by blindly enhancing the quality of the video reconstructed from such multiple compressed copies. The aim is to reconstruct a video that achieves a better quality than any of the available copies. Specifically, we propose to reconstruct each coefficient of the video in the transform domain by using a narrow quantization constraint set derived from the multiple compressed copies together, using a Laplacian or Cauchy distribution model for each AC transform coefficient to minimize the distortion. Analytical and experimental results show the effectiveness of the proposed method.

[1]  Edward J. Delp,et al.  Block artifact reduction using a transform-domain Markov random field model , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Bhaskar Ramamurthi,et al.  Nonlinear space-variant postprocessing of block coded images , 1986, IEEE Trans. Acoust. Speech Signal Process..

[3]  Sang Uk Lee,et al.  On the POCS-based postprocessing technique to reduce the blocking artifacts in transform coded images , 1998, IEEE Trans. Circuits Syst. Video Technol..

[4]  Rabab Kreidieh Ward,et al.  Removing the blocking artifacts of block-based DCT compressed images , 2003, IEEE Trans. Image Process..

[5]  Rabab K. Ward,et al.  Removal of DCT blocking artifacts using DC and AC filtering , 2003, 2003 IEEE Pacific Rim Conference on Communications Computers and Signal Processing (PACRIM 2003) (Cat. No.03CH37490).

[6]  Edward J. Delp,et al.  MAP-based post processing of video sequences using 3-D Huber-Markov random field model , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[7]  Nikolas P. Galatsanos,et al.  Projection-based spatially adaptive reconstruction of block-transform compressed images , 1995, IEEE Trans. Image Process..

[8]  Tao Chen,et al.  Adaptive postfiltering of transform coefficients for the reduction of blocking artifacts , 2001, IEEE Trans. Circuits Syst. Video Technol..

[9]  Hong Yan,et al.  Blocking artifacts suppression in block-coded images using overcomplete wavelet representation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Arun N. Netravali,et al.  Digital Pictures: Representation and Compression , 1988 .

[11]  Aggelos K. Katsaggelos,et al.  A Bayesian approach for the estimation and transmission of regularization parameters for reducing blocking artifacts , 2000, IEEE Trans. Image Process..

[12]  P. Pirsch,et al.  Advances in picture coding , 1985, Proceedings of the IEEE.

[13]  Nikolas P. Galatsanos,et al.  Regularized reconstruction to reduce blocking artifacts of block discrete cosine transform compressed images , 1993, IEEE Trans. Circuits Syst. Video Technol..

[14]  C.-C. Jay Kuo,et al.  Coding artifact removal with multiscale postprocessing , 1997, Proceedings of International Conference on Image Processing.

[15]  R. D. de Queiroz,et al.  Processing JPEG-compressed images and documents. , 1998 .

[16]  Tiago Rosa Maria Paula Queluz,et al.  No-reference image quality assessment based on DCT domain statistics , 2008, Signal Process..

[17]  Lawrence A. Rowe,et al.  DCT coefficient distributions , 1996, Electronic Imaging.

[18]  Jechang Jeong,et al.  Enhancement of wavelet-coded images via novel directional filtering , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[19]  B. Gunturk,et al.  Multiframe resolution-enhancement methods for compressed video , 2002, IEEE Signal Processing Letters.

[20]  Yücel Altunbasak,et al.  Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion models , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Zoran A. Ivanovski,et al.  An adaptive POCS algorithm for compression artifacts removal , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[22]  Anthony Vetro,et al.  Coding artifacts reduction using edge map guided adaptive and fuzzy filtering , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[23]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[24]  Yücel Altunbasak,et al.  Multiframe blocking-artifact reduction for transform-coded video , 2002, IEEE Trans. Circuits Syst. Video Technol..

[25]  Sanjeev R. Kulkarni,et al.  A framework for measuring video similarity and its application to video query by example , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[26]  Jae Lim,et al.  Reduction Of Blocking Effects In Image Coding , 1984 .

[27]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[28]  Dong-Sun Lim,et al.  Deblocking algorithm in MPEG-4 video coding using block boundary characteristics and adaptive filtering , 2005, IEEE International Conference on Image Processing 2005.

[29]  Aggelos K. Katsaggelos,et al.  High-resolution images from low-resolution compressed video , 2003, IEEE Signal Process. Mag..

[30]  C. Kelley Solving Nonlinear Equations with Newton's Method , 1987 .

[31]  Ju Jia Zou,et al.  A deblocking method for BDCT compressed images based on adaptive projections , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Alan C. Bovik,et al.  . Efficient DCT-domain blind measurement and reduction of blocking artifacts , 2002, IEEE Trans. Circuits Syst. Video Technol..

[33]  Ci Wang,et al.  Reconstructing Videos From Multiple Compressed Copies , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Arun N. Netravali,et al.  Digital Pictures: Representation, Compression and Standards , 1995 .

[35]  N. Galatsanos,et al.  Multichannel regularized recovery of compressed video sequences , 2001 .

[36]  F. Muller Distribution shape of two-dimensional DCT coefficients of natural images , 1993 .

[37]  Hong Yan,et al.  POCS-based blocking artifacts suppression using a smoothness constraint set with explicit region modeling , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  C.-C. Jay Kuo,et al.  Review of Postprocessing Techniques for Compression Artifact Removal , 1998, J. Vis. Commun. Image Represent..

[39]  Hocine Cherifi,et al.  On the distribution of the DCT coefficients , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[40]  Onur G. Guleryuz Linear, Worst-Case Estimators for Denoising Quantization Noise in Transform Coded Images , 2006, IEEE Transactions on Image Processing.

[41]  Avideh Zakhor,et al.  Iterative procedures for reduction of blocking effects in transform image coding , 1991, Electronic Imaging.