Down-Sampling Based Video Coding Using Super-Resolution Technique

It has been reported that oversampling a still image before compression does not guarantee a good image quality. Similarly, down-sampling before video compression in low bit rate video coding may alleviate the blocking effect and improve peak signal-to-noise ratio of the decoded frames. When the number of discrete cosine transform coefficients is reduced in such a down-sampling based coding (DBC), the bit budget of each coefficient will increase, thus reduce the quantization error. A DBC video coding scheme is proposed in this paper, where a super-resolution technique is employed to restore the down-sampled frames to their original resolutions. The performance improvement of the proposed DBC scheme is analyzed at low bit rates, and verified by experiments.

[1]  Hong Chang,et al.  Super-resolution through neighbor embedding , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  Harry Shum,et al.  A two-step approach to hallucinating faces: global parametric model and local nonparametric model , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Yiannis Aloimonos,et al.  A Roadmap to the Integration of Early Visual Modules , 2007, International Journal of Computer Vision.

[5]  Jan P. Allebach,et al.  Tree-Based Resolution Synthesis , 1999, PICS.

[6]  Michael Elad,et al.  Down-Scaling for Better Transform Compression , 2001, Scale-Space.

[7]  Aggelos K. Katsaggelos,et al.  High‐resolution images from compressed low‐resolution video: Motion estimation and observable pixels , 2004, Int. J. Imaging Syst. Technol..

[8]  Weisi Lin,et al.  Improved Super-Resolution Reconstruction From Video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[10]  Xiangjun Zhang,et al.  Can Lower Resolution Be Better? , 2008, Data Compression Conference (dcc 2008).

[11]  Aggelos K. Katsaggelos,et al.  Region-based super-resolution for compression , 2007, Multidimens. Syst. Signal Process..

[12]  Nikolas P. Galatsanos,et al.  Maximum a Posteriori Video Super-Resolution Using a New Multichannel Image Prior , 2010, IEEE Transactions on Image Processing.

[13]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[15]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[16]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[17]  Aggelos K. Katsaggelos,et al.  Bayesian resolution enhancement of compressed video , 2004, IEEE Transactions on Image Processing.

[18]  Il-hong Shin,et al.  Adaptive Up-Sampling Method Using DCT for Spatial Scalability of Scalable Video Coding , 2009, IEEE Trans. Circuits Syst. Video Technol..

[19]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[20]  Weisi Lin,et al.  Adaptive downsampling/upsampling for better video compression at low bit rate , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[21]  Luis F. Chaparro,et al.  Low Bit Rate Video Coding Using DCT-Based Fast Decimation/Interpolation and Embedded Zerotree Coding , 2007, IEEE Trans. Circuits Syst. Video Technol..

[22]  Lisimachos P. Kondi,et al.  Comparison of digital image resolution enhancement techniques , 2002, SPIE Defense + Commercial Sensing.

[23]  Heung-Yeung Shum,et al.  Fundamental limits of reconstruction-based superresolution algorithms under local translation , 2004 .

[24]  Lisimachos P. Kondi,et al.  MAP based resolution enhancement of video sequences using a Huber-Markov random field image prior model , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[25]  Debargha Mukherjee,et al.  Super resolution of video using key frames , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[26]  Eric Dubois,et al.  Image up-sampling using total-variation regularization with a new observation model , 2005, IEEE Transactions on Image Processing.

[27]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.