Inter-Frame Post-Processing for Intra-Coded Video

We propose a video codec architecture based on mixed quality frames which allows for low-complexity intra-coded video to undergo inter-frame post-processing to improve its rate-distortion performance. The video sequence is divided into key and non-key frames by applying different quantization parameters among them. The application of different quantization parameters reduces the bit-rate, but also reduces the quality of the non-key frames. In order to enhance the quality of these non-key frames at the decoding process without additional information, we propose the use of the higher quality (key) frames through motion estimation. For that, in blocks where key and non-key frames “match”, we try to apply details of key frames to non-key ones. Tests were carried out with H.264-Intra, Motion JPEG 2000 and Motion JPEG video sequences, recording PSNR improvements of up to 1 dB.

[1]  Edson M. Hung,et al.  Video Super-Resolution Using Codebooks Derived From Key-Frames , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Peter Lambert,et al.  Correlation modeling with decoder-side quantization distortion estimation for distributed video coding , 2010, 28th Picture Coding Symposium.

[3]  Bruno Macchiavello,et al.  A simple reversed-complexity Wyner-Ziv video coding mode based on a spatial reduction framework , 2007, Electronic Imaging.

[4]  M. Reha Civanlar,et al.  Temporal flicker reduction and denoising in video using sparse directional transforms , 2008, Optical Engineering + Applications.

[5]  Bernd Girod,et al.  Transform-domain Wyner-Ziv codec for video , 2004, IS&T/SPIE Electronic Imaging.

[6]  Chris Heegard.  Partitioned linear block codes for computer memory with 'stuck-at' defects , 1983, IEEE Trans. Inf. Theory.

[7]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[8]  M. Ohta,et al.  An overlapped block motion compensation for high quality motion picture coding , 1992, [Proceedings] 1992 IEEE International Symposium on Circuits and Systems.

[9]  M. Omair Ahmad,et al.  A new variable size block motion compensation , 1997, Proceedings of International Conference on Image Processing.

[10]  Kannan Ramchandran,et al.  PRISM: A new robust video coding architecture based on distributed compression principles , 2002 .

[11]  Bruno Macchiavello,et al.  Iterative Side-Information Generation in a Mixed Resolution Wyner-Ziv Framework , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Byeungwoo Jeon,et al.  Fast inter mode selection for H.264/AVC using large block and zero motion consistency history , 2007, TENCON 2007 - 2007 IEEE Region 10 Conference.

[13]  Oscar C. Au,et al.  Temporal Video Denoising Based on Multihypothesis Motion Compensation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[15]  Edson M. Hung,et al.  Blocking-Effect Reduction in a Reversed-Complexity Video Codec Based on a Mixed-Quality Framework , 2010 .

[16]  Marco Dalai,et al.  The DISCOVER codec: Architecture, Techniques and Evaluation , 2007, PCS 2007.

[17]  Truong Q. Nguyen,et al.  Quality Enhancement for Motion JPEG Using Temporal Redundancies , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Yair Moshe,et al.  POST-PROCESSING FOR FLICKER REDUCTION IN H.264/AVC , 2007 .

[19]  K. Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[20]  Peter Lambert,et al.  Bitplane intra coding with decoder-side mode decision in distributed video coding , 2010, 2010 IEEE International Conference on Image Processing.

[21]  Kannan Ramchandran,et al.  PRISM: A Video Coding Paradigm With Motion Estimation at the Decoder , 2007, IEEE Transactions on Image Processing.

[22]  Debargha Mukherjee,et al.  Super resolution of video using key frames , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[23]  Debargha Mukherjee,et al.  A Robust Reversed-Complexity Wyner-Ziv Video Codec Introducing Sign-Modulated Codes , 2006 .

[24]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[25]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[26]  R. Queiroz,et al.  A STATISTICAL MODEL FOR A MIXED RESOLUTION WYNER-ZIV FRAMEWORK , 2007 .

[27]  Aggelos K. Katsaggelos,et al.  High-resolution images from low-resolution compressed video , 2003, IEEE Signal Process. Mag..

[28]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[29]  Siegfried Fößel,et al.  Motion JPEG2000 for high quality video systems , 2003, IEEE Trans. Consumer Electron..

[30]  Truong Q. Nguyen,et al.  Optimal motion compensated spatio-temporal filter for quality enhancement of H.264/AVC compressed video sequences , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[31]  Ming Yang,et al.  H.264/AVC intra-only coding (iAVC) techniques for video over wireless networks , 2009, Electronic Imaging.

[32]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.