Adaptive Temporal Trajectory Filtering for Video Compression

Most in-loop filters currently being employed in video compression algorithms use spatial information from a single frame of the video sequence only. In this paper, a new filter is introduced and investigated that combines both spatial and temporal information to provide subjective and objective quality improvement. The filter only requires a small overhead on slice level while using the temporal information conveyed in the bit stream to reconstruct the individual motion trajectory of every pixel in a frame at both encoder and decoder. This information is then used to perform pixel-wise adaptive motion-compensated temporal filtering. It is shown that the filter performs better than the state-of-the-art codec H.264/AVC over a large range of sequences and bit rates. Additionally, the filter is compared with another, Wiener-based in-loop filtering approach and a complexity analysis of both algorithms is conducted.

[1]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Jani Lainema,et al.  Adaptive deblocking filter , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Thomas Sikora,et al.  Video coding using global motion temporal filtering , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[4]  Jens-Rainer Ohm,et al.  Three-dimensional subband coding with motion compensation , 1994, IEEE Trans. Image Process..

[5]  Gary Sullivan,et al.  Recommended Simulation Common Conditions for H.26L Coding Efficiency Experiments on Low Resolution Progressive Scan Source Material , 2001 .

[6]  Truong Q. Nguyen,et al.  Quality Enhancement for Motion JPEG Using Temporal Redundancies , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Truong Q. Nguyen,et al.  Optimal motion compensated spatio-temporal filter for quality enhancement of H.264/AVC compressed video sequences , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[8]  Jerry D. Gibson,et al.  Digital coding of waveforms: Principles and applications to speech and video , 1985, Proceedings of the IEEE.

[9]  Jens-Rainer Ohm,et al.  Multimedia Communication Technology , 2004 .

[10]  Thomas Wedi,et al.  Transmission of Post-Filter Hints for Video Coding Schemes , 2007, 2007 IEEE International Conference on Image Processing.

[11]  Thomas Sikora,et al.  A novel inloop filter for video-compression based on temporal pixel trajectories , 2010, 28th Picture Coding Symposium.

[12]  Thomas Wiegand,et al.  Long-term memory prediction using affine motion compensation , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[13]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[14]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[15]  Alexis M. Tourapis,et al.  Enhanced predictive zonal search for single and multiple frame motion estimation , 2002, IS&T/SPIE Electronic Imaging.

[16]  Thomas Wiegand,et al.  Multiple-reference-picture video coding using polynomial motion models , 1998, Electronic Imaging.

[17]  Edward H. Adelson,et al.  Human-assisted motion annotation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.