Distortion estimates for adaptive temporal decompositions of video under displacement errors and quantization noise

In video communication systems, due to quantization and transmission errors, mismatches between the transmitter - and receiver-side information may occur, severely impacting the reconstructed video. Theoretical understanding of the quality degradation ensuing from such mismatches is essential when targeting quality-of-service for video communications. In this paper, by viewing the mismatches in the transform coefficients and the adaptive parameters of the temporal analysis of a video coding system as perturbations in the synthesis system, we derive analytic approximations for the expected reconstruction distortion. Our theoretical results are experimentally assessed using adaptive temporal decompositions within a video coding system based on motion-adaptive temporal lifting decomposition. Since we focus on the generic case of adaptive lifting transforms, our results can provide useful insights for estimation-theoretic resiliency mechanisms to be considered within standardized transform-based codecs.

[1]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.

[2]  Ebroul Izquierdo,et al.  Rate-Distortion Optimized Motion-Compensated Prediction for Packet Loss Resilient Video Coding , 2007, IEEE Transactions on Image Processing.

[3]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[4]  B. Girod,et al.  Multiview Video Compression , 2007, IEEE Signal Processing Magazine.

[5]  Mihaela van der Schaar,et al.  In-band motion compensated temporal filtering , 2004, Signal Process. Image Commun..

[6]  David S. Taubman,et al.  Highly scalable video compression with scalable motion coding , 2003, ICIP.

[7]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  E. Izquierdo,et al.  On the influence of motion vector precision limiting in scalable video coding , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[9]  David S. Taubman,et al.  Highly scalable video compression with scalable motion coding , 2003, IEEE Transactions on Image Processing.

[10]  Bernd Girod,et al.  Analysis on Quantization Error Propagation for Motion-Compensated Lifted Wavelet Video Coding , 2005, 2005 IEEE 7th Workshop on Multimedia Signal Processing.

[11]  Fabio Verdicchio,et al.  Distortion estimates for adaptive lifting transforms with noise , 2011, Image Vis. Comput..