Modeling of transmission-loss-induced distortion in decoded video

This paper analyzes the distortion in decoded video caused by random packet losses in the underlying transmission network. A recursion model is derived that relates the average channel-induced distortion in successive P-frames. The model is applicable to all video encoders using the block-based motion-compensated prediction framework (including the H.261/263/264 and MPEG1/2/4 video coding standards) and allows for any motion-compensated temporal concealment method at the decoder. The model explicitly considers the interpolation operation invoked for motion-compensated temporal prediction and concealment with sub-pel motion vectors. The model also takes into account the two new features of the H.264/AVC standard, namely intraprediction and inloop deblocking filtering. A comparison with simulation data shows that the model is very accurate over a large range of packet loss rates and encoder intrablock rates. The model is further adapted to characterize the channel distortion in subsequent received frames after a single lost frame. This allows one to easily evaluate the impact of a single frame loss.

[1]  Faouzi Kossentini,et al.  Optimal mode selection and synchronization for robust video communications over error-prone networks , 2000, IEEE Journal on Selected Areas in Communications.

[2]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[3]  Zhenyu Wu,et al.  An Error Concealment Scheme for Entire Frame Losses for H.264/AVC , 2006, 2006 IEEE Sarnoff Symposium.

[4]  Jianfei Cai,et al.  Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[5]  Thomas Sikora,et al.  Recursive decoder distortion estimation based on AR(1) source modeling for video , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[6]  D. Marpe,et al.  Video coding with H.264/AVC: tools, performance, and complexity , 2004, IEEE Circuits and Systems Magazine.

[7]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[8]  Yao Wang,et al.  Modelling of distortion caused by packet losses in video transport , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[9]  Hua Yang,et al.  Recursive end-to-end distortion estimation with model-based cross-correlation approximation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).