Modeling of SSIM-based end-to-end distortion for error-resilient video coding

Conventional end-to-end distortion models for videos measure the overall distortion based on independent estimations of the source distortion and the channel distortion. However, they are not correlating well with the perceptual characteristics where there is a strong inter-relationship among the source distortion, the channel distortion, and the video content. As most compressed videos are represented to human users, perception-based end-to-end distortion model should be developed for error-resilient video coding. In this paper, we propose a structural similarity (SSIM)-based end-to-end distortion model to optimally estimate the content-dependent perceptual distortion due to quantization, error concealment, and error propagation. Experiments show that the proposed model brings a better visual quality for H.264/AVC video coding over packet-switched networks.

[1]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[2]  Song Ci,et al.  SSIM-based error-resilient rate-distortion optimization of H.264/AVC video coding for wireless streaming , 2014, Signal Process. Image Commun..

[3]  Lei Zhang,et al.  SSIM-based Error Resilient Video Coding Over Packet-Switched Networks , 2014, J. Signal Process. Syst..

[4]  Hua Yang,et al.  GOP-level transmission distortion modeling for mobile streaming video , 2008, Signal Process. Image Commun..

[5]  Jianfei Cai,et al.  Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[6]  Homer H. Chen,et al.  SSIM-Based Perceptual Rate Control for Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Yuan Zhang,et al.  SSIM-Based End-to-End Distortion Modeling for H.264 Video Coding , 2012, PCM.

[8]  Hua Yang,et al.  Optimizing Motion Compensated Prediction for Error Resilient Video Coding , 2010, IEEE Transactions on Image Processing.

[9]  Thomas Wiegand,et al.  Lagrange multiplier selection in hybrid video coder control , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[10]  Stewart T. Worrall,et al.  Error resilience for multi-view video using redundant macroblock coding , 2011, 2011 6th International Conference on Industrial and Information Systems.

[11]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[12]  Yao Zhao,et al.  Joint redundant motion vector and intra macroblock refreshment for video transmission , 2011, EURASIP J. Image Video Process..

[13]  Feng Wu,et al.  Channel Distortion Modeling for Multi-View Video Transmission Over Packet-Switched Networks , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Yao Wang,et al.  Modeling of transmission-loss-induced distortion in decoded video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Yao Zhao,et al.  Dynamic Sub-GOP Forward Error Correction Code for Real-Time Video Applications , 2012, IEEE Transactions on Multimedia.

[16]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[17]  Qiang Peng,et al.  Source Distortion Temporal Propagation Model for Motion Compensated Video Coding Optimization , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[18]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[19]  Jonathan Loo,et al.  Error-Resilient Scheme for Wavelet Video Codec Using Automatic ROI Detection and Wyner-Ziv Coding Over Packet Erasure Channel , 2010, IEEE Transactions on Broadcasting.

[20]  Hua Yang,et al.  Advances in Recursive Per-Pixel End-to-End Distortion Estimation for Robust Video Coding in H.264/AVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Yixuan Zhang,et al.  A Joint Source-Channel Video Coding Scheme Based on Distributed Source Coding , 2008, IEEE Transactions on Multimedia.

[22]  Lei Zhang,et al.  SSIM-Based End-to-End Distortion Model for Error Resilient Video Coding over Packet-Switched Networks , 2013, MMM.

[23]  Jong-Seok Lee,et al.  Parametric estimation of structural similarity degradation for video transmission over error-prone networks , 2013 .

[24]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[25]  Wen Gao,et al.  Joint Source-Channel Rate-Distortion Optimization for H.264 Video Coding Over Error-Prone Networks , 2007, IEEE Transactions on Multimedia.

[26]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[27]  Lei Zhang,et al.  SSIM-Based Error Resilient Video Coding over Packet-Switched Networks , 2012, PCM.

[28]  Si Wu,et al.  Unequal loss protection for robust transmission of motion compensated video over the internet , 2003, Signal Process. Image Commun..