No-Reference Pixel Video Quality Monitoring of Channel-Induced Distortion

Video transmitted over an error-prone network may be received at the decoder with degradations due to packet losses. No-reference quality monitoring algorithms are the most practical way to measure the quality of the received video, since they do not impose any change with respect to the network architecture. Conventionally, these methods assume the availability of the corrupted bitstream. In some situations this is not possible, e.g., because the bitstream is encrypted or processed by third-party decoders, and only the decoded pixel values can be used. The major issue in this scenario is the lack of knowledge about which regions of the video have been actually lost, which is a fundamental ingredient for estimating channel-induced distortion. In this paper, we propose a maximum a posteriori estimation of the pattern of lost macroblocks, which assumes the knowledge of the decoded pixels only. This information can be used as input to a no-reference quality monitoring system, which produces an accurate estimate of the mean-square-error (MSE) distortion introduced by channel errors. The results of the proposed method are well correlated with the MSE distortion computed in full-reference mode, with a linear correlation coefficient equal to 0.9 at frame level and 0.98 at sequence level.

[1]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[2]  Amy R. Reibman,et al.  Quality monitoring of video over a packet network , 2004, IEEE Transactions on Multimedia.

[3]  E. Gilbert.  Capacity of a burst-noise channel , 1960 .

[4]  Bernd Girod,et al.  Analysis of error propagation in hybrid video coding with application to error resilience , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[5]  Alan C. Bovik,et al.  41 OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[6]  S. Tubaro,et al.  Estimating channel-induced distortion in H.264/AVC video without bitstream information , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[7]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  David C. Pheanis,et al.  QoS evaluation of sender-based loss-recovery techniques for VoIP , 2006, IEEE Network.

[9]  Yukihiro Nishida,et al.  Nonreference Method for Estimating PSNR of MPEG-2 Coded Video by Using DCT Coefficients and Picture Energy , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[12]  Michael I. Jordan.  Graphical Models , 2003 .

[13]  Toru Yamada,et al.  No-reference video quality estimation based on error-concealment effectiveness , 2007, Packet Video 2007.

[14]  Pamela C. Cosman,et al.  Modeling packet-loss visibility in MPEG-2 video , 2006, IEEE Transactions on Multimedia.

[15]  M. Serizawa,et al.  REDUCED-REFERENCE BASED VIDEO QUALITY-METRICS USING REPRESENTATIVE-LUMINANCE VALUES , 2007 .

[16]  Margaret H. Pinson.  Low Bandwidth Reduced Reference Video Quality Monitoring System , 2005 .

[17]  Jörgen Gustafsson,et al.  Measuring multimedia quality in mobile networks with an objective parametric model , 2008, 2008 15th IEEE International Conference on Image Processing.

[18]  Ingrid Heynderickx,et al.  A no-reference perceptual blockiness metric , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Stefan Winkler,et al.  Video quality evaluation for mobile streaming applications , 2003, Visual Communications and Image Processing.

[20]  S. Gary,et al.  Joint Model Reference Encoding Methods and Decoding Concealment Methods , 2003 .

[21]  Tiago Rosa Maria Paula Queluz,et al.  No-Reference Quality Assessment of H.264/AVC Encoded Video , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Yukihiro Nishida,et al.  A method of estimating coding PSNR using quantized DCT coefficients , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Athanasios Leontaris,et al.  Quality Evaluation of Motion-Compensated Edge Artifacts in Compressed Video , 2007, IEEE Transactions on Image Processing.

[24]  Athanasios Leontaris,et al.  Comparison of blocking and blurring metrics for video compression , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[25]  Sebastian Möller,et al.  T-V-model: Parameter-based prediction of IPTV quality , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Stefano Tubaro,et al.  Subjective evaluation of a NO-reference video quality Monitoring algorithm for H.264/AVC video over a noisy channel , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[27]  Hong Ren Wu,et al.  No-Reference Quality Assessment for Networked Video via Primary Analysis of Bit Stream , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[29]  D. Greig,et al.  Exact Maximum A Posteriori Estimation for Binary Images , 1989 .

[30]  A. Reibman,et al.  ANALYZING THE SPATIAL QUALITY OF INTERNET STREAMING VIDEO , .

[31]  Amy R. Reibman,et al.  Characterizing packet-loss impairments in compressed video , 2007, 2007 IEEE International Conference on Image Processing.

[32]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[33]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[34]  Stefano Tubaro,et al.  A H.264/AVC video database for the evaluation of quality metrics , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[35]  R. Venkatesh Babu,et al.  NO-REFERENCE METRICS FOR VIDEO STREAMING APPLICATIONS , .

[36]  Stefano Tubaro,et al.  Estimating QP and motion vectors in H.264/AVC video from decoded pixels , 2010, MiFor '10.

[37]  Stefano Tubaro,et al.  No-Reference Video Quality Monitoring for H.264/AVC Coded Video , 2009, IEEE Transactions on Multimedia.

[38]  Toru Yamada,et al.  Accurate video-quality estimation without video decoding , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[39]  Pamela C. Cosman,et al.  Predicting H.264 Packet Loss Visibility using a Generalized Linear Model , 2006, 2006 International Conference on Image Processing.

[40]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[41]  Changhoon Yim,et al.  Evaluation of temporal variation of video quality in packet loss networks , 2011, Signal Process. Image Commun..

[42]  Hua Yang,et al.  Subjective Quality Evaluation of Decoded Video in the Presence of Packet Losses , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[43]  Jean C. Gicquel,et al.  AUTOMATIC QUALITY ASSESSMENT OF VIDEO FLUIDITY IMPAIRMENTS USING A NO-REFERENCE METRIC , 2006 .

[44]  Eric V. Denardo,et al.  Flows in Networks , 2011 .

[45]  Tomás Brandão,et al.  Blind PSNR estimation of video sequences using quantized DCT coefficient data , 2007, PCS 2007.

[46]  Amy R. Reibman,et al.  Predicting packet-loss visibility using scene characteristics , 2007, Packet Video 2007.

[47]  Pamela C. Cosman,et al.  A Versatile Model for Packet Loss Visibility and its Application to Packet Prioritization , 2010, IEEE Transactions on Image Processing.

[48]  Stefano Tubaro,et al.  Reduced-reference estimation of channel-induced video distortion using distributed source coding , 2008, ACM Multimedia.