A framework for end-to-end video quality prediction of MPEG video

This paper proposes, describes and evaluates a novel framework for video quality prediction of MPEG-based video services, considering the perceptual degradation that is introduced by the encoding process and the provision of the encoded signal over an error-prone wireless or wire-line network. The concept of video quality prediction is considered in this work, according to which the encoding parameters of the video service and the network QoS conditions are used for performing an estimation/prediction of the video quality level at the user side, without further processing of the actual encoded and transmitted video content. The proposed prediction framework consists of two discrete models: (i) a model for predicting the video quality of an encoded signal at a pre-encoding stage by correlating the spatiotemporal content dynamics to the bit rate that satisfies a specific level of user satisfaction; and (ii) a model that predicts primarily the undecodable frames (and subsequently the perceived quality degradation caused by them) based on the monitored averaged packet loss ratio of the network. The proposed framework is experimentally tested and validated with video signals encoded according to MPEG-4 standard.

[1]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[2]  Hocine Cherifi,et al.  Sporadic frame dropping impact on quality perception , 2004, IS&T/SPIE Electronic Imaging.

[3]  Jorge E. Caviedes,et al.  No-reference sharpness metric based on local edge kurtosis , 2002, Proceedings. International Conference on Image Processing.

[4]  Zhihai He,et al.  Transmission Distortion Analysis for Real-Time Video Encoding and Streaming Over Wireless Networks , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Zhou Wang,et al.  Full-reference video quality assessment considering structural distortion and no-reference quality evaluation of MPEG video , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[6]  Zhou Wang,et al.  Why is image quality assessment so difficult? , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Serge Fdida,et al.  Joint Adoption of QoS Schemes for MPEG Streams , 2005, Multimedia Tools and Applications.

[8]  Wei-Ying Ma,et al.  Blur determination in the compressed domain using DCT information , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[9]  Lina J. Karam,et al.  A ROBUST IMAGE SHARPNESS METRIC BASED ON KURTOSIS MEASUREMENT OF WAVELET COEFFICIENTS , 2005 .

[10]  Sos S. Agaian,et al.  Quantifying image similarity using measure of enhancement by entropy , 2007, SPIE Defense + Commercial Sensing.

[11]  Zhou Wang,et al.  Quality-aware images , 2006, IEEE Transactions on Image Processing.

[12]  Markus Rupp,et al.  Reference-Free Video Quality Metric for Mobile Streaming Applications , 2005 .

[13]  Andreas Willig,et al.  A Gilbert-Elliot Bit Error Model and the Efficient Use in Packet Level Simulation , 1999 .

[14]  John G. Apostolopoulos,et al.  Video Compression Standards , 1999 .

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Joan L. Mitchell,et al.  MPEG Video: Compression Standard , 1996 .

[17]  Sanjit K. Mitra,et al.  No-reference video quality metric based on artifact measurements , 2005, IEEE International Conference on Image Processing 2005.

[18]  M. Ghanbari,et al.  Reduced-reference picture quality estimation by using local harmonic amplitude information , .

[19]  Pamela C. Cosman,et al.  Modeling packet-loss visibility in MPEG-2 video , 2006, IEEE Transactions on Multimedia.

[20]  H.-J. Zepernick,et al.  Perceptual-based Quality Metrics for Image and Video Services: A Survey , 2007, 2007 Next Generation Internet Networks.

[21]  Jean C. Gicquel,et al.  AUTOMATIC QUALITY ASSESSMENT OF VIDEO FLUIDITY IMPAIRMENTS USING A NO-REFERENCE METRIC , 2006 .

[22]  E. Pallis,et al.  Pre-Encoding PQoS Assessment Method for Optimized Resource Utilization , 2004 .

[23]  Anastasios Kourtis,et al.  Evaluation of video quality based on objectively estimated metric , 2005, Journal of Communications and Networks.

[24]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[25]  Sethuraman Panchanathan,et al.  A Framework for Advanced Video Traces: Evaluating Visual Quality for Video Transmission Over Lossy Networks , 2006, EURASIP J. Adv. Signal Process..

[26]  Markus Rupp,et al.  Content Based Video Quality Estimation for H.264/AVC Video Streaming , 2007, 2007 IEEE Wireless Communications and Networking Conference.

[27]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[28]  H.R. Wu,et al.  A generalized block-edge impairment metric for video coding , 1997, IEEE Signal Processing Letters.

[29]  Xiaoyuan Lu,et al.  Quality assessing of video over a packet network , 2007, Second Workshop on Digital Media and its Application in Museum & Heritages (DMAMH 2007).

[30]  Chih-Heng Ke,et al.  The Packet Loss Effect on MPEG Video Transmission in Wireless Networks , 2006, 20th International Conference on Advanced Information Networking and Applications - Volume 1 (AINA'06).

[31]  Weisi Lin,et al.  Low bit rate quality assessment based on perceptual characteristics , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[32]  Alan C. Bovik,et al.  41 OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[33]  A. Bovik,et al.  OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[34]  Anastasios Kourtis,et al.  Quantified PQoS assessment based on fast estimation of the spatial and temporal activity level , 2007, Multimedia Tools and Applications.

[35]  Stefan Winkler,et al.  Segmentation-driven perceptual quality metrics , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[36]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[37]  Alan C. Bovik,et al.  . Efficient DCT-domain blind measurement and reduction of blocking artifacts , 2002, IEEE Trans. Circuits Syst. Video Technol..

[38]  Borko Furht,et al.  Handbook of Video Databases: Design and Applications , 2003 .