Full-Reference Video Quality Metric for Fully Scalable and Mobile SVC Content

Universal Multimedia Access (UMA) aims at enabling a straightforward consumption of multimedia content in heterogeneous usage environments. These usage environments may range from mobile devices in a wireless network to high-end desktop computers with wired network connectivity. Scalable video content can be used to deal with the restrictions and capabilities of diverse usage environments. However, in order to optimally tailor scalable video content along the temporal, spatial, or perceptual quality axis, a metric is needed that reliably models subjective video quality. The major contribution of this paper is the development of a novel full-reference quality metric for scalable video bit streams that are compliant with the H.264/AVC Scalable Video Coding (SVC) standard. The scalable video bit streams are intended to be used in mobile usage environments (e.g., adaptive video streaming to mobile devices). The proposed quality metric allows modeling the temporal, spatial, and perceptual quality characteristics of SVC-compliant bit streams by taking into account several properties of the compressed bit streams. These properties include the temporal and spatial variance of the video content, the frame rate, the spatial resolution, and PSNR values. An extensive number of subjective experiments have been conducted to construct and validate our quality metric. Experimental results show that the average correlation coefficient for the video sequences tested is as high as 0.95 (compared to a value of 0.60 when only using the traditional PSNR quality metric). The proposed quality metric also shows a performance that is a uniformly high for video sequences with different temporal and spatial characteristics.

[1]  Weisi Lin,et al.  Perceptual quality metric for compressed videos , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[2]  Pierre Bretillon,et al.  Objective quality monitoring issues in digital broadcasting networks , 2005, IEEE Transactions on Broadcasting.

[3]  M. Angela Sasse,et al.  Can small be beautiful?: assessing image resolution requirements for mobile TV , 2005, MULTIMEDIA '05.

[4]  Rosario El-Feghali,et al.  Video Quality Metric for Bit Rate Control via Joint Adjustment of Quantization and Frame Rate , 2007, IEEE Transactions on Broadcasting.

[5]  Lea Skorin-Kapov,et al.  End-to-End QoS Signaling for Future Multimedia Services in the NGN , 2006, NEW2AN.

[6]  Cable Ieee Broadcast IEEE transactions on broadcasting , 1963 .

[7]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Yong Man Ro,et al.  Bit-stream extraction to maximize perceptual quality using quality information table in SVC , 2006, Electronic Imaging.

[9]  J. Rodgers,et al.  Thirteen ways to look at the correlation coefficient , 1988 .

[10]  Frédéric Dufaux,et al.  Constrained bit-rate control for very low bit-rate streaming-video applications , 2001, IEEE Trans. Circuits Syst. Video Technol..

[11]  Ajay Divakaran An Overview of MPEG-7 Motion Descriptors and Their Applications , 2001, CAIP.

[12]  Jinwoo Hong,et al.  Development of QoS-Aware Ubiquitous Content Access (UCA) Testbed , 2007, IEEE Transactions on Consumer Electronics.

[13]  Yong Man Ro,et al.  Quality metric for H.264/AVC scalable video coding with full scalability , 2007, Electronic Imaging.

[14]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[15]  Markus Rupp,et al.  Video Quality Estimation for Mobile H.264/AVC Video Streaming , 2008, J. Commun..

[16]  Andrew T. Campbell,et al.  QoS adaptive transports: delivering scalable media to the desktop , 1997 .

[17]  Stephen D. Voran,et al.  Objective video quality assessment system based on human perception , 1993, Electronic Imaging.

[18]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[19]  Stephen Wolf,et al.  Video Quality Measurement Techniques , 2002 .

[20]  Mohammed Ghanbari,et al.  A comparison of subjective video quality assessment methods for low-bit rate and low-resolution video , 2005, SIP.

[21]  Stefan Winkler,et al.  Perceptual distortion metric for digital color video , 1999, Electronic Imaging.

[22]  Weisi Lin,et al.  Perceptual Quality Metric for H.264 Low Bit Rate Videos , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[23]  Lew B. Stelmach,et al.  All subjective scales are not created equal: The effects of context on different scales , 1999, Signal Process..

[24]  L. Orozco-Barbosa,et al.  Study of video quality metrics for MPEG-2 based video communications , 1999, 1999 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM 1999). Conference Proceedings (Cat. No.99CH36368).

[25]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[26]  Joe F. Chicharo,et al.  Universal multimedia access from wired and wireless systems , 2001 .

[27]  Anastasios Kourtis,et al.  Quantified PQoS assessment based on fast estimation of the spatial and temporal activity level , 2007, Multimedia Tools and Applications.

[28]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[29]  Andrew Perkis,et al.  Evaluation and monitoring of video quality for UMA enabled video streaming systems , 2007, Multimedia Tools and Applications.

[30]  Markus Rupp,et al.  Quality assessment for H.264 coded low-rate and low-resolution video sequences , 2004, Communications, Internet, and Information Technology.

[31]  H.-J. Zepernick,et al.  Perceptual-based Quality Metrics for Image and Video Services: A Survey , 2007, 2007 Next Generation Internet Networks.

[32]  Liam Murphy,et al.  Subjective assessment of the quality-oriented adaptive scheme , 2005, IEEE Transactions on Broadcasting.

[33]  Thomas Sikora,et al.  The MPEG-7 visual standard for content description-an overview , 2001, IEEE Trans. Circuits Syst. Video Technol..

[34]  Weisi Lin,et al.  LOW BIT RATE VIDEO QUALITY ASSESSMENT BASED ON PERCEPTUAL CHARACTERISTICS , 2003 .

[35]  John Cosmas,et al.  Mobile audio-visual terminal: system design and subjective testing in DECT and UMTS networks , 2000, IEEE Trans. Veh. Technol..

[36]  Stefan Winkler,et al.  Video quality evaluation for mobile streaming applications , 2003, Visual Communications and Image Processing.

[37]  Shih-Fu Chang,et al.  Video Adaptation: Concepts, Technologies, and Open Issues , 2005, Proceedings of the IEEE.

[38]  C. Won,et al.  Efficient Use of MPEG‐7 Edge Histogram Descriptor , 2002 .