Packet loss visibility across SD, HD, 3D, and UHD video streams

Video quality is analysed by packetization, packet loss, and codec.The paper goes beyond prior studies as it tests SD, HD, 3D, and 4kUHD video.Simulations and network experiments include VBR, CBR, H.264 and HEVC streaming.The paper forecasts bitrates and expected quality in error-prone environments.The impact of packet reordering and duplication is also considered. The trend towards video streaming with increased spatial resolutions and dimensions, SD, HD, 3D, and 4kUHD, even for portable devices has important implications for displayed video quality. There is an interplay between packetization, packet loss visibility, choice of codec, and viewing conditions, which implies that prior studies at lower resolutions may not be as relevant. This paper presents two sets of experiments, the one at a Variable BitRate (VBR) and the other at a Constant BitRate (CBR), which highlight different aspects of the interpretation. The latter experiments also compare and contrast encoding with either an H.264 or an High Efficiency Video Coding (HEVC) codec, with all results recorded as objective Mean Opinion Score (MOS). The video quality assessments will be of interest to those considering: the bitrates and expected quality in error-prone environments; or, in fact, whether to use a reliable transport protocol to prevent all errors, at a cost in jitter and latency, rather than tolerate low levels of packet errors.

[1]  Bernd Girod,et al.  Analysis of packet loss for compressed video: does burst-length matter? , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[2]  Wojtek J. Krzanowski,et al.  Principles of multivariate analysis : a user's perspective. oxford , 1988 .

[3]  Federica Battisti,et al.  QoS to QoE mapping model for wired/wireless video communication , 2014, 2014 Euro Med Telco Conference (EMTC).

[4]  Charles Poynton,et al.  Digital Video and HDTV Algorithms and Interfaces , 2012 .

[5]  Sebastian Bosse,et al.  Toward a Direct Measure of Video Quality Perception Using EEG , 2012, IEEE Transactions on Image Processing.

[6]  Amy R. Reibman,et al.  Predicting packet-loss visibility using scene characteristics , 2007, Packet Video 2007.

[7]  Brian Everitt,et al.  Principles of Multivariate Analysis , 2001 .

[8]  Tao Chen,et al.  3D-TV Content Storage and Transmission , 2011, IEEE Transactions on Broadcasting.

[9]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[10]  Colin Perkins,et al.  RTP: Audio and Video for the Internet , 2003 .

[11]  Gregory W. Cermak,et al.  HDTV Subjective Quality of H.264 vs. MPEG-2, With and Without Packet Loss , 2010, IEEE Transactions on Broadcasting.

[12]  Sujata Banerjee,et al.  Metrics for Evaluating Video Streaming Quality in Lossy IEEE 802.11 Wireless Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[13]  Steffen Beich,et al.  Digital Video And Hdtv Algorithms And Interfaces , 2016 .

[14]  Colin Perkins,et al.  Packet reordering, high speed networks and transport protocol performance , 2004, Proceedings. 13th International Conference on Computer Communications and Networks (IEEE Cat. No.04EX969).

[15]  Alexander Raake,et al.  No-reference bit stream model for video quality assessment of h.264/AVC video based on packet loss visibility , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  José C. López-Ardao,et al.  Towards a General Parametric Model for Perceptual Video Quality Estimation , 2013, IEEE Transactions on Broadcasting.

[17]  W.A.C. Fernando,et al.  A compound depth and image quality metric for measuring the effects of packet loss on 3D video , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[18]  Roksana Boreli,et al.  Mitigating the Impact of Packet Reordering to Maximize Performance of Multimedia Applications , 2011, 2011 IEEE International Conference on Communications (ICC).

[19]  Lena Schwartz Next Generation Wireless Lans 802 11n And 802 11ac , 2016 .

[20]  Gregory W. Cermak,et al.  Subjective video quality as a function of bit rate frame rate, packet loss, and codec , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[21]  Bernd Girod,et al.  Advances in channel-adaptive video streaming , 2002, Proceedings. International Conference on Image Processing.

[22]  Yao Zhao,et al.  Joint redundant motion vector and intra macroblock refreshment for video transmission , 2011, EURASIP J. Image Video Process..

[23]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[24]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[25]  R. Jain Quality of experience , 2004, IEEE MultiMedia.

[26]  Ahmet M. Kondoz,et al.  Predicting sensation of depth in 3D video , 2010 .

[27]  Donald F. Towsley,et al.  Measurement and Classification of Out-of-Sequence Packets in a Tier-1 IP Backbone , 2002, IEEE/ACM Transactions on Networking.

[28]  Patrick Le Callet,et al.  PERCEPTUAL EFFECTS OF PACKET LOSS ON H.264/AVC ENCODED VIDEOS , 2009 .

[29]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  C.-C. Jay Kuo,et al.  Subjective and Objective Video Quality Assessment of 3D Synthesized Views With Texture/Depth Compression Distortion , 2015, IEEE Transactions on Image Processing.

[31]  James Nightingale,et al.  The impact of network impairment on quality of experience (QoE) in H.265/HEVC video streaming , 2014, IEEE Transactions on Consumer Electronics.

[32]  Pamela C. Cosman,et al.  Predicting H.264 Packet Loss Visibility using a Generalized Linear Model , 2006, 2006 International Conference on Image Processing.

[33]  G. W. Snedecor Statistical Methods , 1964 .

[34]  Stuart D. Walker,et al.  Ultra-high definition Wireless Video transmission using H.264 over 802.11n WLAN: Challenges and performance evaluation , 2013, Proceedings of the 12th International Conference on Telecommunications.

[35]  Pamela C. Cosman,et al.  Modeling packet-loss visibility in MPEG-2 video , 2006, IEEE Transactions on Multimedia.

[36]  Rahul Vanam,et al.  Improved Rate Control and Motion Estimation for H.264 Encoder , 2007, 2007 IEEE International Conference on Image Processing.

[37]  James Nightingale,et al.  HEVStream: a framework for streaming and evaluation of high efficiency video coding (HEVC) content in loss-prone networks , 2012, IEEE Transactions on Consumer Electronics.

[38]  Munchurl Kim,et al.  Assessments of Subjective Video Quality on HEVC-Encoded 4K-UHD Video for Beyond-HDTV Broadcasting Services , 2013, IEEE Transactions on Broadcasting.

[39]  Gang Liu,et al.  Cloud transcoder: bridging the format and resolution gap between internet videos and mobile devices , 2012, NOSSDAV '12.

[40]  King Ngi Ngan,et al.  Full-Reference Video Quality Assessment by Decoupling Detail Losses and Additive Impairments , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  Alan C. Bovik,et al.  Wireless Video Quality Assessment: A Study of Subjective Scores and Objective Algorithms , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Lingfen Sun,et al.  QoE Prediction Model and its Application in Video Quality Adaptation Over UMTS Networks , 2012, IEEE Transactions on Multimedia.

[44]  Hans Hoffmann,et al.  A Novel Method for Subjective Picture Quality Assessment and Further Studies of HDTV Formats , 2008, IEEE Transactions on Broadcasting.

[45]  Mohit Sharma,et al.  A true multistandard, programmable, low-power, full HD video-codec engine for smartphone SoC , 2012, 2012 IEEE International Solid-State Circuits Conference.

[46]  Stefano Tubaro,et al.  Subjective Quality Assessment of H.264/AVC Video Streaming with Packet Losses , 2011, EURASIP J. Image Video Process..

[47]  Mainak Chatterjee,et al.  Case Study of Internet Links: What Degrades Video QoE? , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[48]  Y. Wang,et al.  Video plus depth compression for mobile 3D services , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[49]  Pamela C. Cosman,et al.  Classification of MPEG-2 Transport Stream packet loss visibility , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[50]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[51]  Gerardo Rubino,et al.  A study of real-time packet video quality using random neural networks , 2002, IEEE Trans. Circuits Syst. Video Technol..

[52]  Laurence B. Milstein,et al.  A Markov model for block errors on fading channels , 1996, Proceedings of PIMRC '96 - 7th International Symposium on Personal, Indoor, and Mobile Communications.

[53]  Benny Bing 3D and HD Broadband Video Networking , 2010 .