Scene content driven FEC allocation for video streaming

Unequal error protection schemes applied on video data streams, considering varying importance of data packets over a group of pictures (GOP), are more efficient in terms of rate-distortion performance at different loss rates. Importance ordering policy adopted so far, mostly considered frame positions within a GOP. In the present work, we offer significant importance to the packets containing scene-transition frames, as these should be better error protected. We adopt a strategy of Forward Error Correcting (FEC) Code allocation, based on the minimization of end-to-end distortion up to the decoder, assuming that error concealment is adopted at the decoder. Two FEC allocation strategies are proposed within the Block of Packets (BOP) structure - one is an iterative modified hill climbing approach and the other is a reduced complexity heuristic approach. The Gilbert-Elliot model is used for the modeling of transmission channel. The proposed FEC allocation schemes outperform existing FEC allocation schemes in terms of PSNR for sequences with and without transitions, when transmitted over lossy channels.

[1]  Dong In Kim,et al.  Significance-Aware Channel Power Allocation for Wireless Multimedia Streaming , 2010, IEEE Transactions on Vehicular Technology.

[2]  Gabriella Olmo,et al.  Unequal Protection of Video Data According to Slice Relevance , 2011, IEEE Transactions on Image Processing.

[3]  Hamid Gharavi.  Trends in Multimedia Communications Over Mobile Networks | NIST , 2010 .

[4]  Madhu Sudan,et al.  Priority encoding transmission , 1996, IEEE Trans. Inf. Theory.

[5]  Richard E. Ladner,et al.  Unequal loss protection: graceful degradation of image quality over packet erasure channels through forward error correction , 2000, IEEE Journal on Selected Areas in Communications.

[6]  Narciso García,et al.  Lightweight multimedia packet prioritization model for unequal error protection , 2011, IEEE Transactions on Consumer Electronics.

[7]  Pamela C. Cosman,et al.  H.264/AVC video packet aggregation and unequal error protection for noisy channels , 2012, 2012 19th IEEE International Conference on Image Processing.

[8]  Richard E. Ladner,et al.  Unequal loss protection for H.263 compressed video , 2005, IEEE Trans. Circuits Syst. Video Technol..

[9]  Touradj Ebrahimi,et al.  Error-resilient video coding performance analysis of motion JPEG2000 and MPEG-4 , 2004, IS&T/SPIE Electronic Imaging.

[10]  Zhengguo Li,et al.  A Novel Rate Control Scheme for Low Delay Video Communication of H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Hojin Ha,et al.  Perceptually Unequal Packet Loss Protection by Weighting Saliency and Error Propagation , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Thomas Wiegand,et al.  Efficient HTTP-based streaming using Scalable Video Coding , 2012, Signal Process. Image Commun..

[14]  Somnath Sengupta,et al.  Hybrid temporal/spatial error concealment strategy robust to scene transitions , 2011, Proceedings of 2011 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[15]  Fernando Jaureguizar,et al.  A video-aware FEC-based unequal loss protection system for video streaming over RTP , 2011, IEEE Transactions on Consumer Electronics.

[16]  E. O. Elliott.  Estimates of error rates for codes on burst-noise channels , 1963 .

[17]  Harsha Sirisena,et al.  Hybrid error control mechanism for video transmission in the wireless IP networks , 1999, 10th IEEE Workshop on Local and Metropolitan Area Networks. Selected Papers (IEEE Cat. No.99EX512).

[18]  Warnakulasuriya Anil Chandana Fernando,et al.  Unequal Error Protection Technique for ROI Based H.264 Video Coding , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[19]  Van Jacobson,et al.  Compressing IP/UDP/RTP Headers for Low-Speed Serial Links , 1999, RFC.

[20]  Oscar C. Au,et al.  Edge-Directed Error Concealment , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Gabriella Olmo,et al.  Image and video transmission: a comparison study of using unequal loss protection and multiple description coding , 2011, Multimedia Tools and Applications.

[22]  Sethuraman Panchanathan,et al.  Error resiliency schemes in H.264/AVC standard , 2006, J. Vis. Commun. Image Represent..

[23]  Yücel Altunbasak,et al.  Error-resilient image and video transmission over the Internet using unequal error protection , 2003, IEEE Trans. Image Process..

[24]  Yong Pei,et al.  An Adaptive Motion-Based Unequal Error Protection Approach for Real-Time Video Transport Over Wireless IP Networks , 2006, IEEE Transactions on Multimedia.

[25]  R. Talluri,et al.  Error-resilient video coding in the ISO MPEG-4 standard , 1998, IEEE Commun. Mag..

[26]  Attilio Fiandrotti,et al.  Content-adaptive traffic prioritization of spatio-temporal scalable video for robust communications over QoS-provisioned 802.11e networks , 2010, Signal Process. Image Commun..

[27]  Zhengguo Li,et al.  An unequal packet loss resilience scheme for video over the Internet , 2005, IEEE Transactions on Multimedia.

[28]  Somnath Sengupta,et al.  Switchable video error concealment using encoder driven scene transition detection and edge preserving SEC , 2013, Multimedia Tools and Applications.

[29]  Nick Feamster,et al.  Packet Loss Recovery for Streaming Video , 2002 .

[30]  Wei Zhang,et al.  Distortion-Minimized Video Slicing for Unequal Loss Protection , 2009, IEEE Signal Processing Letters.

[31]  Pamela C. Cosman,et al.  Predicting slice loss distortion in H.264/AVC video for low complexity data prioritization , 2012, 2012 19th IEEE International Conference on Image Processing.

[32]  Thomas Maugey,et al.  Rate distorsion analysis in a disparity compensated scheme , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  E. Gilbert.  Capacity of a burst-noise channel , 1960 .

[34]  Bernd Girod,et al.  Packet-loss-resilient Internet video streaming , 1998, Electronic Imaging.

[35]  Ahmet M. Kondoz,et al.  Multi bearer channel resource allocation for optimised transmission of video objects , 2008, 2008 15th IEEE International Conference on Image Processing.

[36]  Laurence B. Milstein,et al.  Optimized Unequal Error Protection Using Multiplexed Hierarchical Modulation , 2012, IEEE Transactions on Information Theory.

[37]  Lap-Pui Chau,et al.  A novel unequal error protection approach for error resilient video transmission , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[38]  Miska M. Hannuksela,et al.  RTP Payload Format for H.264 Video , 2005, RFC.

[39]  Si Wu,et al.  Unequal loss protection for robust transmission of motion compensated video over the internet , 2003, Signal Process. Image Commun..

[40]  Soo-Chang Pei,et al.  Novel error concealment method with adaptive prediction to the abrupt and gradual scene changes , 2004, IEEE Trans. Multim..