Optimized cross-layer forward error correction coding for H.264 AVC video transmission over wireless channels

Forward error correction (FEC) codes that can provide unequal error protection (UEP) have been used recently for video transmission over wireless channels. These video transmission schemes may also benefit from the use of FEC codes both at the application layer (AL) and the physical layer (PL). However, the interaction and optimal setup of UEP FEC codes at the AL and the PL have not been previously investigated. In this paper, we study the cross-layer design of FEC codes at both layers for H.264 video transmission over wireless channels. In our scheme, UEP Luby transform codes are employed at the AL and rate-compatible punctured convolutional codes at the PL. In the proposed scheme, video slices are first prioritized based on their contribution to video quality. Next, we investigate the four combinations of cross-layer FEC schemes at both layers and concurrently optimize their parameters to minimize the video distortion and maximize the peak signal-to-noise ratio. We evaluate the performance of these schemes on four test H.264 video streams and show the superiority of optimized cross-layer FEC design.

[1]  Philip Koopman,et al.  Cyclic redundancy code (CRC) polynomial selection for embedded networks , 2004, International Conference on Dependable Systems and Networks, 2004.

[2]  Nazanin Rahnavard,et al.  Generalization of Rateless Codes for Unequal Error Protection and Recovery Time: Asymptotic Analysis , 2006, 2006 IEEE International Symposium on Information Theory.

[3]  Christos Bouras,et al.  A study of forward error correction for mobile multicast , 2011, Int. J. Commun. Syst..

[4]  A. Serdar Tan,et al.  Rate-distortion optimized layered stereoscopic video streaming with raptor codes , 2007, Packet Video 2007.

[5]  Pamela C. Cosman,et al.  Wireless H.264 Video Quality Enhancement Through Optimal Prioritized Packet Fragmentation , 2012, IEEE Transactions on Multimedia.

[6]  David Gomez-Barquero,et al.  Application Layer FEC for Improved Mobile Reception of DVB-H Streaming Services , 2006, IEEE Vehicular Technology Conference.

[7]  Thomas Stockhammer,et al.  Application Layer Forward Error Correction for Mobile Multimedia Broadcasting , 2008 .

[8]  Enrico Magli,et al.  Sliding-Window Raptor Codes for Efficient Scalable Wireless Video Broadcasting With Unequal Loss Protection , 2010, IEEE Transactions on Image Processing.

[9]  Andrea J. Goldsmith,et al.  Cross-layer design of ad hoc networks for real-time video streaming , 2005, IEEE Wireless Communications.

[10]  David Coley,et al.  Introduction to Genetic Algorithms for Scientists and Engineers , 1999 .

[11]  Sethuraman Panchanathan,et al.  Special issue on emerging H.264/AVC video coding standard , 2006, J. Vis. Commun. Image Represent..

[12]  Thomas Stockhammer,et al.  Video Streaming over MBMS: A System Design Approach , 2006, J. Multim..

[13]  Robert G. Gallager,et al.  Low-density parity-check codes , 1962, IRE Trans. Inf. Theory.

[14]  Thomas Stockhammer,et al.  On practical crosslayer aspects in 3GPP video services , 2007, MV '07.

[15]  Joachim Hagenauer,et al.  Rate-compatible punctured convolutional codes (RCPC codes) and their applications , 1988, IEEE Trans. Commun..

[16]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[17]  Xingjun Zhang,et al.  Robust video transmission over lossy network by exploiting H.264/AVC data partitioning , 2008, 2008 5th International Conference on Broadband Communications, Networks and Systems.

[18]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[19]  Nazanin Rahnavard,et al.  Unequal error protection rateless coding for efficient MPEG video transmission , 2009, MILCOM 2009 - 2009 IEEE Military Communications Conference.

[20]  Michael Luby,et al.  LT codes , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[21]  Hojin Ha,et al.  Layer-weighted unequal error protection for scalable video coding extension of H.264/AVC , 2008, IEEE Transactions on Consumer Electronics.

[22]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[23]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[24]  M. van der Schaar,et al.  Cross-layer wireless multimedia transmission: challenges, principles, and new paradigms , 2005, IEEE Wireless Communications.

[25]  Michael G. Strintzis,et al.  Robust Transmission of H.264/AVC Streams Using Adaptive Group Slicing and Unequal Error Protection , 2006, EURASIP J. Adv. Signal Process..

[26]  Borko Furht,et al.  Handbook of Mobile Broadcasting: DVB-H, DMB, ISDB-T, AND MEDIAFLO , 2008 .

[27]  Thomas Stockhammer,et al.  Communication Networks Enhanced system design for download and streaming services using Raptor codes , 2009, Eur. Trans. Telecommun..

[28]  Chengke Wu,et al.  A novel unequal loss protection approach for scalable video streaming over wireless networks , 2007, IEEE Trans. Consumer Electron..

[29]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[30]  Sethuraman Panchanathan,et al.  Error resiliency schemes in H.264/AVC standard , 2006, J. Vis. Commun. Image Represent..

[31]  Rajarathnam Chandramouli,et al.  Reliable Multimedia Transmission Over Cognitive Radio Networks Using Fountain Codes , 2008, Proceedings of the IEEE.

[32]  Gabriella Olmo,et al.  Slice Sorting for Unequal Loss Protection of Video Streams , 2008, IEEE Signal Processing Letters.

[33]  Christos Bouras,et al.  Application layer forward error correction for multicast streaming over LTE networks , 2013, Int. J. Commun. Syst..

[34]  Jérôme Lacan,et al.  Dependency-aware unequal erasure protection codes , 2006 .

[35]  Zabih Ghassemlooy,et al.  A MIMO-ANN system for increasing data rates in organic visible light communications systems , 2013, 2013 IEEE International Conference on Communications (ICC).

[36]  Sunil Kumar,et al.  Robust H.264/AVC video coding with priority classification, adaptive NALU size and fragmentation , 2009, MILCOM 2009 - 2009 IEEE Military Communications Conference.

[37]  Zixiang Xiong,et al.  Scalable Video Multicast Using Expanding Window Fountain Codes , 2009, IEEE Transactions on Multimedia.

[38]  Thomas Stockhammer,et al.  Asynchronous Media Streaming Over Wireless Broadcast Channels , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[39]  Thomas Stockhammer,et al.  Mobile data broadcasting over MBMS tradeoffs in forward error correction , 2006, MUM '06.

[40]  Pamela C. Cosman,et al.  Predicting slice loss distortion in H.264/AVC video for low complexity data prioritization , 2012, 2012 19th IEEE International Conference on Image Processing.

[41]  Aggelos K. Katsaggelos,et al.  Unequal Error Protection for Robust Streaming of Scalable Video Over Packet Lossy Networks , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  M.G. Strintzis,et al.  Robust Transmission of Multi-View Video Streams using Flexible Macroblock Ordering and Systematic LT Codes , 2007, 2007 3DTV Conference.

[43]  Shakeel Ahmad,et al.  Robust live unicast video streaming with rateless codes , 2007, Packet Video 2007.

[44]  H. Vincent Poor,et al.  Compressive autonomous sensing (CASe) for wideband spectrum sensing , 2012, 2012 IEEE International Conference on Communications (ICC).

[45]  Nazanin Rahnavard,et al.  Rateless Codes With Unequal Error Protection Property , 2007, IEEE Transactions on Information Theory.

[46]  Chee Kheong Siew,et al.  Forward Error Correction-Based 2-D Layered Multiple Description Coding for Error-Resilient H.264 SVC Video Transmission , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[47]  Zixiang Xiong,et al.  Expanding Window Fountain codes for scalable video multicast , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[48]  Shakeel Ahmad,et al.  Adaptive Unicast Video Streaming With Rateless Codes and Feedback , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[49]  Jörg Widmer,et al.  Broadcast video streaming in cellular networks: An adaptation framework for channel, video and AL-FEC rates allocation , 2010, 2010 The 5th Annual ICST Wireless Internet Conference (WICON).

[50]  Chang Wen Chen,et al.  Proceedings of the international workshop on Workshop on mobile video , 2007, MM 2007.

[51]  Richard D. Wesel,et al.  A Cross-Layer Perspective on Rateless Coding for Wireless Channels , 2009, 2009 IEEE International Conference on Communications.

[52]  Naohisa Ohta.  Packet Video , 1994 .

[53]  John R. Koza,et al.  Survey of genetic algorithms and genetic programming , 1995, Proceedings of WESCON'95.

[54]  Songyu Yu,et al.  Adaptive unequal loss protection for scalable video streaming over IP networks , 2005, IEEE Transactions on Consumer Electronics.

[55]  Thomas Wiegand,et al.  Receiver driven layered multicast with layer-aware forward error correction , 2008, 2008 15th IEEE International Conference on Image Processing.