Error-resilient packet-switched mobile video telephony with channel-adaptive rateless coding and early reference picture selection

Providing high-quality video for packet-switched wireless video telephony on handheld devices is a challenging task due to packet loss, varying bandwidth, and end-to-end delay constraints. While many error resilience techniques have been proposed for video transmission over wireless channels, only a few were specifically designed for mobile video telephony. We propose a low-complexity channel-adaptive error resilience technique for packet-switched mobile video telephony, which combines rateless coding, feedback, and reference picture selection. In contrast to previous approaches, our technique uses cumulative feedback at every transmission opportunity and predicts when decoding is likely to fail so that reference picture selection can be triggered at an early stage. Experimental results for H.264 video sequences show that the proposed technique can achieve improvements of 1.64 dB in peak signal-to-noise ratio over benchmark techniques in simulated Long-Term Evolution networks.

[1]  Prasant Mohapatra,et al.  Improving mobile video telephony , 2014, 2014 Eleventh Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[2]  Thomas Stockhammer,et al.  RaptorQ Forward Error Correction Scheme for Object Delivery , 2011, RFC.

[3]  Xiangjian He,et al.  Survey of Error Concealment techniques: Research directions and open issues , 2015, 2015 Picture Coding Symposium (PCS).

[4]  Doe Hyun Yoon,et al.  Spiral intra macroblock refresh with motion vector restriction for low bit-rate video telephony over a 3G network , 2004, IEEE Transactions on Consumer Electronics.

[5]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Shakeel Ahmad,et al.  Error-resilient packet switched H.264 mobile video telephony with LT coding and reference picture selection , 2009, 2009 17th European Signal Processing Conference.

[7]  Aggelos K. Katsaggelos,et al.  Review of Error Resilient Coding Techniques for Real-Time Video Communications , 2000 .

[8]  Thomas Stockhammer,et al.  Interactive Error Control for Mobile Video Telephony , 2007, 2007 IEEE International Conference on Communications.

[9]  Jörg Ott,et al.  Evaluation of Error Resilience Mechanisms for 3G Conversational Video , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[10]  Dapeng Wu,et al.  Estimation of accurate effective loss rate for FEC video transmission , 2014, Signal Process. Image Commun..

[11]  Klaus Diepold,et al.  Complexity Constrained Robust Video Transmission for Hand-Held Devices , 2007, 2007 IEEE International Conference on Image Processing.

[12]  Qionghai Dai,et al.  Channel-adaptive hybrid ARQ/FEC for robust video transmission over 3G , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[13]  Farooq Khan,et al.  LTE for 4G Mobile Broadband: Air Interface Technologies and Performance , 2009 .

[14]  L. B. Milstein,et al.  On the accuracy of a first-order Markov model for data transmission on fading channels , 1995, Proceedings of ICUPC '95 - 4th IEEE International Conference on Universal Personal Communications.

[15]  Bernd Girod,et al.  Feedback-based error control for mobile video transmission , 1999, Proc. IEEE.

[16]  Michael Luby,et al.  LT codes , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[17]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Xiuzi Ye,et al.  Error resilience schemes of H.264/AVC for 3G conversational video services , 2005, The Fifth International Conference on Computer and Information Technology (CIT'05).

[19]  Shakeel Ahmad,et al.  Unequal Error Protection Using Fountain Codes With Applications to Video Communication , 2011, IEEE Transactions on Multimedia.

[20]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[21]  Ci Wang,et al.  A novel error recovery scheme for H.264 video and its application in conversational services , 2004, IEEE Trans. Consumer Electron..

[22]  Ming-Ting Sun,et al.  Wireless video transport using conditional retransmission and low-delay interleaving , 2002, IEEE Trans. Circuits Syst. Video Technol..

[23]  Min Chen,et al.  Multi-stages hybrid ARQ with conditional frame skipping and reference frame selecting scheme for real-time video transport over wireless LAN , 2004, IEEE Transactions on Consumer Electronics.

[24]  Shakeel Ahmad,et al.  Error resilient packet-switched video telephony with adaptive rateless coding and reference picture selection. , 2010 .

[25]  Mário Serafim Nunes,et al.  Video quality optimization algorithm for video-telephony over IP networks , 2010, 21st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.

[26]  Tarik Taleb,et al.  Forward error correction strategies for media streaming over wireless networks , 2008, IEEE Communications Magazine.

[27]  Byung-Gyu Kim,et al.  An efficient delay-constrained ARQ scheme for MMT packet-based real-time video streaming over IP networks , 2015, Journal of Real-Time Image Processing.

[28]  Antti Toskala,et al.  LTE for UMTS - OFDMA and SC-FDMA Based Radio Access , 2009 .

[29]  Yang Xu,et al.  “Can you SEE me now?” A measurement study of mobile video calls , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.