Improving mobile video telephony

Video telephony is becoming popular over smart-phones and tablets. Unlike the Desktop era, smartphone users are often `mobile' and this impacts how the video is processed and transmitted over the network. The significant increase in the motion content in such videos change the composition of video frames. Coupled with wireless packet losses, it often leads to poor quality of video received by the end user. In this work, we propose RVD, a framework for Reliable Video Delivery in mobile telephony by accounting for video object motion comprising foreground end-user motion and background scene changes in the network transmission of video. Multilayer perceptron (MLP) based non-linear regression model is used to analyze the impact of redundancy on received video quality under network variations and different degrees of video motion. RVD achieves 17-25% bandwidth savings for a target video quality, and 50-56% quality improvement over video-oblivious approaches.

[1]  Donald F. Towsley,et al.  Adaptive FEC-based error control for Internet telephony , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[2]  Hari Balakrishnan,et al.  Cross-layer wireless bit rate adaptation , 2009, SIGCOMM '09.

[3]  Adam Wolisz,et al.  EvalVid - A Framework for Video Transmission and Quality Evaluation , 2003, Computer Performance Evaluation / TOOLS.

[4]  Tim Szigeti,et al.  Cisco TelePresence Fundamentals , 2009 .

[5]  Ce-Kuen Shieh,et al.  An unequal error protection mechanism for video streaming over IEEE 802.11e WLANs , 2012, Comput. Networks.

[6]  Maurizio Casoni,et al.  A tool for multimedia quality assessment in NS3: QoE Monitor , 2013, Simul. Model. Pract. Theory.

[7]  Tsuhan Chen,et al.  Robust wireless video streaming using hybrid spatial/temporal retransmission , 2010, IEEE Journal on Selected Areas in Communications.

[8]  Valery Naranjo,et al.  Shot detection method for low bit-rate H.264 video coding , 2006, 2006 14th European Signal Processing Conference.

[9]  Nick Feamster,et al.  Packet Loss Recovery for Streaming Video , 2002 .

[10]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[11]  Miska M. Hannuksela,et al.  RTP Payload Format for H.264 Video , 2005, RFC.

[12]  Prasant Mohapatra,et al.  Mobile video chat: issues and challenges , 2013, IEEE Communications Magazine.

[13]  Jue Wang,et al.  ChitChat: Making Video Chat Robust to Packet Loss , 2010 .

[14]  M. van der Schaar,et al.  Cross-layer wireless multimedia transmission: challenges, principles, and new paradigms , 2005, IEEE Wireless Communications.

[15]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[16]  John G. Apostolopoulos,et al.  Reliable video communication over lossy packet networks using multiple state encoding and path diversity , 2000, IS&T/SPIE Electronic Imaging.

[17]  Kuan-Ta Chen,et al.  Could Skype be more satisfying? a QoE-centric study of the FEC mechanism in an internet-scale VoIP system , 2010, IEEE Network.

[18]  David G. Messerschmitt,et al.  A progressively reliable transport protocol for interactive wireless multimedia , 1999, Multimedia Systems.

[19]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[20]  Sze Wei Lee,et al.  A fast forward error correction allocation algorithm for unequal error protection of video transmission over wireless channels , 2008, IEEE Transactions on Consumer Electronics.

[21]  Jorge Sastre,et al.  Variable frame rate and gop size H.264 rate control for mobile communications , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[22]  Thomas Wiegand,et al.  Layer-Aware Forward Error Correction for Mobile Broadcast of Layered Media , 2011, IEEE Transactions on Multimedia.

[23]  Magnus Westerlund,et al.  Codec Operation Point RTCP Extension , 2012 .

[24]  Ali C. Begen,et al.  Not All Packets Are Equal, Part 2: The Impact of Network Packet Loss on Video Quality , 2009, IEEE Internet Computing.

[25]  Mihaela van der Schaar,et al.  Cross-layer wireless multimedia transmission: challenges, principles, and new paradigms , 2005, IEEE Wirel. Commun..

[26]  Alexis M. Tourapis,et al.  Enhanced predictive zonal search for single and multiple frame motion estimation , 2002, IS&T/SPIE Electronic Imaging.

[27]  Yao Zhao,et al.  Real-time forward error correction for video transmission , 2011, 2011 Visual Communications and Image Processing (VCIP).

[28]  Vicki Bruce,et al.  The Role of the Face in Communication: Implications for Videophone Design , 1996, Interact. Comput..

[29]  Ahmed Karmouch,et al.  Vertical Mobility Management Architectures in Wireless Networks: A Comprehensive Survey and Future Directions , 2012, IEEE Communications Surveys & Tutorials.

[30]  Anastasis A. Sofokleous,et al.  Review: H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia , 2005, Comput. J..