Delivering High-Frame-Rate Video to Mobile Devices in Heterogeneous Wireless Networks

High-frame rate (HFR) video streaming is emerging as a new paradigm in popular multimedia applications (e.g., mobile cloud gaming) to achieve smooth viewing experience perceived by end users. However, it is severely challenging to guarantee the delivery quality of HFR video over wireless platforms with regard to the high transmission rate and limited network resources. Multihoming capability enables mobile devices to concurrently receive video data with different radio interfaces (e.g., cellular and Wi-Fi). To effectively deliver mobile HFR video over multiple wireless access networks, this paper develops an application-layer transmission scheme dubbed joint FRAme Scheduling and Error Resilience (FRASER). First, we propose an unequal frame scheduling approach by taking advantage of interlaced forward error correction coding and reliability-aware data allocation to minimize the total distortion. Second, we introduce an error resilience scheme at the receiver side to proactively leverage the out-of-order and overdue video packets to mitigate the error propagations. The proposed FRASER is able to substantially reduce the probability of I (Intra) frame loss and consecutive P (Predicted) frame drops. We conduct the performance evaluation through extensive emulations in Exata involving HFR video streaming encoded with H.264 codec. Evaluation results show that FRASER outperforms the reference transmission schemes in terms of video peak signal-to-noise ratio, end-to-end delay, and received frame rate. Thus, FRASER is recommended for delivering HFR video streaming to multihomed mobile devices in heterogeneous wireless networks.

[1]  Pascal Frossard FEC performance in multimedia streaming , 2001, IEEE Communications Letters.

[2]  Ming Wang,et al.  TCP-Oriented Raptor Coding for High-Frame-Rate Video Transmission Over Wireless Networks , 2016, IEEE Journal on Selected Areas in Communications.

[3]  Anumula Satheesh,et al.  Joint Cloud and Wireless Networks Operations in Mobile Cloud Computing Environments With Telecom Operator Cloud , 2016 .

[4]  Ming Wang,et al.  Energy Minimization for Quality-Constrained Video with Multipath TCP over Heterogeneous Wireless Networks , 2016, 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS).

[5]  Ming Wang,et al.  Energy-Minimized Multipath Video Transport to Mobile Devices in Heterogeneous Wireless Networks , 2016, IEEE Journal on Selected Areas in Communications.

[6]  Koushik Kar,et al.  A Transport Protocol to Exploit Multipath Diversity in Wireless Networks , 2012, IEEE/ACM Transactions on Networking.

[7]  Michael G. Strintzis,et al.  Robust Transmission of H.264/AVC Video using Adaptive Slice Grouping and Unequal Error Protection , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[8]  Cheng-Hsin Hsu,et al.  On the Quality of Service of Cloud Gaming Systems , 2014, IEEE Transactions on Multimedia.

[9]  Lin Cai,et al.  A Real-Time Adaptive Algorithm for Video Streaming over Multiple Wireless Access Networks , 2014, IEEE Journal on Selected Areas in Communications.

[10]  Hwangjun Song,et al.  MPMTP: Multipath Multimedia Transport Protocol using Systematic Raptor Codes over Wireless Networks , 2015, IEEE Transactions on Mobile Computing.

[11]  Gerhard Haßlinger,et al.  The Gilbert-Elliott Model for Packet Loss in Real Time Services on the Internet , 2011, MMB.

[12]  Jiyan Wu,et al.  Loss Tolerant Bandwidth Aggregation for multihomed video streaming over heterogeneous wireless networks , 2013, GLOBECOM.

[13]  Hongke Zhang,et al.  CMT-QA: Quality-Aware Adaptive Concurrent Multipath Data Transfer in Heterogeneous Wireless Networks , 2013, IEEE Transactions on Mobile Computing.

[14]  Ming Wang,et al.  Bandwidth-Efficient Multipath Transport Protocol for Quality-Guaranteed Real-Time Video Over Heterogeneous Wireless Networks , 2016, IEEE Transactions on Communications.

[15]  Shipeng Li,et al.  High frame rate screen video coding for screen sharing applications , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[16]  Chau Yuen,et al.  Modeling and Optimization of High Frame Rate Video Transmission Over Wireless Networks , 2016, IEEE Transactions on Wireless Communications.

[17]  Jian He,et al.  iCloudAccess: Cost-Effective Streaming of Video Games From the Cloud With Low Latency , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Jörg Ott,et al.  MPRTP: multipath considerations for real-time media , 2013, MMSys.

[19]  Bernd Girod,et al.  Analysis of Packet Loss for Compressed Video: Effect of Burst Losses and Correlation Between Error Frames , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Chau Yuen,et al.  Distortion-Aware Concurrent Multipath Transfer for Mobile Video Streaming in Heterogeneous Wireless Networks , 2014, IEEE Transactions on Mobile Computing.

[21]  Chau Yuen,et al.  Enabling Adaptive High-Frame-Rate Video Streaming in Mobile Cloud Gaming Applications , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Thomas Stockhammer,et al.  RaptorQ Forward Error Correction Scheme for Object Delivery , 2011, RFC.

[23]  Cheng-Hsin Hsu,et al.  Distortion-Aware Scalable Video Streaming to Multinetwork Clients , 2013, IEEE/ACM Transactions on Networking.

[24]  Gerhard Haßlinger,et al.  2-State (semi-)Markov processes beyond Gilbert-Elliott: Traffic and channel models based on 2nd order statistics , 2013, 2013 Proceedings IEEE INFOCOM.

[25]  SEONG-PING CHUAH,et al.  Cloud gaming: a green solution to massive multiplayer online games , 2014, IEEE Wireless Communications.

[26]  Gabriella Olmo,et al.  Slice Sorting for Unequal Loss Protection of Video Streams , 2008, IEEE Signal Processing Letters.

[27]  Ming Wang,et al.  Streaming High-Quality Mobile Video with Multipath TCP in Heterogeneous Wireless Networks , 2016, IEEE Transactions on Mobile Computing.

[28]  E. Gilbert Capacity of a burst-noise channel , 1960 .

[29]  Frank R. Kschischang,et al.  Applications of algebraic soft-decision decoding of Reed-Solomon codes , 2006, IEEE Transactions on Communications.

[30]  Jun Huang,et al.  Joint source-channel coding and optimization for mobile video streaming in heterogeneous wireless networks , 2013, EURASIP J. Wirel. Commun. Netw..

[31]  Mung Chiang,et al.  A scheduling framework for adaptive video delivery over cellular networks , 2013, MobiCom.

[32]  Wei Tu,et al.  Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks , 2010, IEEE Journal on Selected Areas in Communications.

[33]  Tansu Alpcan,et al.  Distributed Rate Allocation Policies for Multihomed Video Streaming Over Heterogeneous Access Networks , 2009, IEEE Transactions on Multimedia.

[34]  Kensuke Fukuda,et al.  Seven Years and One Day: Sketching the Evolution of Internet Traffic , 2009, IEEE INFOCOM 2009.

[35]  T. Moon Error Correction Coding: Mathematical Methods and Algorithms , 2005 .

[36]  Xiaodong Wang,et al.  Adaptive Transmission for Delay-Constrained Wireless Video , 2014, IEEE Transactions on Wireless Communications.

[37]  Chau Yuen,et al.  Goodput-Aware Load Distribution for Real-Time Traffic over Multipath Networks , 2015, IEEE Transactions on Parallel and Distributed Systems.

[38]  Weihua Zhuang,et al.  Energy and Content Aware Multi-Homing Video Transmission in Heterogeneous Networks , 2013, IEEE Transactions on Wireless Communications.

[39]  Chau Yuen,et al.  A low-latency scheduling approach for high-definition video streaming in a heterogeneous wireless network with multihomed clients , 2014, Multimedia Systems.

[40]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[41]  Mihaela van der Schaar,et al.  Cross-Layer Packetization and Retransmission Strategies for Delay-Sensitive Wireless Multimedia Transmission , 2007, IEEE Transactions on Multimedia.

[42]  Hwangjun Song,et al.  An End-to-End Virtual Path Construction System for Stable Live Video Streaming over Heterogeneous Wireless Networks , 2011, IEEE Journal on Selected Areas in Communications.

[43]  Yao Zhao,et al.  Multiple Description Coding for H.264/AVC With Redundancy Allocation at Macro Block Level , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[44]  Yue Deng,et al.  Joint non-Gaussian denoising and superresolving of raw high frame rate videos. , 2014, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[45]  Hongke Zhang,et al.  Cross-Layer Fairness-Driven Concurrent Multipath Video Delivery Over Heterogeneous Wireless Networks , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[46]  Frank R. Kschischang,et al.  Applications of Algebraic Soft-Decision Decoding of Reed–Solomon Codes , 2006 .

[47]  Guohong Cao,et al.  Energy-aware video streaming on smartphones , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[48]  Xiao Qin,et al.  An Availability-Aware Task Scheduling Strategy for Heterogeneous Systems , 2008, IEEE Transactions on Computers.

[49]  Thomas Stockhammer,et al.  Raptor Forward Error Correction Scheme for Object Delivery , 2007, RFC.

[50]  Wei Song,et al.  Performance Analysis of Probabilistic Multipath Transmission of Video Streaming Traffic over Multi-Radio Wireless Devices , 2012, IEEE Transactions on Wireless Communications.