A cloud-assisted DASH-based Scalable Interactive Multiview Video Streaming framework

Interactive multiview video streaming (IMVS) allows viewers to periodically switch viewpoint. Its user experience can be further enhanced by creating virtual views from neighboring coded views using view synthesis techniques. Dynamic adaptive streaming over HTTP (DASH) is a new standard that can adjust the quality of video streaming according to the network condition. In this paper, we propose an improved DASH-based IMVS scheme over wireless networks. The main contributions are twofold. First, our scheme allows virtual views to be generated at either the cloud-based server or the client, and can adaptively select the optimal approach based on the network condition and the cost of the cloud. Second, scalable video coding is used in our system. Simulations with the NS3 tool demonstrate the advantage of our proposed scheme over the existing approach with client-based view synthesis and single-layer video coding.

[1]  Moncef Gabbouj,et al.  Rate adaptation for adaptive HTTP streaming , 2011, MMSys.

[2]  Antonio Ortega,et al.  Interactive Streaming of Stored Multiview Video Using Redundant Frame Structures , 2011, IEEE Transactions on Image Processing.

[3]  Lei Zhou,et al.  DASH(HEVC)/LTE: QoE-based dynamic adaptive streaming of HEVC content over wireless networks , 2012, 2012 Visual Communications and Image Processing.

[4]  Thomas Wiegand,et al.  Efficient HTTP-based streaming using Scalable Video Coding , 2012, Signal Process. Image Commun..

[5]  Kevin C. Almeroth,et al.  Receiver driven rate adaptation for wireless multimedia applications , 2012, MMSys '12.

[6]  Gene Cheung,et al.  Delay-Cognizant Interactive Streaming of Multiview Video With Free Viewpoint Synthesis , 2012, IEEE Transactions on Multimedia.

[7]  Mahbub Hassan,et al.  HTTP-Based Adaptive Streaming for Mobile Clients using Markov Decision Process , 2013, 2013 20th International Packet Video Workshop.

[8]  张云.  Regional bit allocation and rate distortion optimization for multiview depth video coding with View synthesis distortion model , 2013 .

[9]  Lin Cai,et al.  A Real-Time Adaptive Algorithm for Video Streaming over Multiple Wireless Access Networks , 2014, IEEE Journal on Selected Areas in Communications.

[10]  Xirong Que,et al.  Scheduling and resource allocation for wireless dynamic adaptive streaming of scalable videos over HTTP , 2014, 2014 IEEE International Conference on Communications (ICC).

[11]  Mohamed Hefeeda,et al.  A DASH-based Free Viewpoint Video Streaming System , 2014, NOSSDAV 2014.

[12]  Wendong Wang,et al.  QoE-Driven Cross-Layer Optimization for Wireless Dynamic Adaptive Streaming of Scalable Videos Over HTTP , 2015, IEEE Transactions on Circuits and Systems for Video Technology.