MEC-Assisted Panoramic VR Video Streaming Over Millimeter Wave Mobile Networks

Panoramic virtual reality video (PVRV) is becoming increasingly popular since it offers a true immersive experience. However, the ultra-high resolution of PVRV requires significant bandwidth and ultra-low latency for PVRV streaming, something that makes challenging the extension of this application to mobile networks. Besides bandwidth, the frequent perspective viewport rendering induces a heavy computational load on battery-constrained mobile devices. To attack these problems jointly, this paper proposes a PVRV streaming system that is designed for modern multiconnectivity-based millimeter wave (mmWave) cellular networks in conjunction with mobile edge computing (MEC). First, mmWave is deployed to support the high bandwidth needs of PVRV streaming. Next, the multiple mmWave links that tend to suffer from outages are coupled with a sub-6 GHz link to ensure disruption-free wireless communication. With the help of an MEC server, the tradeoff among link adaptation, transcoding-based chunk quality adaptation, and viewport rendering offloading is sought to improve the wireless bandwidth utilization and mobile device's energy efficiency. Simulation results show that the proposed scheme can improve the streaming performance in both energy efficiency and the quality of received viewport over the state-of-the-art schemes.

[1]  Madhukar Budagavi,et al.  360 degrees video coding using region adaptive smoothing , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[2]  Shiqiang Yang,et al.  A Dataset for Exploring User Behaviors in VR Spherical Video Streaming , 2017, MMSys.

[3]  Chiu Ngo,et al.  A 60 GHz wireless network for enabling uncompressed video communication , 2008, IEEE Communications Magazine.

[4]  Matteo Drago,et al.  Reliable Video Streaming over mmWave with Multi Connectivity and Network Coding , 2017, 2018 International Conference on Computing, Networking and Communications (ICNC).

[5]  Song Ci,et al.  SSIM-based cross-layer optimized video streaming over LTE downlink , 2014, 2014 IEEE Global Communications Conference.

[6]  Sunghyun Choi,et al.  Link Adaptation for High-Quality Uncompressed Video Streaming in 60-GHz Wireless Networks , 2016, IEEE Transactions on Multimedia.

[7]  S. Dutta,et al.  5G MmWave Module for the ns-3 Network Simulator , 2015, MSWiM.

[8]  Cheng-Hsin Hsu,et al.  360° Video Viewing Dataset in Head-Mounted Virtual Reality , 2017, MMSys.

[9]  Harry Shum,et al.  Data compression and transmission aspects of panoramic videos , 2005, IEEE Trans. Circuits Syst. Video Technol..

[10]  Xuemin Shen,et al.  Video Quality Provisioning for Millimeter Wave 5G Cellular Networks With Link Outage , 2015, IEEE Transactions on Wireless Communications.

[11]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[12]  Gwendal Simon,et al.  360-Degree Video Head Movement Dataset , 2017, MMSys.

[13]  Bernd Girod,et al.  A Framework to Evaluate Omnidirectional Video Coding Schemes , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[14]  Gwendal Simon,et al.  Viewport-adaptive navigable 360-degree video delivery , 2016, 2017 IEEE International Conference on Communications (ICC).

[15]  Kevin Skadron,et al.  Reducing multimedia decode power using feedback control , 2003, Proceedings 21st International Conference on Computer Design.

[16]  Filip De Turck,et al.  An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos , 2017, ACM Multimedia.

[17]  Thrasyvoulos Spyropoulos,et al.  MEC architectural implications for LTE/LTE-A networks , 2016, MobiArch.

[18]  Joongheon Kim,et al.  Strategic Control of 60 GHz Millimeter-Wave High-Speed Wireless Links for Distributed Virtual Reality Platforms , 2017, Mob. Inf. Syst..

[19]  Yongtian Wang,et al.  Display technologies in virtual reality systems , 2016 .

[20]  Sundeep Rangan,et al.  Improved Handover Through Dual Connectivity in 5G mmWave Mobile Networks , 2016, IEEE Journal on Selected Areas in Communications.

[21]  Songqing Chen,et al.  OpTile: Toward Optimal Tiling in 360-degree Video Streaming , 2017, ACM Multimedia.

[22]  Mehdi Bennis,et al.  Living on the edge: The role of proactive caching in 5G wireless networks , 2014, IEEE Communications Magazine.

[23]  Dirk Wübben,et al.  Performance of HARQ with Reduced Size Retransmissions Using Network Coding Principles , 2013, 2013 IEEE 77th Vehicular Technology Conference (VTC Spring).

[24]  Di Yuan,et al.  Resource scheduling to jointly minimize receiving and transmitting energy in OFDMA systems , 2014, 2014 11th International Symposium on Wireless Communications Systems (ISWCS).

[25]  Kyungwhoon Cheun,et al.  Millimeter-wave beamforming as an enabling technology for 5G cellular communications: theoretical feasibility and prototype results , 2014, IEEE Communications Magazine.

[26]  Zhimin Xu,et al.  360ProbDASH: Improving QoE of 360 Video Streaming Using Tile-based HTTP Adaptive Streaming , 2017, ACM Multimedia.

[27]  Thomas Schierl,et al.  Compressed domain video processing for tile based panoramic streaming using HEVC , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[28]  Bernd Girod,et al.  Content Adaptive Representations of Omnidirectional Videos for Cinematic Virtual Reality , 2015, ImmersiveME@ACM Multimedia.

[29]  Zulin Wang,et al.  Modeling Attention in Panoramic Video: A Deep Reinforcement Learning Approach , 2017, ArXiv.

[30]  Michael Riegler,et al.  Tiling in Interactive Panoramic Video: Approaches and Evaluation , 2016, IEEE Transactions on Multimedia.

[31]  Jeffrey G. Andrews,et al.  Adaptive resource allocation in multiuser OFDM systems with proportional rate constraints , 2005, IEEE Transactions on Wireless Communications.

[32]  Sundeep Rangan,et al.  End-to-End Simulation of 5G mmWave Networks , 2017, IEEE Communications Surveys & Tutorials.

[33]  Xavier Gandibleux,et al.  Multiple Objective Combinatorial Optimization — A Tutorial , 2003 .

[34]  Xin Liu,et al.  Motion-Prediction-Based Multicast for 360-Degree Video Transmissions , 2017, 2017 14th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[35]  André Kaup,et al.  Decoding-Energy-Rate-Distortion Optimization for Video Coding , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Antonios Argyriou,et al.  Joint Source Encoding and Networking Optimization for Panoramic Video Streaming over LTE-A Downlink , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.