Mobile-Edge Cooperative Multi-User 360° Video Computing and Streaming

We investigate a novel communications system that integrates scalable multi-layer 360° video tiling, viewport-adaptive rate-distortion optimal resource allocation, and VR-centric edge computing and caching, to enable future high-quality untethered VR streaming. Our system comprises a collection of 5G small cells that can pool their communication, computing, and storage resources to collectively deliver scalable 360° video content to mobile VR clients at much higher quality. Our major contributions are rigorous design of multi-layer 360° tiling and related models of statistical user navigation, and analysis and optimization of edge-based multi-user VR streaming that integrates viewport adaptation and server cooperation. We also explore the possibility of network coded data operation and its implications for the analysis, optimization, and system performance we pursue here. We demonstrate considerable gains in delivered immersion fidelity, featuring much higher 360° viewport peak signal to noise ratio (PSNR) and VR video frame rates and spatial resolutions.

[1]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[2]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Ton Kalker,et al.  The Road to Immersive Communication , 2012, Proceedings of the IEEE.

[4]  Vijay Sivaraman,et al.  Profiling per-packet and per-byte energy consumption in the NetFPGA Gigabit router , 2011, 2011 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[5]  Filip De Turck,et al.  Improving Virtual Reality Streaming using HTTP/2 , 2017, MMSys.

[6]  Pascal Frossard,et al.  Prioritized Distributed Video Delivery With Randomized Network Coding , 2011, IEEE Transactions on Multimedia.

[7]  Deniz Gündüz,et al.  Learning-based optimization of cache content in a small cell base station , 2014, 2014 IEEE International Conference on Communications (ICC).

[8]  Aljoscha Smolic,et al.  Viewport-aware adaptive 360° video streaming using tiles for virtual reality , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[9]  Feng Qian,et al.  A close examination of performance and power characteristics of 4G LTE networks , 2012, MobiSys '12.

[10]  Christian Timmerer,et al.  Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP: Design, Implementation, and Evaluation , 2017, MMSys.

[11]  Mohammad Hosseini,et al.  Adaptive 360 VR Video Streaming: Divide and Conquer , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[12]  Sujit Dey,et al.  Video caching in Radio Access Network: Impact on delay and capacity , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[13]  Lu Yu,et al.  Weighted-to-Spherically-Uniform Quality Evaluation for Omnidirectional Video , 2017, IEEE Signal Processing Letters.

[14]  Deeparnab Chakrabarty,et al.  Knapsack Problems , 2008 .

[15]  Abdallah Khreishah,et al.  Joint Caching, Routing, and Channel Assignment for Collaborative Small-Cell Cellular Networks , 2016, IEEE Journal on Selected Areas in Communications.

[16]  Alexandros G. Dimakis,et al.  FemtoCaching: Wireless video content delivery through distributed caching helpers , 2011, 2012 Proceedings IEEE INFOCOM.