Motion-Aware Interplay between WiGig and WiFi for Wireless Virtual Reality

Wireless virtual reality (VR) is a promising direction for future VR systems that offloads heavy computation to a remote processing entity and wirelessly receives high-quality streams. WiGig and WiFi are representative solutions to implement wireless VR; however, they differ in communication bandwidth and reliability. Our testbed experiments show that the performance of WiGig and VR traffic generation strongly correlates with and consequently can be predicted from a user’s motion. Based on this observation, we develop a wireless VR system that exploits the benefits of both links by switching between them and controlling the VR frame encoding for latency regulation and image quality enhancement. The proposed system predicts the performance of the links and selects the one with a higher capacity in an opportunistic manner. It adjusts the encoding rate of the host based on the motion-aware prediction of the frame size and estimated latency of the selected link. By evaluating the testbed data, we demonstrate that the proposed system outperforms a WiGig-only system with a fixed encoding rate in terms of latency regulation and image quality.

[1]  Woongsoo Na,et al.  Simulation and measurement: Feasibility study of Tactile Internet applications for mmWave virtual reality , 2020, ETRI Journal.

[2]  Sachin Katti,et al.  Position Tracking for Virtual Reality Using Commodity WiFi , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Kyu-Han Kim,et al.  WiFi-Assisted 60 GHz Wireless Networks , 2017, MobiCom.

[4]  Ronny Yongho Kim,et al.  Delay oriented VR mode WLAN for efficient Wireless multi-user Virtual Reality device , 2017, 2017 IEEE International Conference on Consumer Electronics (ICCE).

[5]  Sanghyun Kim,et al.  Selective Timewarp Based on Embedded Motion Vectors for Interactive Cloud Virtual Reality , 2019, IEEE Access.

[6]  Walid Saad,et al.  Data Correlation-Aware Resource Management in Wireless Virtual Reality (VR): An Echo State Transfer Learning Approach , 2019, IEEE Transactions on Communications.

[7]  Yuris Mulya Saputra,et al.  E-MICE: Energy-Efficient Concurrent Exploitation of Multiple Wi-Fi Radios , 2017, IEEE Transactions on Mobile Computing.

[8]  Russell M. Taylor Virtual Reality System Concepts Illustrated Using OSVR , 2019, VR Developer Gems.

[9]  Gerrit Beldman,et al.  Lan medium access control (mac) and physical layer (phy) specifications , 1997 .

[10]  Ji-Hoon Yun,et al.  Predictive Tile Selection for 360-Degree VR Video Streaming in Bandwidth-Limited Networks , 2018, IEEE Communications Letters.

[11]  Qiyue Li,et al.  Modeling QoE of Virtual Reality Video Transmission over Wireless Networks , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[12]  Mugen Peng,et al.  Joint Radio Communication, Caching, and Computing Design for Mobile Virtual Reality Delivery in Fog Radio Access Networks , 2019, IEEE Journal on Selected Areas in Communications.

[13]  Omid Salehi-Abari,et al.  Enabling High-Quality Untethered Virtual Reality , 2017, NSDI.

[14]  Carl Machover,et al.  Virtual reality , 1994, IEEE Computer Graphics and Applications.

[15]  Joongheon Kim,et al.  Strategic Control of 60 GHz Millimeter-Wave High-Speed Wireless Links for Distributed Virtual Reality Platforms , 2017, Mob. Inf. Syst..

[16]  Parameswaran Ramanathan,et al.  60 GHz Indoor Networking through Flexible Beams: A Link-Level Profiling , 2015, SIGMETRICS 2015.

[17]  Danpu Liu,et al.  Wireless Multicast of Virtual Reality Videos With MPEG-I Format , 2019, IEEE Access.

[18]  Min Huang,et al.  MAC Scheduling for Multiuser Wireless Virtual Reality in 5G MIMO-OFDM Systems , 2018, 2018 IEEE International Conference on Communications Workshops (ICC Workshops).

[19]  Victor C. M. Leung,et al.  An Adaptive Wireless Virtual Reality Framework in Future Wireless Networks: A Distributed Learning Approach , 2020, IEEE Transactions on Vehicular Technology.

[20]  Mehdi Bennis,et al.  Toward Low-Latency and Ultra-Reliable Virtual Reality , 2018, IEEE Network.

[21]  Wei Gao,et al.  DeltaVR: Achieving High-Performance Mobile VR Dynamics through Pixel Reuse , 2019, 2019 18th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[22]  Mohamed Hefeeda,et al.  Streaming Virtual Reality Content , 2016, ArXiv.

[23]  Sanghyun Kim,et al.  Enhancement of Motion Feedback Latency for Wireless Virtual Reality in IEEE 802.11 WLANs , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).