360Cast: Foveation-Based Wireless Soft Delivery for 360-Degree Video

Wireless 360-degree video delivery provides virtual reality (VR) immersive experience where each user can freely switch his/her viewing orientation. The existing schemes of the wireless 360-degree video streaming use digital-based compression and transmission. However, they have many disadvantages in terms of video traffic and quality: cliff effect due to unstable wireless channels, large video traffic due to the extremely high resolution of the 360-degree video, and the perceptual redundancy within the transmitted video. To solve the above problems, this paper proposes a novel wireless 360-degree video transmission scheme called 360Cast. 360Cast adopts the analog-based transmission, including power allocation and analog modulation, to achieve graceful video quality improvement even in time-varying wireless channels. Here, the power allocation considers the distortion of human perception and sphere-to-plane projection to maximize the human perceptual quality at the 360-degree video playback. In addition, 360Cast predicts and transmits the user’s viewport based on the recent HMD user’s orientation by using dynamic linear regression (DLR) and only transmits the viewport for traffic reduction. Evaluation results show that the proposed 360Cast provides better human perceptual quality via HMD compared with the existing analog transmission schemes, i.e., SoftCast and FoveaCast, by using the integration of viewport prediction, power allocation, and analog modulation.

[1]  Anh T. Pham,et al.  A New Adaptation Approach for Viewport-adaptive 360-degree Video Streaming , 2017, 2017 IEEE International Symposium on Multimedia (ISM).

[2]  Cheng-Hsin Hsu,et al.  360° Video Viewing Dataset in Head-Mounted Virtual Reality , 2017, MMSys.

[3]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Songqing Chen,et al.  OpTile: Toward Optimal Tiling in 360-degree Video Streaming , 2017, ACM Multimedia.

[5]  Touradj Ebrahimi,et al.  Perceptual Video Compression: A Survey , 2012, IEEE Journal of Selected Topics in Signal Processing.

[6]  Xin Liu,et al.  Motion-Prediction-Based Multicast for 360-Degree Video Transmissions , 2017, 2017 14th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[7]  Dina Katabi,et al.  SoftCast: one-size-fits-all wireless video , 2010, SIGCOMM '10.

[8]  Xin Liu,et al.  Shooting a moving target: Motion-prediction-based transmission for 360-degree videos , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[9]  Xiaoxu Meng Foveated Rendering Techniques in Modern Computer Graphics , 2018 .

[10]  Cheng-Hsin Hsu,et al.  Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual Reality , 2017, NOSSDAV.

[11]  Detlev Marpe,et al.  Performance comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC encoders , 2013, 2013 Picture Coding Symposium (PCS).

[12]  Ali Borji,et al.  Salient object detection: A survey , 2014, Computational Visual Media.

[13]  Sachin Katti,et al.  FlexCast: graceful wireless video streaming , 2011, MobiCom.

[14]  Zhou Wang,et al.  Embedded foveation image coding , 2001, IEEE Trans. Image Process..

[15]  Ruiqin Xiong,et al.  OmniCast: Wireless Pseudo-Analog Transmission for Omnidirectional Video , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[16]  Silvia Rossi,et al.  Navigation-aware adaptive streaming strategies for omnidirectional video , 2017, 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP).

[17]  Jian Shen,et al.  Foveation-Based Wireless Soft Image Delivery , 2018, IEEE Transactions on Multimedia.

[18]  Gregory J. Zelinsky,et al.  Design and evaluation of a foveated video streaming service for commodity client devices , 2016, MMSys.

[19]  Konrad Tollmar,et al.  Gaze-Aware Streaming Solutions for the Next Generation of Mobile VR Experiences , 2018, IEEE Transactions on Visualization and Computer Graphics.

[20]  Feng Wu,et al.  ParCast: soft video delivery in MIMO-OFDM WLANs , 2012, Mobicom '12.

[21]  Afshin Taghavi Nasrabadi,et al.  Adaptive 360-Degree Video Streaming using Scalable Video Coding , 2017, ACM Multimedia.