Jigsaw: Robust Live 4K Video Streaming

The popularity of 4K videos has grown significantly in the past few years. Yet coding and streaming live 4K videos incurs prohibitive cost to the network and end system. Motivated by this observation, we explore the feasibility of supporting live 4K video streaming over wireless networks using commodity devices. Given the high data rate requirement of 4K videos, 60 GHz is appealing, but its large and unpredictable throughput fluctuation makes it hard to provide desirable user experience. In particular, to support live 4K video streaming, we should (i) adapt to highly variable and unpredictable wireless throughput, (ii) support efficient 4K video coding on commodity devices. To this end, we propose a novel system, Jigsaw. It consists of (i) easy-to-compute layered video coding to seamlessly adapt to unpredictable wireless link fluctuations, (ii) efficient GPU implementation of video coding on commodity devices, and (iii) effectively leveraging both WiFi and WiGig through delayed video adaptation and smart scheduling. Using real experiments and emulation, we demonstrate the feasibility and effectiveness of our system. Our results show that it improves PSNR by 6-15dB and improves SSIM by 0.011-0.217 over state-of-the-art approaches. Moreover, even when throughput fluctuates widely between 0.2Gbps-2Gbps, it can achieve an average PSNR of 33dB.

[1]  Chiu Ngo,et al.  A 60 GHz wireless network for enabling uncompressed video communication , 2008, IEEE Communications Magazine.

[2]  Hermann Hellwagner,et al.  An evaluation of TCP-based rate-control algorithms for adaptive internet streaming of H.264/SVC , 2010, MMSys '10.

[3]  Feng Li,et al.  Rubiks: Practical 360-Degree Streaming for Smartphones , 2018, MobiSys.

[4]  Sachin Katti,et al.  FlexCast: graceful wireless video streaming , 2011, MobiCom.

[5]  Feng Wu,et al.  ParCast: soft video delivery in MIMO-OFDM WLANs , 2012, Mobicom '12.

[6]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Thomas Stockhammer,et al.  Dynamic adaptive streaming over HTTP --: standards and design principles , 2011, MMSys.

[8]  Kuochen Wang,et al.  Enabling seamless WiGig/WiFi handovers in tri-band wireless systems , 2017, 2017 IEEE 25th International Conference on Network Protocols (ICNP).

[9]  Anirudh Sivaraman,et al.  Encoding, Fast and Slow: Low-Latency Video Processing Using Thousands of Tiny Threads , 2017, NSDI.

[10]  Swarun Kumar,et al.  piStream: Physical Layer Informed Adaptive Video Streaming over LTE , 2015, MobiCom.

[11]  Cristina Hava Muntean,et al.  QoE-aware video resolution thresholds computation for adaptive multimedia , 2017, 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[12]  Theodore S. Rappaport,et al.  Wireless communications - principles and practice , 1996 .

[13]  Y. Charlie Hu,et al.  Furion: Engineering High-Quality Immersive Virtual Reality on Today's Mobile Devices , 2020, IEEE Transactions on Mobile Computing.

[14]  Gwendal Simon,et al.  YouTube live and Twitch: a tour of user-generated live streaming systems , 2015, MMSys.

[15]  Vyas Sekar,et al.  CFA: A Practical Prediction System for Video QoE Optimization , 2016, NSDI.

[16]  Marco Gruteser,et al.  Cutting the Cord: Designing a High-quality Untethered VR System with Low Latency Remote Rendering , 2018, MobiSys.

[17]  Chiu Ngo,et al.  Progressive Transmission of Uncompressed Video over mmW Wireless , 2010, 2010 7th IEEE Consumer Communications and Networking Conference.

[18]  Feng Qian,et al.  360° Innovations for Panoramic Video Streaming , 2017, HotNets.

[19]  Shiwen Mao,et al.  Multiple description coding for uncompressed video streaming over 60GHz networks , 2013, CRAB '13.

[20]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[21]  Matti Siekkinen,et al.  Dissecting the End-to-end Latency of Interactive Mobile Video Applications , 2016, HotMobile.

[22]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[23]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.

[24]  Chiu Ngo,et al.  Support of Uncompressed Video Streaming Over 60GHz Wireless Networks , 2008, 2008 5th IEEE Consumer Communications and Networking Conference.

[25]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Cheng-Hsin Hsu,et al.  Performance Measurements of Virtual Reality Systems: Quantifying the Timing and Positioning Accuracy , 2016, ACM Multimedia.

[27]  Sunghyun Choi,et al.  Link Adaptation for High-Quality Uncompressed Video Streaming in 60-GHz Wireless Networks , 2016, IEEE Transactions on Multimedia.

[28]  Janne Salonen,et al.  VP8 Data Format and Decoding Guide , 2011, RFC.

[29]  Luca De Cicco,et al.  Feedback control for adaptive live video streaming , 2011, MMSys.

[30]  Daniel J. Wigdor,et al.  How Much Faster is Fast Enough?: User Perception of Latency & Latency Improvements in Direct and Indirect Touch , 2015, CHI.

[31]  Xinyu Zhang,et al.  Pose Information Assisted 60 GHz Networks: Towards Seamless Coverage and Mobility Support , 2017, MobiCom.

[32]  Bo Li,et al.  Design and deployment of a hybrid CDN-P2P system for live video streaming: experiences with LiveSky , 2009, ACM Multimedia.

[33]  Dina Katabi,et al.  A cross-layer design for scalable mobile video , 2011, MobiCom.

[34]  Kyu-Han Kim,et al.  WiFi-Assisted 60 GHz Wireless Networks , 2017, MobiCom.

[35]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..