Look Ahead at the First-mile in Livecast with Crowdsourced Highlight Prediction

Recently, data-driven prediction strategies have shown the potential of shepherding the optimization strategies for end viewer’s Quality-of-Experience in practical streaming applications. The current prediction-based designs have largely focused on optimizing the last-mile, i.e., viewer-side, which 1) need the real-time feedback from viewers to improve the prediction accuracy; and 2) need quick responses to guarantee the effectiveness of optimization strategies in the future. Thanks to the emerged crowdsourced livecast services, e.g., Twitch.tv, we for the first time exploit the opportunity to realize the long-term prediction and optimization with the assistance derived from the first-mile, i.e., source broadcasters.In this paper, we propose a novel framework CastFlag, which analyzes the broadcasters’ operations and interactions, predicts the key events (i.e., highlights), and optimizes the transcoding stage in the corresponding live streams, even before the encoding stage. Taking the most popular eSports gamecast as an example, we illustrate the effectiveness of this framework in the game highlight prediction and transcoding workload allocation. The trace-driven evaluation shows the superiority of CastFlag as it: (1) improves the prediction accuracy over other learning-based approaches by up to 30%; (2) achieves an average of 10% saving of the transcoding latency at less cost.

[1]  Lifeng Sun,et al.  Comyco: Quality-Aware Adaptive Video Streaming via Imitation Learning , 2019, ACM Multimedia.

[2]  Shijie Sun,et al.  Pytheas: Enabling Data-Driven Quality of Experience Optimization Using Group-Based Exploration-Exploitation , 2017, NSDI.

[3]  Yale Song Real-Time Video Highlights for Yahoo Esports , 2016, ArXiv.

[4]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[5]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[6]  Xiufeng Xie,et al.  Learning to Coordinate Video Codec with Transport Protocol for Mobile Video Telephony , 2019, MobiCom.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Haitian Pang,et al.  Enhancing the crowdsourced live streaming: a deep reinforcement learning approach , 2019, NOSSDAV.

[10]  Cheng-Hsin Hsu,et al.  Segment-of-Interest driven live game streaming: Saving bandwidth without degrading experience , 2015, 2015 International Workshop on Network and Systems Support for Games (NetGames).

[11]  Vyas Sekar,et al.  Via: Improving Internet Telephony Call Quality Using Predictive Relay Selection , 2016, SIGCOMM.

[12]  Junchen Jiang,et al.  Pano: optimizing 360° video streaming with a better understanding of quality perception , 2019, SIGCOMM.

[13]  Gang Wang,et al.  Anatomy of a Personalized Livestreaming System , 2016, Internet Measurement Conference.

[14]  Wei-Ta Chu,et al.  On broadcasted game video analysis: event detection, highlight detection, and highlight forecast , 2016, Multimedia Tools and Applications.

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Antonio Liotta,et al.  Unsupervised deep learning for real-time assessment of video streaming services , 2017, Multimedia Tools and Applications.

[17]  Cong Zhang,et al.  Fog-Based Transcoding for Crowdsourced Video Livecast , 2017, IEEE Communications Magazine.

[18]  Jiangchuan Liu,et al.  Crowdsourced Live Streaming over Aggregated Edge Networks , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[19]  Lifeng Sun,et al.  Seeker: Topic-Aware Viewing Pattern Prediction in Crowdsourced Interactive Live Streaming , 2017, NOSSDAV.

[20]  Brent E. Harrison,et al.  Identifying patterns in combat that are predictive of success in MOBA games , 2014, FDG.

[21]  Ravindra K. Ahuja,et al.  Network Flows: Theory, Algorithms, and Applications , 1993 .