Enhancing Internet-Scale Video Service Deployment Using Microblog-Based Prediction

Online microblogging has been very popular in today's Internet, where users follow other people they are interested in and exchange information between themselves. Among these exchanges, video links are a representative type on a microblogging site. The impact is fundamental-not only are viewers in a video service directly coming from the microblog sharing and recommendation, but also are the users in the microblogging site representing a promising sample to all the viewers. It is intriguing to study a proactive service deployment for such videos, using the propagation patterns of microblogs. Based on extensive traces from Youku and Tencent Weibo, a popular video sharing site and a favored microblogging system, we explore how video propagation patterns in the microblogging system are correlated with video popularity on the video sharing site. Using influential factors summarized from the measurement studies, we further design a neural network-based learning framework to predict the number of potential viewers and their geographic distribution. We then design proactive video deployment algorithms based on the prediction framework, which not only determines the upload capacities of servers in different regions, but also strategically replicates videos to these regions to serve users. Our PlanetLab-based experiments verify the effectiveness of our design.

[1]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[2]  Stephen A. Billings,et al.  Non-linear system identification using neural networks , 1990 .

[3]  Vijay Kumar Adhikari,et al.  REVERSE ENGINEERING THE YOUTUBE VIDEO DELIVERY CLOUD , 2011 .

[4]  E. Michael Azoff,et al.  Neural Network Time Series: Forecasting of Financial Markets , 1994 .

[5]  Douglas C. Montgomery,et al.  Generalized Linear Models: With Applications in Engineering and the Sciences: Second Edition , 2012 .

[6]  Yang Guo,et al.  A survey on peer-to-peer video streaming systems , 2008, Peer-to-Peer Netw. Appl..

[7]  Gerhard Nahler,et al.  Pearson Correlation Coefficient , 2020, Definitions.

[8]  Hosung Park,et al.  What is Twitter, a social network or a news media? , 2010, WWW '10.

[9]  Todor Boyanov,et al.  Numerical Methods and Applications , 2014, Lecture Notes in Computer Science.

[10]  Krishna P. Gummadi,et al.  A measurement-driven analysis of information propagation in the flickr social network , 2009, WWW '09.

[11]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[12]  Neil Savage,et al.  Twitter as medium and message , 2011, Commun. ACM.

[13]  Sonia Fahmy,et al.  Analyzing video services in Web 2.0: a global perspective , 2008, NOSSDAV.

[14]  Bernardo A. Huberman,et al.  Predicting the popularity of online content , 2008, Commun. ACM.

[15]  Jie Gao,et al.  Moving beyond end-to-end path information to optimize CDN performance , 2009, IMC '09.

[16]  Lifeng Sun,et al.  Propagation-based social-aware replication for social video contents , 2012, ACM Multimedia.

[17]  David E. Culler,et al.  PlanetLab: an overlay testbed for broad-coverage services , 2003, CCRV.

[18]  M. Osborne,et al.  Using Prediction Markets and Twitter to Predict a Swine Flu Pandemic , 2009 .

[19]  Scott Counts,et al.  Predicting the Speed, Scale, and Range of Information Diffusion in Twitter , 2010, ICWSM.

[20]  Balachander Krishnamurthy,et al.  A few chirps about twitter , 2008, WOSN '08.

[21]  Lifeng Sun,et al.  Guiding internet-scale video service deployment using microblog-based prediction , 2012, 2012 Proceedings IEEE INFOCOM.

[22]  Pablo Rodriguez,et al.  I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system , 2007, IMC '07.

[23]  Ke Xu,et al.  Video sharing in online social networks: measurement and analysis , 2012, NOSSDAV '12.

[24]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[25]  Gang Peng,et al.  CDN: Content Distribution Network , 2004, ArXiv.

[26]  Bo Li,et al.  Design and deployment of a hybrid CDN-P2P system for live video streaming: experiences with LiveSky , 2009, ACM Multimedia.

[27]  Catherine Rosenberg,et al.  Analysis of a CDN–P2P hybrid architecture for cost-effective streaming media distribution , 2006, Multimedia Systems.

[28]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[29]  XuDongyan,et al.  Analysis of a CDN---P2P hybrid architecture for cost-effective streaming media distribution , 2006 .

[30]  Dan Wang,et al.  Towards understanding the external links of video sharing sites: measurement and analysis , 2010, NOSSDAV '10.