Video transcoding time prediction for proactive load balancing

In this paper, we present a method for predicting the transcoding time of videos given an input video stream and its transcoding parameters. Video transcoding time is treated as a random variable and is statistically predicted from past observations. Our proposed method predicts the transcoding time as a function of several parameters of the input and output video streams, and does not require any detailed information about the codec used. We show the effectiveness of our method via comparing the resulting predictions with the actual transcoding times on unseen video streams. Simulation results show that our prediction method enables a significantly better load balancing of transcoding jobs than classical load balancing methods.

[1]  Naoki Wakamiya,et al.  High-Speed Distributed Video Transcoding for Multiple Rates and Formats , 2005, IEICE Trans. Inf. Syst..

[2]  Martin Halvey,et al.  Exploring social dynamics in online media sharing , 2007, WWW '07.

[3]  Pablo Rodriguez,et al.  I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system , 2007, IMC '07.

[4]  Ben Y. Zhao,et al.  Understanding user behavior in large-scale video-on-demand systems , 2006, EuroSys.

[5]  Ming-Ting Sun,et al.  Motion Vector Refinement for High-Performance Transcoding , 1999, IEEE Trans. Multim..

[6]  Sébastien Lafond,et al.  Bit Rate Reduction Video Transcoding with Distributed Computing , 2012, 2012 20th Euromicro International Conference on Parallel, Distributed and Network-based Processing.

[7]  Geoffrey Morrison.  Video Transcoders with Low Delay , 1997 .

[8]  Andrew V. Goldberg,et al.  Quincy: fair scheduling for distributed computing clusters , 2009, SOSP '09.

[9]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[10]  Michael Roitzsch,et al.  Principles for the Prediction of Video Decoding Times Applied to MPEG-1/2 and MPEG-4 Part 2 Video , 2006, 2006 27th IEEE International Real-Time Systems Symposium (RTSS'06).

[11]  Zhi-Li Zhang,et al.  Counting YouTube videos via random prefix sampling , 2011, IMC '11.

[12]  Sébastien Lafond,et al.  Prediction-Based Dynamic Resource Allocation for Video Transcoding in Cloud Computing , 2013, 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[13]  Ming-Ting Sun,et al.  Digital Video Transcoding , 2005, Proceedings of the IEEE.

[14]  Krishna P. Gummadi,et al.  Measurement and analysis of online social networks , 2007, IMC '07.

[15]  Mor Harchol-Balter.  The Effect of Heavy-Tailed Job Size Distributions on Computer System Design , 1999 .

[16]  Jun Xin,et al.  Video Adaptation : Concepts , Technologies , and Open Issues , .

[17]  Gang Liu,et al.  Cloud transcoder: bridging the format and resolution gap between internet videos and mobile devices , 2012, NOSSDAV '12.

[18]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[19]  Zongpeng Li,et al.  Youtube traffic characterization: a view from the edge , 2007, IMC '07.

[20]  Yu Gu,et al.  Watch global, cache local: YouTube network traffic at a campus network: measurements and implications , 2008, Electronic Imaging.