Towards microservices architecture to transcode videos in the large at low costs

The increasing popularity of videos over Internet, combined with the wide heterogeneity of various kinds of end users' devices, imposes strong requirements on the underlying infrastructure and computing resources to meet the users expectations. In particular, designing an adequate transcoding workflow in the cloud to stream videos at large scale is: (i) costly, and (ii) complex. By inheriting key concepts from the software engineering domain, such as separation of concerns and microservice architecture style, we are giving our experience feedbacks of building both a low cost and efficient transcoding platform over an ad hoc computing cloud built around a rack of Raspberry Pis.

[1]  Edward Walker,et al.  The Real Cost of a CPU Hour , 2009, Computer.

[2]  Laxmi N. Bhuyan,et al.  Load Balancing in a Cluster-Based Web Server for Multimedia Applications , 2006, IEEE Transactions on Parallel and Distributed Systems.

[3]  Christian Timmerer,et al.  Scalable video coding guidelines and performance evaluations for adaptive media delivery of high definition content , 2013, 2013 IEEE Symposium on Computers and Communications (ISCC).

[4]  Adnan Ashraf,et al.  Cost-Efficient Virtual Machine Provisioning for Multi-tier Web Applications and Video Transcoding , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.

[5]  Borko Furht,et al.  A study of transcoding on cloud environments for video content delivery , 2010, MCMC '10.

[6]  Anand Sivasubramaniam,et al.  Cloudy with a Chance of Cost Savings , 2013, IEEE Transactions on Parallel and Distributed Systems.

[7]  Wei Lin,et al.  Apollo: Scalable and Coordinated Scheduling for Cloud-Scale Computing , 2014, OSDI.

[8]  Jun Zhu,et al.  Twinkle: A fast resource provisioning mechanism for internet services , 2011, 2011 Proceedings IEEE INFOCOM.

[9]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[10]  Andrea C. Arpaci-Dusseau,et al.  Slacker: Fast Distribution with Lazy Docker Containers , 2016, FAST.