Probabilistic-based workload forecasting and service redeployment for multi-tenant services

This paper presents a two-stage service migration decision method which combines business workload forecasting with real-time load sensing, and thus adds business forecasting to previous load balancing approaches that rely solely upon real-time load sensing. The migration decision procedure and the detailed causal analysis algorithms based on Bayesian networks are also given. After the critical business indicators have been obtained from causal analysis, business fluctuation related with the critical indicators can be forecasted by using Markov chain method. And then, the migration decision can be made based on the forecasting results and the real-time load information together. We evaluate the migration decision method through three sets of experiments. We found that by migrating service on a shared multi-tenant service environment, the QoS requirement can be assured dynamically and the capability of workloads increases under same resource cost, which is helpful in optimised deploying for multi-tenant applications.

[1]  Bhavani M. Thuraisingham,et al.  Dynamic Service and Data Migration in the Clouds , 2009, 2009 33rd Annual IEEE International Computer Software and Applications Conference.

[2]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1998, Learning in Graphical Models.

[3]  Ioannis Stavrakakis,et al.  Scalable service migration in autonomic network environments , 2010, IEEE Journal on Selected Areas in Communications.

[4]  Cheng-Zhong Xu,et al.  Service migration in distributed virtual machines for adaptive grid computing , 2005, 2005 International Conference on Parallel Processing (ICPP'05).

[5]  Alois Knoll,et al.  Service Migration Scenarios for Embedded Networks , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[6]  Yue-Shan Chang,et al.  Agent-Based Service Migration Framework in Hybrid Cloud , 2011, 2011 IEEE International Conference on High Performance Computing and Communications.

[7]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[8]  Anja Feldmann,et al.  Competitive analysis for service migration in VNets , 2010, VISA '10.

[9]  Jianbing Ma,et al.  Qualitative Approach to Bayesian Networks With Multiple Causes , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[10]  David Heckerman,et al.  Causal independence for probability assessment and inference using Bayesian networks , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[11]  Anja Feldmann,et al.  The Wide-Area Virtual Service Migration Problem: A Competitive Analysis Approach , 2014, IEEE/ACM Transactions on Networking.

[12]  Cheng Wu,et al.  Provisioning Virtual Resources Adaptively in Elastic Compute Cloud Platforms , 2011, Int. J. Web Serv. Res..

[13]  Michael John Markham,et al.  Calculating the Prior Probability Distribution for a Causal Network Using Maximum Entropy: Alternative Approaches , 2011, Entropy.

[14]  Wenbing Zhao,et al.  Proactive Service Migration for Long-Running Byzantine Fault Tolerant Systems , 2008, IET Softw..

[15]  Changshui Zhang,et al.  Competitive EM algorithm for finite mixture models , 2004, Pattern Recognit..

[16]  Bo Hong,et al.  Task scheduling in budget-constrained cloud computing systems to maximise throughput , 2012, Int. J. Comput. Sci. Eng..

[17]  Takashi Isozaki,et al.  Learning Causal Bayesian Networks Using Minimum Free Energy Principle , 2012, New Generation Computing.

[18]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[19]  Albert Y. Zomaya,et al.  Evolutionary Scheduling of Dynamic Multitasking Workloads for Big-Data Analytics in Elastic Cloud , 2014, IEEE Transactions on Emerging Topics in Computing.

[20]  Fang Deng,et al.  Toward Middleware-Based Online Application Migration , 2009, 2009 33rd Annual IEEE International Computer Software and Applications Conference.

[21]  Dmitri Botvich,et al.  Dynamic Optimization Solution for Green Service Migration in Data Centres , 2011, 2011 IEEE International Conference on Communications (ICC).

[22]  Shenggui Zhang,et al.  Integrated importance measures of multi-state systems under uncertainty , 2010, Comput. Ind. Eng..

[23]  Stephen J. Cohen,et al.  Service Migration in an Enterprise System Architecture , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[24]  Serafín Moral,et al.  Approximate inference in Bayesian networks using binary probability trees , 2011, Int. J. Approx. Reason..

[25]  Shijun Liu,et al.  S-BM: A benchmark suite for multi-tenant supplier relationship management service , 2013, 2013 10th International Conference on Service Systems and Service Management.

[26]  Anand R. Tripathi,et al.  Resource-Aware Migratory Services in Wide-Area Shared Computing Environments , 2009, 2009 28th IEEE International Symposium on Reliable Distributed Systems.

[27]  Paul A. S. Ward,et al.  Leveraging many simple statistical models to adaptively monitor software systems , 2007, Int. J. High Perform. Comput. Netw..

[28]  Ioannis Stavrakakis,et al.  Centrality-driven scalable service migration , 2011, 2011 23rd International Teletraffic Congress (ITC).

[29]  Carmen Mas Machuca,et al.  Cost analysis of the service migration problem between communication platforms , 2008, NOMS 2008 - 2008 IEEE Network Operations and Management Symposium.

[30]  Ioannis Stavrakakis,et al.  Scalable service migration in general topologies , 2008, 2008 International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[31]  Raymond A. Paul,et al.  An Infrastructure for Web Services Migration for Real-Time Applications , 2006, 2006 Second IEEE International Symposium on Service-Oriented System Engineering (SOSE'06).

[32]  Shiliang Sun,et al.  A bayesian network approach to traffic flow forecasting , 2006, IEEE Transactions on Intelligent Transportation Systems.

[33]  M. Livny,et al.  A Service Migration Case Study : Migrating the Condor Schedd , 2005 .

[34]  Wei Kuang Lai,et al.  Application-Layer Implementation of Service Migration , 2008, 2008 International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[35]  T. V. Suresh Kumar,et al.  Determining suitable execution environment based on dynamic workload during early stages of software development life cycle: a simulation approach , 2012, Int. J. Comput. Sci. Eng..

[36]  Changwon Yoo,et al.  The Bayesian method for causal discovery of latent-variable models from a mixture of experimental and observational data , 2012, Comput. Stat. Data Anal..