Daleel: Simplifying cloud instance selection using machine learning

Decision making in cloud environments is quite challenging due to the diversity in service offerings and pricing models, especially considering that the cloud market is an incredibly fast moving one. In addition, there are no hard and fast rules; each customer has a specific set of constraints (e.g. budget) and application requirements (e.g. minimum computational resources). Machine learning can help address some of the complicated decisions by carrying out customer-specific analytics to determine the most suitable instance type(s) and the most opportune time for starting or migrating instances. We employ machine learning techniques to develop an adaptive deployment policy, providing an optimal match between the customer demands and the available cloud service offerings. We provide an experimental study based on extensive set of job executions over a major public cloud infrastructure.

[1]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[2]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[3]  Zeshui Xu,et al.  A VIKOR-based method for hesitant fuzzy multi-criteria decision making , 2013, Fuzzy Optimization and Decision Making.

[4]  Gordon S. Blair,et al.  Experiences of using a hybrid cloud to construct an environmental virtual observatory , 2013, CloudDP '13.

[5]  José Ramón San Cristóbal Mateo,et al.  Weighted Sum Method and Weighted Product Method , 2012 .

[6]  R. Marler,et al.  The weighted sum method for multi-objective optimization: new insights , 2010 .

[7]  Gordon S. Blair,et al.  Adaptive decision making in multi-cloud management , 2014, CCB '14.

[8]  Dana Petcu,et al.  Portable Cloud applications - From theory to practice , 2013, Future Gener. Comput. Syst..

[9]  Gregoris Mentzas,et al.  Preference-based cloud service recommendation as a brokerage service , 2014, CCB '14.

[10]  Marin Litoiu,et al.  Introducing STRATOS: A Cloud Broker Service , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[11]  Eddy Caron,et al.  Forecasting for Grid and Cloud Computing On-Demand Resources Based on Pattern Matching , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[12]  Gordon S. Blair,et al.  MultiBox: Lightweight Containers for Vendor-Independent Multi-cloud Deployments , 2015, EGC.

[13]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[14]  Yehia Elkhatib,et al.  Defining Cross-Cloud Systems , 2016, ArXiv.

[15]  IEEE/IFIP Network Operations and Management Symposium, NOMS 2010, 19-23 April 2010, Osaka, Japan , 2010, IEEE/IFIP Network Operations and Management Symposium.

[16]  Daniela M. Witten,et al.  An Introduction to Statistical Learning: with Applications in R , 2013 .

[17]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[18]  Nikos Loutas,et al.  Cloud4SOA: A Semantic-Interoperability PaaS Solution for Multi-cloud Platform Management and Portability , 2013, ESOCC.

[19]  Samuel Ajila,et al.  Predicting cloud resource provisioning using machine learning techniques , 2013, 2013 26th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE).

[20]  Victor Muntés-Mulero,et al.  Risk-Driven Framework for Decision Support in Cloud Service Selection , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[21]  Kevin Lee,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012, Future Gener. Comput. Syst..

[22]  M. Kubát.  An Introduction to Machine Learning , 2017, Springer International Publishing.

[23]  Blesson Varghese,et al.  Cloud Services Brokerage: A Survey and Research Roadmap , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[24]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[25]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[26]  Paul Rayson,et al.  VARD2 : a tool for dealing with spelling variation in historical corpora , 2008 .

[27]  Andreas Menychtas,et al.  Software modernization and cloudification using the ARTIST migration methodology and framework , 2014, Scalable Comput. Pract. Exp..

[28]  Jim Gao,et al.  Machine Learning Applications for Data Center Optimization , 2014 .

[29]  Yehia El-khatib.  Building Cloud Applications for Challenged Networks , 2015, EGC.

[30]  Paul Marshall,et al.  Rebalancing in a multi-cloud environment , 2013, Science Cloud '13.