A lightweight plug-and-play elasticity service for self-organizing resource provisioning on parallel applications

Abstract Today cloud elasticity can bring benefits to parallel applications, besides the traditional targets including Web and critical-business demands. This consists in adapting the number of resources and processes at runtime, so users do not need to worry about the best choice for them beforehand. To accomplish this, the most common approaches use threshold-based reactive elasticity or time-consuming proactive elasticity. However, both present at least one problem related to the need of a previous user experience, lack on handling load peaks, completion of parameters or design for a specific infrastructure and workload setting. In this context, we developed a hybrid elasticity service for master–slave parallel applications named Helpar. The proposal presents a closed control loop elasticity architecture that adapts at runtime the values of lower and upper thresholds. The main scientific contribution is the proposition of the Live Thresholding (LT) technique for controlling elasticity. LT is based on the TCP congestion algorithm and automatically manages the value of the elasticity bounds to enhance better reactiveness on resource provisioning. The idea is to provide a lightweight plug-and-play service at the PaaS (Platform-as-a-Service) level of a cloud, in which users are completely unaware of the elasticity feature, only needing to compile their applications with Helpar prototype. For evaluation, we used a numerical integration application and OpenNebula to compare the Helpar execution against two scenarios: a set of static thresholds and a non-elastic application. The results present the lightweight feature of Helpar, besides highlighting its performance competitiveness in terms of application time (performance) and cost (performance × energy) metrics.

[1]  Aniruddha S. Gokhale,et al.  Efficient Autoscaling in the Cloud Using Predictive Models for Workload Forecasting , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[2]  Dan Roth,et al.  Automated and Adaptive Threshold Setting: Enabling Technology for Autonomy and Self-Management , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[3]  Jeffrey S. Chase,et al.  Automated control in cloud computing: challenges and opportunities , 2009, ACDC '09.

[4]  Samuel Kounev,et al.  Self‐adaptive workload classification and forecasting for proactive resource provisioning , 2014, Concurr. Comput. Pract. Exp..

[5]  Chung-Horng Lung,et al.  Towards an Autonomic Auto-scaling Prediction System for Cloud Resource Provisioning , 2015, 2015 IEEE/ACM 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems.

[6]  Gong Changqing,et al.  The impact of TCP segment size and routing change on congestion control protocol performance in mobile ad hoc networks , 2005, Proceedings. 2005 International Conference on Wireless Communications, Networking and Mobile Computing, 2005..

[7]  Kevin Lee,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012, Future Gener. Comput. Syst..

[8]  Christof Fetzer,et al.  Vertical Scaling for Prioritized VMs Provisioning , 2012, 2012 Second International Conference on Cloud and Green Computing.

[9]  Luis Carlos Erpen De Bona,et al.  A programming-level approach for elasticizing parallel scientific applications , 2015, J. Syst. Softw..

[10]  Douglas Thain,et al.  Converting a High Performance Application to an Elastic Cloud Application , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[11]  Alexander Clemm,et al.  Integrated and autonomic cloud resource scaling , 2012, 2012 IEEE Network Operations and Management Symposium.

[12]  Johan Tordsson,et al.  An adaptive hybrid elasticity controller for cloud infrastructures , 2012, 2012 IEEE Network Operations and Management Symposium.

[13]  Alan Fekete,et al.  Event aware elasticity control for cloud applications , 2012 .

[14]  Cristiano André da Costa,et al.  AutoElastic: Automatic Resource Elasticity for High Performance Applications in the Cloud , 2016, IEEE Transactions on Cloud Computing.

[15]  Frank Leymann,et al.  Dynamic Service Provisioning for the Cloud , 2012, 2012 IEEE Ninth International Conference on Services Computing.

[16]  Hai Jin,et al.  Towards Optimized Fine-Grained Pricing of IaaS Cloud Platform , 2015, IEEE Transactions on Cloud Computing.

[17]  Rajkumar Buyya,et al.  Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers , 2010, MGC '10.

[18]  Franz J. Hauck,et al.  CLOUDFARM: An Elastic Cloud Platform with Flexible and Adaptive Resource Management , 2014, 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing.

[19]  Eddy Caron,et al.  Forecasting for Cloud computing on-demand resources based on pattern matching , 2010 .

[20]  Krzysztof Banas,et al.  Comparison of Xeon Phi and Kepler GPU Performance for Finite Element Numerical Integration , 2014, 2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS).

[21]  Bruno Schulze,et al.  An Analysis of Public Clouds Elasticity in the Execution of Scientific Applications: a Survey , 2016, Journal of Grid Computing.

[22]  José Antonio Lozano,et al.  A Review of Auto-scaling Techniques for Elastic Applications in Cloud Environments , 2014, Journal of Grid Computing.

[23]  Claus Pahl,et al.  Autonomic resource provisioning for cloud-based software , 2014, SEAMS 2014.

[24]  Samuel Kounev,et al.  BUNGEE: An Elasticity Benchmark for Self-Adaptive IaaS Cloud Environments , 2015, 2015 IEEE/ACM 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems.

[25]  Hai Jin,et al.  Morpho: A decoupled MapReduce framework for elastic cloud computing , 2014, Future Gener. Comput. Syst..

[26]  Dejan Nickovic,et al.  A Pattern-Based Formalization of Cloud-Based Elastic Systems , 2015, 2015 IEEE/ACM 7th International Workshop on Principles of Engineering Service-Oriented and Cloud Systems.

[27]  Bing Han,et al.  Research and Improvement of Congestion Control Algorithms Based on TCP Protocol , 2009, 2009 WRI World Congress on Software Engineering.

[28]  Xue-Jie Zhang,et al.  Comparison of open-source cloud management platforms: OpenStack and OpenNebula , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[29]  Gagan Agrawal,et al.  A Framework for Elastic Execution of Existing MPI Programs , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[30]  Kathryn Bean,et al.  Transforming reactive auto-scaling into proactive auto-scaling , 2013, CloudDP '13.

[31]  Marco Aurélio Stelmar Netto,et al.  Evaluating Auto-scaling Strategies for Cloud Computing Environments , 2014, 2014 IEEE 22nd International Symposium on Modelling, Analysis & Simulation of Computer and Telecommunication Systems.

[32]  Erik Elmroth,et al.  Self-adaptation Challenges for Cloud-based Applications: A Control Theoretic Perspective , 2015 .

[33]  Marin Litoiu,et al.  Exploring Alternative Approaches to Implement an Elasticity Policy , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[34]  Schahram Dustdar,et al.  Application-level performance monitoring of cloud services based on the complex event processing paradigm , 2012, 2012 Fifth IEEE International Conference on Service-Oriented Computing and Applications (SOCA).

[35]  Feng Xu,et al.  Research and application of migrating legacy systems to the private cloud platform with cloudstack , 2012, 2012 IEEE International Conference on Automation and Logistics.

[36]  Antonino Musolino,et al.  Numerical Integration of Coupled Equations for High-Speed Electromechanical Devices , 2015, IEEE Transactions on Magnetics.

[37]  Mihai Comanescu Implementation of time-varying observers used in direct field orientation of motor drives by trapezoidal integration , 2012 .

[38]  Wenguang Chen,et al.  Cost-effective cloud HPC resource provisioning by building Semi-Elastic virtual clusters , 2013, 2013 SC - International Conference for High Performance Computing, Networking, Storage and Analysis (SC).