Mapping of time-consuming multitask applications on a cloud system by multiobjective Differential Evolution

The paper deal with the mapping problem of multitask parallel applications on cloud systems.Specific reference is made to task interaction graph applications.A new form of service contract is hypothesized.A tool based on a multiobjective Differential Evolution algorithm is proposed to deal with the problem.The results demonstrate the effectiveness of the proposed evolutionary mapper. Cloud computing is on-demand provisioning of virtual resources aggregated together so that by specific contracts users can lease access to their combined power.Here we hypothesize a new form of service contract by means of which users do not explicitly require resources, but simply supply information about their time-consuming multitask applications and specify their needs through some quality of service (QoS) parameters. The individuation of the virtual machines (VMs) onto which map and execute them is left to the cloud manager. Unfortunately the task/node mapping, already known as NP-hard for conventional parallel systems, becomes more challenging when application tasks must be run on VMs hosted on heterogeneous and shared cloud nodes, and when it must comply with QoS requests too. To support this new cloud service, a novel mapper tool, based on a multiobjective Differential Evolution algorithm, is proposed. Such a tool defines the mapping of the tasks on the VMs with the aim to exploit as much as possible the available cloud resources without penalizing the execution time of the submitted applications and, at the same time, to respect users' QoS requests.To reveal the robustness of this evolutionary tool, an experimental analysis on artificial time-consuming parallel applications, modeled as task interaction graphs, has been effected.

[1]  Virginia Mary Lo,et al.  Heuristic Algorithms for Task Assignment in Distributed Systems , 1988, IEEE Trans. Computers.

[2]  E. Tarantino,et al.  A distributed evolutionary approach for multisite mapping on grids , 2011, Concurr. Comput. Pract. Exp..

[3]  Abhijit Bose,et al.  MARS: a metascheduler for distributed resources in campus grids , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[4]  Rajkumar Buyya,et al.  Multiobjective differential evolution for workflow execution on grids , 2007, MGC '07.

[5]  Laxmikant V. Kalé,et al.  Optimizing VM placement for HPC in the cloud , 2012, FederatedClouds '12.

[6]  室 章治郎.  Michael R.Garey/David S.Johnson 著, "COMPUTERS AND INTRACTABILITY A guide to the Theory of NP-Completeness", FREEMAN, A5判変形判, 338+xii, \5,217, 1979 , 1980 .

[7]  Ki-Hyung Kim,et al.  Mapping Cooperating GRID Applications by Affinity for Resource Characteristics , 2004, AIS.

[8]  Andreas C. Nearchou,et al.  Differential evolution for sequencing and scheduling optimization , 2006, J. Heuristics.

[9]  Naixue Xiong,et al.  A game-theoretic method of fair resource allocation for cloud computing services , 2010, The Journal of Supercomputing.

[10]  Jeffrey D. Ullman,et al.  NP-Complete Scheduling Problems , 1975, J. Comput. Syst. Sci..

[11]  Dejan S. Milojicic,et al.  Exploring the performance and mapping of HPC applications to platforms in the cloud , 2012, HPDC '12.

[12]  Sathish S. Vadhiyar,et al.  Performance modeling of parallel applications for grid scheduling , 2008, J. Parallel Distributed Comput..

[13]  Shen Shen Wu,et al.  Heuristic Algorithms for Task Assignment and Scheduling in a Processor Network , 1994, Parallel Comput..

[14]  Francine Berman,et al.  High-performance schedulers , 1998 .

[15]  Fei Wang,et al.  A Task Scheduling Algorithm Based on Load Balancing in Cloud Computing , 2010, WISM.

[16]  Zibin Zheng,et al.  Topology-Aware Deployment of Scientific Applications in Cloud Computing , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[17]  Domenico Laforenza,et al.  Grid programming: some indications where we are headed , 2002, Parallel Comput..

[18]  Rajkumar Buyya,et al.  Multiobjective differential evolution for scheduling workflow applications on global Grids , 2009 .

[19]  Geoffrey C. Fox,et al.  High Performance Parallel Computing with Clouds and Cloud Technologies , 2009, CloudComp.

[20]  Y. Khalidi,et al.  Building a Cloud Computing Platform for New Possibilities , 2011, Computer.

[21]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[22]  Rajkumar Buyya,et al.  Workflow scheduling algorithms for grid computing , 2008 .

[23]  Shuai Gao,et al.  Genetic simulated annealing algorithm for task scheduling based on cloud computing environment , 2010, 2010 International Conference on Intelligent Computing and Integrated Systems.

[24]  Dejan S. Milojicic,et al.  HPC-Aware VM Placement in Infrastructure Clouds , 2013, 2013 IEEE International Conference on Cloud Engineering (IC2E).

[25]  Selim G. Akl,et al.  Scheduling Algorithms for Grid Computing: State of the Art and Open Problems , 2006 .

[26]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[27]  Rajkumar Buyya,et al.  High-Performance Cloud Computing: A View of Scientific Applications , 2009, 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks.

[28]  David Fernández-Baca,et al.  Allocating Modules to Processors in a Distributed System , 1989, IEEE Trans. Software Eng..

[29]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[30]  Mary K. Vernon,et al.  Parallel program performance prediction using deterministic task graph analysis , 2004, TOCS.

[31]  Ville Tirronen,et al.  A study on scale factor/crossover interaction in distributed differential evolution , 2011, Artificial Intelligence Review.

[32]  Oscar H. Ibarra,et al.  Heuristic Algorithms for Scheduling Independent Tasks on Nonidentical Processors , 1977, JACM.

[33]  Mehmet Fatih Tasgetiren,et al.  A discrete differential evolution algorithm for the permutation flowshop scheduling problem , 2007, GECCO '07.

[34]  Amin Nobakhti,et al.  A simple self-adaptive Differential Evolution algorithm with application on the ALSTOM gasifier , 2008, Appl. Soft Comput..

[35]  Rizos Sakellariou,et al.  A hybrid heuristic for DAG scheduling on heterogeneous systems , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[36]  Richard Wolski,et al.  The Eucalyptus Open-Source Cloud-Computing System , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[37]  Jan Platos,et al.  Differential Evolution for Scheduling Independent Tasks on Heterogeneous Distributed Environments , 2010 .

[38]  Atakan Dogan,et al.  Scheduling of a meta-task with QoS requirements in heterogeneous computing systems , 2006, J. Parallel Distributed Comput..

[39]  David R. Kaeli,et al.  Quantifying load imbalance on virtualized enterprise servers , 2010, WOSP/SIPEW '10.

[40]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[41]  André Brinkmann,et al.  Enforcing SLAs in Scientific Clouds , 2010, 2010 IEEE International Conference on Cluster Computing.

[42]  C. Sanges,et al.  A recursively scalable network VLSI implementation , 1988, Future Gener. Comput. Syst..

[43]  Depei Qian,et al.  Virtual machine mapping policy based on load balancing in private cloud environment , 2011, 2011 International Conference on Cloud and Service Computing.

[44]  Ivanoe De Falco,et al.  A Distributed Differential Evolution Approach for Mapping in a Grid Environment , 2007, 15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07).

[45]  Hamidah Ibrahim,et al.  Impatient task mapping in elastic cloud using genetic algorithm , 2011 .

[46]  Yang Yu,et al.  QoS Constrained Grid Workflow Scheduling Optimization Based on a Novel PSO Algorithm , 2009, 2009 Eighth International Conference on Grid and Cooperative Computing.

[47]  Yong Zhao,et al.  Cloud Computing and Grid Computing 360-Degree Compared , 2008, GCE 2008.

[48]  Lori A. Clarke,et al.  Task interaction graphs for concurrency analysis , 1989, ICSE '89.

[49]  Edward Walker,et al.  Benchmarking Amazon EC2 for High-Performance Scientific Computing , 2008, login Usenix Mag..

[50]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[51]  Borja Sotomayor,et al.  Virtual Infrastructure Management in Private and Hybrid Clouds , 2009, IEEE Internet Computing.

[52]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[53]  Hironori Kasahara,et al.  Practical Multiprocessor Scheduling Algorithms for Efficient Parallel Processing , 1984, IEEE Transactions on Computers.

[54]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[55]  Rajkumar Buyya,et al.  Market-Oriented Cloud Computing: Vision, Hype, and Reality for Delivering IT Services as Computing Utilities , 2008, 2008 10th IEEE International Conference on High Performance Computing and Communications.

[56]  Ivanoe De Falco,et al.  Two new fast heuristics for mapping parallel applications on cloud computing , 2014, Future Gener. Comput. Syst..

[57]  Theodora Varvarigou,et al.  Service selection and workflow mapping for Grids: an approach exploiting quality-of-service information , 2009 .

[58]  Graham R. Nudd,et al.  Pace—A Toolset for the Performance Prediction of Parallel and Distributed Systems , 2000, Int. J. High Perform. Comput. Appl..

[59]  Ivanoe De Falco,et al.  Multiobjective Differential Evolution for Mapping in a Grid Environment , 2007, HPCC.

[60]  Francine Berman,et al.  Using Stochastic Information to Predict Application Behavior on Contended Resources , 2001, Int. J. Found. Comput. Sci..

[61]  Vijay S. Mookerjee,et al.  Maximizing business value by optimal assignment of jobs to resources in grid computing , 2009, Eur. J. Oper. Res..

[62]  J. Ramanujam,et al.  Cluster partitioning approaches to mapping parallel programs onto a hypercube , 1987, Parallel Comput..

[63]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[64]  Zhongzhi Shi,et al.  A revisit of fast greedy heuristics for mapping a class of independent tasks onto heterogeneous computing systems , 2007, J. Parallel Distributed Comput..

[65]  Quan-Ke Pan,et al.  A novel differential evolution algorithm for bi-criteria no-wait flow shop scheduling problems , 2009, Comput. Oper. Res..

[66]  Min Xie,et al.  Iterative list scheduling for heterogeneous computing , 2005, J. Parallel Distributed Comput..

[67]  Ivanoe De Falco,et al.  An adaptive multisite mapping for computationally intensive grid applications , 2010, Future Gener. Comput. Syst..

[68]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[69]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[70]  Alexandru Iosup,et al.  Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing , 2011, IEEE Transactions on Parallel and Distributed Systems.

[71]  Michael Griebel,et al.  Massively Parallel Fluid Simulations on Amazon's HPC Cloud , 2011, 2011 First International Symposium on Network Cloud Computing and Applications.

[72]  Rajkumar Buyya,et al.  Environment-conscious scheduling of HPC applications on distributed Cloud-oriented data centers , 2011, J. Parallel Distributed Comput..

[73]  Ishfaq Ahmad,et al.  Optimal task assignment in heterogeneous distributed computing systems , 1998, IEEE Concurr..

[74]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.