Multi-Criteria Job Scheduling in Grid Using an Accelerated Genetic Algorithm

The continuous growth of computation power requirement has provoked computational Grids, in order to resolve large scale problems. Job scheduling is a very important mechanism and a better scheduling scheme can greatly improve the efficiency of Grid computing. A lot of algorithms have been proposed to address the job scheduling problem. Unfortunately, most of them largely ignore the security risks involved in executing jobs in such an unreliable environment as Grid. This is known as security problem and it is a main hurdle to make the job scheduling secure, reliable and fault-tolerant. In this paper, we present a Genetic Algorithm with multi-criteria approach, in terms of job completion time and security risks. Although Genetic Algorithms are suitable for large search space problems such as job scheduling, they are too slow to be executed online. Hence, we changed the implementation of a traditional genetic algorithm, proposing the Accelerated Genetic Algorithm. We also present the Accelerated Genetic Algorithm with Overhead which concerns the extra overhead caused by the application of Accelerated Genetic Algorithm. Accelerated Genetic Algorithm and Accelerated Genetic Algorithm with Overhead are compared with three well-known heuristic algorithms. Simulation results indicate a substantial performance advantage of both Accelerated Genetic Algorithm and Accelerated Genetic Algorithm with Overhead.

[1]  Jarek Nabrzyski,et al.  A multicriteria approach to two-level hierarchy scheduling in grids , 2008, J. Sched..

[2]  Rajkumar Buyya,et al.  A Taxonomy of Workflow Management Systems for Grid Computing , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[3]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[4]  Helen D. Karatza,et al.  Task cluster scheduling in a grid system , 2010, Simul. Model. Pract. Theory.

[5]  Maria Pia Fanti,et al.  Genetic multi-criteria approach to flexible line scheduling , 1998, Int. J. Approx. Reason..

[6]  Thomas L. Casavant,et al.  A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems , 1988, IEEE Trans. Software Eng..

[7]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[8]  Chuliang Weng,et al.  Heuristic scheduling for bag-of-tasks applications in combination with QoS in the computational grid , 2005, Future Gener. Comput. Syst..

[9]  Helen D. Karatza,et al.  Clairvoyant site allocation of jobs with highly variable service demands in a computational grid , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[10]  Helen D. Karatza,et al.  Performance and energy aware cluster-level scheduling of compute-intensive jobs with unknown service times , 2011, Simul. Model. Pract. Theory.

[11]  Albert Y. Zomaya,et al.  An Introduction to Genetic-Based Scheduling in Parallel-Processor Systems , 2001 .

[12]  Hesham H. Ali,et al.  Task scheduling in parallel and distributed systems , 1994, Prentice Hall series in innovative technology.

[13]  John M. Brooke,et al.  Enabling scientific collaboration on the Grid , 2010, Future Gener. Comput. Syst..

[14]  Michael J. Lewis,et al.  Grid Resource Availability Prediction-Based Scheduling and Task Replication , 2009, Journal of Grid Computing.

[15]  Nirwan Ansari,et al.  A Genetic Algorithm for Multiprocessor Scheduling , 1994, IEEE Trans. Parallel Distributed Syst..

[16]  Han Hoogeveen,et al.  Multicriteria scheduling , 2005, Eur. J. Oper. Res..

[17]  Dalibor Klusácek,et al.  Comparison Of Multi-Criteria Scheduling Techniques , 2008, CoreGRID Integration Workshop.

[18]  Sheng-De Wang,et al.  Nature's heuristics for scheduling jobs on Computational Grids , 2000 .

[19]  Marin Golub,et al.  Scheduling Multiprocessor Tasks with Genetic Algorithms , 2019 .

[20]  Ladislau Bölöni,et al.  A comparison study of static mapping heuristics for a class of meta-tasks on heterogeneous computing systems , 1999, Proceedings. Eighth Heterogeneous Computing Workshop (HCW'99).

[21]  Gideon Langholz,et al.  Multi-criteria scheduling optimization using fuzzy logic , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[22]  Ming Tang,et al.  The impact of data replication on job scheduling performance in the Data Grid , 2006, Future Gener. Comput. Syst..

[23]  W. A. Greene,et al.  Dynamic load-balancing via a genetic algorithm , 2001, Proceedings 13th IEEE International Conference on Tools with Artificial Intelligence. ICTAI 2001.

[24]  Marco Aurélio Amaral Henriques,et al.  An Adaptive Scheduler for Grids , 2006, Journal of Grid Computing.

[25]  Jarek Nabrzyski,et al.  Grid Multicriteria Job Scheduling with Resource Reservation and Prediction Mechanisms , 2006 .

[26]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[27]  Ken Kennedy,et al.  Scheduling strategies for mapping application workflows onto the grid , 2005, HPDC-14. Proceedings. 14th IEEE International Symposium on High Performance Distributed Computing, 2005..

[28]  Uwe Schwiegelshohn,et al.  Job Allocation Strategies with User Run Time Estimates for Online Scheduling in Hierarchical Grids , 2011, Journal of Grid Computing.

[29]  Shanshan Song,et al.  Risk-resilient heuristics and genetic algorithms for security-assured grid job scheduling , 2006, IEEE Transactions on Computers.

[30]  Fatos Xhafa,et al.  Genetic algorithm based schedulers for grid computing systems , 2007 .

[31]  Victoria Ungureanu,et al.  Deferred Assignment Scheduling in Cluster-Based Servers , 2006, Cluster Computing.

[32]  Shanshan Song,et al.  Security-driven heuristics and a fast genetic algorithm for trusted grid job scheduling , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[33]  Marco Danelutto,et al.  Integrated Research in Grid Computing , 2008 .

[34]  Rajkumar Buyya,et al.  Weaving computational grids: how analogous are they with electrical grids? , 2002, Comput. Sci. Eng..

[35]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[36]  Amany M. Sarhan,et al.  A New Grid Scheduler with Failure Recovery and Rescheduling Mechanisms: Discussion and Analysis , 2012, Journal of Grid Computing.

[37]  Helen D. Karatza,et al.  The impact of service demand variability on resource allocation strategies in a grid system , 2010, TOMC.

[38]  R. C. Joshi,et al.  A weighted mean time Min-Min Max-Min selective scheduling strategy for independent tasks on Grid , 2010, 2010 IEEE 2nd International Advance Computing Conference (IACC).

[39]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[40]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[41]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[42]  Chao-Chin Wu,et al.  An integrated security-aware job scheduling strategy for large-scale computational grids , 2010, Future Gener. Comput. Syst..

[43]  Helen D. Karatza,et al.  Evaluation of gang scheduling performance and cost in a cloud computing system , 2010, The Journal of Supercomputing.

[44]  Albert Y. Zomaya,et al.  Observations on Using Genetic Algorithms for Dynamic Load-Balancing , 2001, IEEE Trans. Parallel Distributed Syst..

[45]  Jemal H. Abawajy,et al.  An efficient adaptive scheduling policy for high-performance computing , 2009, Future Gener. Comput. Syst..

[46]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..

[47]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[48]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[49]  Ian T. Foster,et al.  A security architecture for computational grids , 1998, CCS '98.

[50]  Ben Y. Zhao,et al.  An architecture for a secure service discovery service , 1999, MobiCom.