Multi-objective Evolution Based Dynamic Job Scheduler in Grid

Grid computing is a high performance computing environment to fulfill large-scale computational demands. It can integrate computational as well as storage resources from different networks and geographically dispersed organizations into a high performance computational & storage platform. It is used to solve complex computational-intensive problems, and also provide solution to storage-intensive applications with connected storage resources. Scheduling of user jobs properly on the heterogeneous resources is an important task in a grid computing environment. The main goal of scheduling is to maximize resource utilization, minimize waiting time of jobs, reduce energy consumption, minimize cost to the user after satisfying constraints of jobs and resources. We can trade off between the required level of quality of service, the deadline and the budget of user. In this paper, we propose a Multi-objective Evolution-based Dynamic Scheduler in Grid. Our scheduler have used Multi-objective optimization technique using Genetic algorithm with pareto front approach to find efficient schedules. It explores the search space vividly to avoid stagnation and generate near optimal solution. We propose that our scheduler provides a better grip on most features of grid from perspective of grid owner as well as user. Dynamic grid environment has forced us to make it a real time dynamic scheduler. A job grouping technique is proposed for grouping fine-grained jobs and for ease of computation. Experimentation on different data sets and on various parameters revealed effectiveness of multi-objective scheduling criteria and extraction of performance from grid resource.

[1]  Klaudia Frankfurter Computers And Intractability A Guide To The Theory Of Np Completeness , 2016 .

[2]  Bart Dhoedt,et al.  Dynamic scheduling in grid systems , 2005 .

[3]  Alan S. Manne,et al.  On the Job-Shop Scheduling Problem , 1960 .

[4]  Ian T. Foster,et al.  The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets , 2000, J. Netw. Comput. Appl..

[5]  Ajith Abraham,et al.  MULTIOBJECTIVE EVOLUTIONARY ALGORITHMS FOR SCHEDULING JOBS ON COMPUTATIONAL GRIDS , 2007 .

[6]  Li Gao,et al.  Task Scheduling using Parallel Genetic Simulated Annealing Algorithm , 2006, 2006 IEEE International Conference on Service Operations and Logistics, and Informatics.

[7]  A. Abraham,et al.  Scheduling jobs on computational grids using a fuzzy particle swarm optimization algorithm , 2010, Future Gener. Comput. Syst..

[8]  John Levine,et al.  A hybrid ant algorithm for scheduling independent jobs in heterogeneous computing environments , 2004 .

[9]  Jarek Nabrzyski,et al.  Grid resource management: state of the art and future trends , 2004 .

[10]  Min Liu,et al.  An enhanced Pareto-based artificial bee colony algorithm for the multi-objective flexible job-shop scheduling , 2012 .

[11]  Graham Ritchie,et al.  Static Multi-processor Scheduling with Ant Colony Optimisation & Local Search , 2003 .

[12]  Steve Greenberg,et al.  Best Practices for Data Centers: Lessons Learned from Benchmarking 22 Data Centers , 2006 .

[13]  Ujjwal Maulik,et al.  A Simulated Annealing-Based Multiobjective Optimization Algorithm: AMOSA , 2008, IEEE Transactions on Evolutionary Computation.

[14]  Peter Brucker,et al.  Job-shop scheduling with multi-purpose machines , 1991, Computing.

[15]  Wilfried Jakob,et al.  Fast Multi-objective Scheduling of Jobs to Constrained Resources Using a Hybrid Evolutionary Algorithm , 2008, PPSN.

[16]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[17]  Ajith Abraham,et al.  Scheduling Jobs on Computational Grids Using Fuzzy Particle Swarm Algorithm , 2006, KES.

[18]  John Levine,et al.  A fast, effective local search for scheduling independent jobs in heterogeneous computing environments , 2003 .

[19]  Woodie C. Flowers,et al.  A genetic algorithm for resource-constrained scheduling , 1996 .

[20]  Ian T. Foster,et al.  Grid Services for Distributed System Integration , 2002, Computer.

[21]  Lakhmi C. Jain,et al.  Network and information security: A computational intelligence approach: Special Issue of Journal of Network and Computer Applications , 2007, J. Netw. Comput. Appl..

[22]  Quan Liu,et al.  Research on Fine-grained Job scheduling in Grid Computing , 2009 .

[23]  Rajkumar Buyya,et al.  A Dynamic Job Grouping-Based Scheduling for Deploying Applications with Fine-Grained Tasks on Global Grids , 2005, ACSW.

[24]  Jack J. Dongarra,et al.  Experiments with Scheduling Using Simulated Annealing in a Grid Environment , 2002, GRID.

[25]  Rajkumar Buyya,et al.  Nature's heuristics for scheduling jobs on Computational Grids , 2000 .

[26]  Mutsuo Saito,et al.  An Application of Finite Field: Design and Implementation of 128-bit Instruction-Based Fast Pseudorandom Number Generator , 2007 .

[27]  Alexandru Iosup,et al.  The Grid Workloads Archive , 2008, Future Gener. Comput. Syst..

[28]  Oscar H. Ibarra,et al.  Heuristic Algorithms for Scheduling Independent Tasks on Nonidentical Processors , 1977, JACM.

[29]  Arun Agarwal,et al.  Fuzzy based resource management framework for high throughput computing , 2004, IEEE International Symposium on Cluster Computing and the Grid, 2004. CCGrid 2004..

[30]  Kun-Ming Yu,et al.  An Evolution-Based Dynamic Scheduling Algorithm in Grid Computing Environment , 2008, 2008 Eighth International Conference on Intelligent Systems Design and Applications.

[31]  Peter Brucker,et al.  Job-shop Scheduling Problem , 2009, Encyclopedia of Optimization.

[32]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[33]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[34]  Fatos Xhafa,et al.  Computational models and heuristic methods for Grid scheduling problems , 2010, Future Gener. Comput. Syst..

[35]  Jarek Nabrzyski,et al.  Grid Resource Management , 2004 .