A novel scheduling with multi-criteria for high-performance computing systems: an improved genetic algorithm-based approach

Scheduling in high-performance computing systems is experiencing potential challenges in modern computing applications due to different application sizes, computational requirements, resource utilization, rational completion time, etc. The scheduling problem is known to be an NP-complete problem. These challenges are moderated by the logical assignment of tasks to processors in a way to produce minimum schedule length and lesser load balance by utilizing system resources. In this paper, we proposed a novel genetic algorithm (GA)-based scheduling technique by considering four conflicting objectives, minimization of makespan, load balancing, and maximization of resource utilization, and speed up ratio. A novel mutation technique is proposed which helps to improve the considered multiple objectives. The performance of the proposed work is analyzed and validated through extensive simulation results using synthetic as well as benchmark data sets. It has been observed that the proposed work performs better than the existing algorithms, GA-based scheduling, priority-based performance-improved algorithm, and particle swarm optimization. A statistical hypothesis test ANOVA followed by post hoc analysis is conducted to demonstrate the significance of the work.

[1]  Abbas Akkasi,et al.  Genetic Algorithm for Task Scheduling in Heterogeneous Distributed Computing System , 2015 .

[2]  Li Fu,et al.  Time and Energy Optimization Algorithms for the Static Scheduling of Multiple Workflows in Heterogeneous Computing System , 2017, Journal of Grid Computing.

[3]  Helen D. Karatza,et al.  Scheduling bags of tasks and gangs in a distributed system , 2015, 2015 International Conference on Computer, Information and Telecommunication Systems (CITS).

[4]  Imtiaz Ahmad,et al.  Task scheduling for heterogeneous computing systems , 2017, The Journal of Supercomputing.

[5]  Kenli Li,et al.  A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues , 2014, Inf. Sci..

[6]  Gang Zeng,et al.  A Hybrid Heuristic-Genetic Algorithm with Adaptive Parameters for Static Task Scheduling in Heterogeneous Computing System , 2017, 2017 IEEE Trustcom/BigDataSE/ICESS.

[7]  Su Wang,et al.  A Hybrid Parallel Genetic Algorithm with Dynamic Migration Strategy Based on Sunway Many-Core Processor , 2017, 2017 IEEE 19th International Conference on High Performance Computing and Communications Workshops (HPCCWS).

[8]  Yun Zhang,et al.  Efficient numerical simulation of injection mold filling with the lattice Boltzmann method , 2017 .

[9]  Manoj Khandelwal,et al.  Implementing an ANN model optimized by genetic algorithm for estimating cohesion of limestone samples , 2018, Engineering with Computers.

[10]  Valentin Cristea,et al.  Resource-aware hybrid scheduling algorithm in heterogeneous distributed computing , 2015, Future Gener. Comput. Syst..

[11]  Hassan Rashidi,et al.  An enhanced genetic algorithm with new operators for task scheduling in heterogeneous computing systems , 2017, Eng. Appl. Artif. Intell..

[12]  Yu Liu,et al.  DeMS: A hybrid scheme of task scheduling and load balancing in computing clusters , 2017, J. Netw. Comput. Appl..

[13]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[14]  Sanjay Kadam,et al.  A novel multi-objective bacteria foraging optimization algorithm (MOBFOA) for multi-objective scheduling , 2018, Appl. Soft Comput..

[15]  Nicholas R. Jennings,et al.  Efficient Task Scheduling Multi-Objective Particle Swarm Optimization in Cloud Computing , 2016, 2016 IEEE 41st Conference on Local Computer Networks Workshops (LCN Workshops).

[16]  Jian Xie,et al.  Independent Tasks Scheduling Based on Genetic Algorithm in Cloud Computing , 2009, 2009 5th International Conference on Wireless Communications, Networking and Mobile Computing.

[17]  Pratyay Kuila,et al.  Design of Dependable Task Scheduling Algorithm in Cloud Environment , 2015, WCI '15.

[18]  Howard Jay Siegel,et al.  Heterogeneous Distributed Computing , 1999 .

[19]  Marco Aurélio Stelmar Netto,et al.  Job placement advisor based on turnaround predictions for HPC hybrid clouds , 2016, Future Gener. Comput. Syst..

[20]  Nikos S. Voros,et al.  Scheduling independent tasks on heterogeneous processors using heuristics and Column Pricing , 2016, Future Gener. Comput. Syst..

[21]  Kenli Li,et al.  Bi-objective workflow scheduling of the energy consumption and reliability in heterogeneous computing systems , 2017, Inf. Sci..

[22]  Qiang Li,et al.  Template-Based Genetic Algorithm for QoS-Aware Task Scheduling in Cloud Computing , 2016, 2016 International Conference on Advanced Cloud and Big Data (CBD).

[23]  Jin Huang,et al.  Distributed Resource Scheduling Algorithm Based on Hybrid Genetic Algorithm , 2017, 2017 International Conference on Computing Intelligence and Information System (CIIS).

[24]  Keith E. Muller,et al.  Regression and ANOVA: An Integrated Approach Using SAS Software , 2003 .

[25]  Tarun Biswas,et al.  Multi-level queue for task scheduling in heterogeneous distributed computing system , 2017, 2017 4th International Conference on Advanced Computing and Communication Systems (ICACCS).

[26]  Kenli Li,et al.  Minimizing Cost of Scheduling Tasks on Heterogeneous Multicore Embedded Systems , 2016, ACM Trans. Embed. Comput. Syst..

[27]  David W. Coit,et al.  Multi-objective optimization using genetic algorithms: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[28]  Tarun Biswas,et al.  A Novel Energy Efficient Scheduling for High Performance Computing Systems , 2018, 2018 9th International Conference on Computing, Communication and Networking Technologies (ICCCNT).

[29]  Erik Elmroth,et al.  Towards understanding HPC users and systems: A NERSC case study , 2018, J. Parallel Distributed Comput..

[30]  Prasanta K. Jana,et al.  An effective multi-objective workflow scheduling in cloud computing: A PSO based approach , 2016, 2016 Ninth International Conference on Contemporary Computing (IC3).

[31]  O. Geoffrey Okogbaa,et al.  Regression and ANOVA: An Integrated Approach Using SAS Software , 2004 .

[32]  Kenli Li,et al.  A Hybrid Chemical Reaction Optimization Scheme for Task Scheduling on Heterogeneous Computing Systems , 2015, IEEE Transactions on Parallel and Distributed Systems.

[33]  S. Kavitha,et al.  Priority based Performance Improved Algorithm for Meta-task Scheduling in Cloud environment , 2017, 2017 2nd International Conference on Computing and Communications Technologies (ICCCT).

[34]  Prasanta K. Jana,et al.  Uncertainty-Based QoS Min–Min Algorithm for Heterogeneous Multi-cloud Environment , 2016, Arabian Journal for Science and Engineering.

[35]  R. K. Jena,et al.  Multi Objective Task Scheduling in Cloud Environment Using Nested PSO Framework , 2015 .