A Hybrid Chemical Reaction Optimization Scheme for Task Scheduling on Heterogeneous Computing Systems

Scheduling for directed acyclic graph (DAG) tasks with the objective of minimizing makespan has become an important problem in a variety of applications on heterogeneous computing platforms, which involves making decisions about the execution order of tasks and task-to-processor mapping. Recently, the chemical reaction optimization (CRO) method has proved to be very effective in many fields. In this paper, an improved hybrid version of the CRO method called HCRO (hybrid CRO) is developed for solving the DAG-based task scheduling problem. In HCRO, the CRO method is integrated with the novel heuristic approaches, and a new selection strategy is proposed. More specifically, the following contributions are made in this paper. (1) A Gaussian random walk approach is proposed to search for optimal local candidate solutions. (2) A left or right rotating shift method based on the theory of maximum Hamming distance is used to guarantee that our HCRO algorithm can escape from local optima. (3) A novel selection strategy based on the normal distribution and a pseudo-random shuffle approach are developed to keep the molecular diversity. Moreover, an exclusive-OR (XOR) operator between two strings is introduced to reduce the chance of cloning before new molecules are generated. Both simulation and real-life experiments have been conducted in this paper to verify the effectiveness of HCRO. The results show that the HCRO algorithm schedules the DAG tasks much better than the existing algorithms in terms of makespan and speed of convergence.

[1]  Hui Li,et al.  Task Scheduling of Computational Grid Based on Particle Swarm Algorithm , 2010, 2010 Third International Joint Conference on Computational Science and Optimization.

[2]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[3]  Jie Zhu,et al.  A genetic algorithm for finding a path subject to two constraints , 2013, Appl. Soft Comput..

[4]  S. Padmavathi,et al.  Contention Awareness In Task Scheduling Using Tabu Search , 2009, 2009 IEEE International Advance Computing Conference.

[5]  Lhassane Idoumghar,et al.  Motorization for an Electric Scooter by Using Permanent-Magnet Machines Optimized Based on a Hybrid Metaheuristic Algorithm , 2013, IEEE Transactions on Vehicular Technology.

[6]  Nirwan Ansari,et al.  A Genetic Algorithm for Multiprocessor Scheduling , 1994, IEEE Trans. Parallel Distributed Syst..

[7]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[8]  Stan Z. Li,et al.  Hamming Distance , 2009, Encyclopedia of Biometrics.

[9]  Shanshan Song,et al.  Risk-resilient heuristics and genetic algorithms for security-assured grid job scheduling , 2006, IEEE Transactions on Computers.

[10]  Victor O. K. Li,et al.  Chemical-Reaction-Inspired Metaheuristic for Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[11]  Daniel Gajski,et al.  Hypertool: A Programming Aid for Message-Passing Systems , 1990, IEEE Trans. Parallel Distributed Syst..

[12]  Pier Luca Lanzi,et al.  Ant colony optimization for mapping and scheduling in heterogeneous multiprocessor systems , 2008, 2008 International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation.

[13]  Kenli Li,et al.  A DAG scheduling scheme on heterogeneous computing systems using double molecular structure-based chemical reaction optimization , 2013, J. Parallel Distributed Comput..

[14]  Marin Golub,et al.  Scheduling Multiprocessor Tasks with Genetic Algorithms , 2019 .

[15]  Victor O. K. Li,et al.  Real-Coded Chemical Reaction Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[16]  Albert Y. Zomaya,et al.  Genetic Scheduling for Parallel Processor Systems: Comparative Studies and Performance Issues , 1999, IEEE Trans. Parallel Distributed Syst..

[17]  Hui Cheng,et al.  A High Efficient Task Scheduling Algorithm Based on Heterogeneous Multi-Core Processor , 2010, 2010 2nd International Workshop on Database Technology and Applications.

[18]  Shanlin Yang,et al.  An improved ant colony optimization for scheduling identical parallel batching machines with arbitrary job sizes , 2013, Appl. Soft Comput..

[19]  Pier Luca Lanzi,et al.  Ant Colony Heuristic for Mapping and Scheduling Tasks and Communications on Heterogeneous Embedded Systems , 2010, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[20]  Kenneth O. Stanley,et al.  Picbreeder: A Case Study in Collaborative Evolutionary Exploration of Design Space , 2011, Evolutionary Computation.

[21]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[22]  G. D. Smith,et al.  Solving the Graphical Steiner Tree Problem Using Genetic Algorithms , 1993 .

[23]  Jianqin Wang,et al.  A new algorithm for grid independent task schedule: Genetic simulated annealing , 2010, 2010 World Automation Congress.

[24]  Victor O. K. Li,et al.  Chemical Reaction Optimization for the Grid Scheduling Problem , 2010, 2010 IEEE International Conference on Communications.

[25]  Li Xin,et al.  A Hybrid ABC-DE Algorithm and Its Application for Time-Modulated Arrays Pattern Synthesis , 2013, IEEE Transactions on Antennas and Propagation.

[26]  Colin R. Reeves,et al.  Using Genetic Algorithms with Small Populations , 1993, ICGA.

[27]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[28]  Kenli Li,et al.  A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues , 2014, Inf. Sci..

[29]  Jin Xu,et al.  Chemical Reaction Optimization for Task Scheduling in Grid Computing , 2011, IEEE Transactions on Parallel and Distributed Systems.

[30]  Shinji Wakao,et al.  Binary-Based Topology Optimization of Magnetostatic Shielding by a Hybrid Evolutionary Algorithm Combining Genetic Algorithm and Extended Compact Genetic Algorithm , 2013, IEEE Transactions on Magnetics.

[31]  Fatos Xhafa,et al.  Scheduling in Multiprocessor System Using Genetic Algorithms , 2008, 2008 7th Computer Information Systems and Industrial Management Applications.

[32]  Hsien-Chie Cheng,et al.  Thermal Chip Placement in MCMs Using a Novel Hybrid Optimization Algorithm , 2012, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[33]  Pengfei Zhou,et al.  Hybrid optimization algorithm based on chaos, cloud and particle swarm optimization algorithm , 2013 .

[34]  Xiaoping Li,et al.  Adaptive Hybrid Algorithms for the Sequence-Dependent Setup Time Permutation Flow Shop Scheduling Problem , 2012, IEEE Transactions on Automation Science and Engineering.

[35]  Miguel A. Vega-Rodríguez,et al.  Parallel Multiobjective Metaheuristics for Inferring Phylogenies on Multicore Clusters , 2015, IEEE Transactions on Parallel and Distributed Systems.

[36]  Rick Siow Mong Goh,et al.  A Tabu Search for the Heterogeneous DAG Scheduling Problem , 2009, 2009 15th International Conference on Parallel and Distributed Systems.

[37]  James C. Browne,et al.  General approach to mapping of parallel computations upon multiprocessor architectures , 1988 .

[38]  Bin Zhang,et al.  Task Scheduling in Grid Based on Particle Swarm Optimization , 2006, 2006 Fifth International Symposium on Parallel and Distributed Computing.

[39]  Mohsen Jahanshahi,et al.  Using Simulated Annealing for Task Scheduling in Distributed Systems , 2009, 2009 International Conference on Computational Intelligence, Modelling and Simulation.

[40]  Tung Khac Truong,et al.  Chemical reaction optimization with greedy strategy for the 0-1 knapsack problem , 2013, Appl. Soft Comput..

[41]  M. E. Muller,et al.  A Note on the Generation of Random Normal Deviates , 1958 .

[42]  Y.-K. Kwok,et al.  Static scheduling algorithms for allocating directed task graphs to multiprocessors , 1999, CSUR.

[43]  Shaoqiu Xiao,et al.  A Hybrid IWO/PSO Algorithm for Pattern Synthesis of Conformal Phased Arrays , 2013, IEEE Transactions on Antennas and Propagation.

[44]  Tohru Kikuno,et al.  A new heuristic algorithm based on GAs for multiprocessor scheduling with task duplication , 1997, Proceedings of 3rd International Conference on Algorithms and Architectures for Parallel Processing.

[45]  Ying Wah Teh,et al.  A study of density-grid based clustering algorithms on data streams , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[46]  Patrick M. Reed,et al.  Diagnostic Assessment of Search Controls and Failure Modes in Many-Objective Evolutionary Optimization , 2012, Evolutionary Computation.