A Survey on ANN Based Task Scheduling Strategies in Heterogeneous Distributed Computing Systems

Heterogeneous Distributed Computing Systems (HeDCS) efficiently utilize the heterogeneity of diverse computational resources which are interlinked through high speed networks for executing a group of computing intensive applications. Directed acyclic graphs (DAGs) are usually used to represent these parallel applications with varied computational requirements and constraints. The optimal scheduling of the given set of precedence constrained tasks to available resources is a core concern in HeDCS and is known to be NP Complete problem. Non deterministic nature of application programs and heterogeneous environment are the main challenges in designing, implementing and analyzing phases of task scheduling techniques. A myriad of heuristic and meta-heuristic approaches have been proposed in the literature to solve this complex problem. The basic purpose of this study is to cover ANN based task scheduling strategies in the distributed computing environment perspective. Further existing scheduling heuristics could be classified in a new state of art classification including the description of frequently used parameters in the mentioned scheduling strategies. The flexible and powerful nature of ANN for identifying the data patterns, underlying time and other constraints and learning capabilities have shown to be a promising candidate among other heuristics. Nepal Journal of Science and Technology Vol. 16, No.1 (2015) pp. 69-78

[1]  Ishfaq Ahmad,et al.  Efficient Scheduling of Arbitrary TAsk Graphs to Multiprocessors Using a Parallel Genetic Algorithm , 1997, J. Parallel Distributed Comput..

[2]  Ishfaq Ahmad,et al.  Optimal task assignment in heterogeneous distributed computing systems , 1998, IEEE Concurr..

[3]  Radu Prodan,et al.  Towards a general model of the multi-criteria workflow scheduling on the grid , 2009, Future Gener. Comput. Syst..

[4]  Yi Yang,et al.  Selection of the Order of Autoregressive Models for Host Load Prediction in Grid , 2007, Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007).

[5]  Hangyu Wang,et al.  Hopfield Neural Network Approach for Task Scheduling in a Grid Environment , 2008, 2008 International Conference on Computer Science and Software Engineering.

[6]  Hesham El-Rewini,et al.  Scheduling and Task Allocation , 2005 .

[7]  Jiadong Yang,et al.  Task scheduling using Bayesian optimization algorithm for heterogeneous computing environments , 2011, Appl. Soft Comput..

[8]  Imtiaz Ahmad,et al.  Particle swarm optimization for task assignment problem , 2002, Microprocess. Microsystems.

[9]  ZhuGuangxi,et al.  An optimal scheduling algorithm based on task duplication , 2005 .

[10]  Zheng Shijue,et al.  A parallel genetic simulated annealing hybrid algorithm for task scheduling , 2008, Wuhan University Journal of Natural Sciences.

[11]  H. G. Rotithor.  Taxonomy of dynamic task scheduling schemes in distributed computing systems , 1994 .

[12]  Cédric Augonnet,et al.  StarPU: a unified platform for task scheduling on heterogeneous multicore architectures , 2011, Concurr. Comput. Pract. Exp..

[13]  Kenli Li,et al.  List scheduling with duplication for heterogeneous computing systems , 2010, J. Parallel Distributed Comput..

[14]  Virginia Mary Lo,et al.  Heuristic Algorithms for Task Assignment in Distributed Systems , 1988, IEEE Trans. Computers.

[15]  Kanad Ghose,et al.  A Bottom-Up Approach to Task Scheduling on Distributed Memory Multiprocessors , 1994, 1994 Internatonal Conference on Parallel Processing Vol. 2.

[16]  Zhenwei Yu,et al.  A Chaotic Neural Network Algorithm for Task Scheduling in Overlay Grid , 2005, 2005 First International Conference on Semantics, Knowledge and Grid.

[17]  C. Ribeiro,et al.  A Tabu Search Approach to Task Scheduling on Heterogeneous Processors under Precedence Constraints , 1995, Int. J. High Speed Comput..

[18]  Celso C. Ribeiro,et al.  Performance evaluation of a parallel tabu search task scheduling algorithm , 2000, Parallel Comput..

[19]  Emmanuel Jeannot,et al.  Robust task scheduling in non-deterministic heterogeneous computing systems , 2006, 2006 IEEE International Conference on Cluster Computing.

[20]  Funda Sivrikaya-Serifoglu,et al.  Multiprocessor task scheduling in multistage hybrid flow-shops: a genetic algorithm approach , 2004, J. Oper. Res. Soc..

[21]  Bassem Jarboui,et al.  A combinatorial particle swarm optimization for solving multi-mode resource-constrained project scheduling problems , 2008, Appl. Math. Comput..

[22]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[23]  Yong Meng Teo,et al.  Solving the N-Body Problem with the ALiCE Grid System , 2002, ASIAN.

[24]  Wayne H. Wolf,et al.  TGFF: task graphs for free , 1998, Proceedings of the Sixth International Workshop on Hardware/Software Codesign. (CODES/CASHE'98).

[25]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[26]  Varghese S. Jacob,et al.  Heuristics and augmented neural networks for task scheduling with non-identical machines , 2006, Eur. J. Oper. Res..

[27]  Stephen F. Lundstrom,et al.  Predicting Performance of Parallel Computations , 1990, IEEE Trans. Parallel Distributed Syst..

[28]  Varghese S. Jacob,et al.  An Improved Augmented Neural-Network Approach for Scheduling Problems , 2006, INFORMS J. Comput..

[29]  Felipe Balmaceda,et al.  Optimal Task Assignments , 2016, Games Econ. Behav..

[30]  Andrew J. Page,et al.  Dynamic task scheduling using genetic algorithms for heterogeneous distributed computing , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[31]  Yueh-Min Huang,et al.  Scheduling multiprocessor job with resource and timing constraints using neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[32]  Hojjat Adeli,et al.  Scheduling/Cost Optimization and Neural Dynamics Model for Construction , 1997 .

[33]  Yueh-Min Huang,et al.  Competitive neural network to solve scheduling problems , 2001, Neurocomputing.

[34]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[35]  Mario Cannataro,et al.  Distributed data mining on grids: services, tools, and applications , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  Rajesh K. Gupta,et al.  Energy-aware task scheduling with task synchronization for embedded real-time systems , 2006, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[37]  R P Levin.  Efficient scheduling. , 1997, Dental economics - oral hygiene.

[38]  Ishfaq Ahmad,et al.  Dynamic Critical-Path Scheduling: An Effective Technique for Allocating Task Graphs to Multiprocessors , 1996, IEEE Trans. Parallel Distributed Syst..

[39]  Chisu Wu,et al.  Genetic-algorithm-based real-time task scheduling with multiple goals , 2004, J. Syst. Softw..

[40]  Jan Janecek,et al.  A high performance, low complexity algorithm for compile-time task scheduling in heterogeneous systems , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[41]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[42]  Salim Hariri,et al.  Task scheduling algorithms for heterogeneous processors , 1999, Proceedings. Eighth Heterogeneous Computing Workshop (HCW'99).

[43]  Johan Montagnat,et al.  Flexible and Efficient Workflow Deployment of Data-Intensive Applications On Grids With MOTEUR , 2008, Int. J. High Perform. Comput. Appl..

[44]  Jiayi Zhou,et al.  A Fuzzy Neural Network Based Scheduling Algorithm for Job Assignment on Computational Grids , 2007, NBiS.

[45]  Dharma P. Agrawal,et al.  A task duplication based scheduling algorithm for heterogeneous systems , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[46]  Behrooz Shirazi,et al.  Analysis and Evaluation of Heuristic Methods for Static Task Scheduling , 1990, J. Parallel Distributed Comput..

[47]  A.M. Rahmani,et al.  A Modified Simulated Annealing Algorithm for Static Task Scheduling in Grid Computing , 2008, 2008 International Conference on Computer Science and Information Technology.

[48]  Kang G. Shin,et al.  Combined Task and Message Scheduling in Distributed Real-Time Systems , 1999, IEEE Trans. Parallel Distributed Syst..

[49]  Rajkumar Buyya,et al.  Economic-based Distributed Resource Management and Scheduling for Grid Computing , 2002, ArXiv.

[50]  José Aguilar,et al.  Heuristic Algorithms for Task Assignment of Parallel Programs , 1994, EUROSIM.

[51]  Elisa Bertino,et al.  PARALLEL AND DISTRIBUTED SYSTEMS , 2010 .

[52]  Jing-Chiou Liou,et al.  Task Clustering and Scheduling for Distributed Memory Parallel Architectures , 1996, IEEE Trans. Parallel Distributed Syst..

[53]  Jiayi Zhou,et al.  A Dynamic Resource Broker and Fuzzy Logic Based Scheduling Algorithm in Grid Environment , 2007, ICANNGA.

[54]  Rizos Sakellariou,et al.  Towards Service Level Agreement Based Scheduling on the Grid , 2004 .

[55]  Jacek Blazewicz,et al.  Distributed Processing of Divisible Jobs with Communication Startup Costs , 1997, Discret. Appl. Math..

[56]  Dongkun Shin,et al.  Intra-Task Voltage Scheduling for Low-Energy, Hard Real-Time Applications , 2001, IEEE Des. Test Comput..