Comparative Study of Scheduling Algorithms in Heterogeneous Distributed Computing Systems

It is the need of an era to store and process big data and its applications. To process these applications, it is inevitable to use heterogeneous distributed computing systems (HeDCS). The heterogeneous distributed systems facilitate scalability, an essential characteristic for big data processing. However, to implement the scalable model, it is essential to handle performance, efficiency, optimal resource utilization and several other key constraints. Scheduling algorithms play a vital role in achieving better performance and high throughput in heterogeneous distributed computing systems. Hence, selection of a proper scheduling algorithm, for the specific application, becomes a critical task. Selection of an appropriate scheduling algorithm in heterogeneous distributed computing systems require the consideration of various parameters like scheduling type, multi-core processors, and heterogeneity. The paper discusses broadly the hierarchical classification of scheduling algorithms implemented in heterogeneous distributed computing systems and presents a comparative study of these algorithms, thus providing an insight into the significance of various parameters that play a role in the selection of a scheduling algorithm.

[1]  Vincenzo Grassi,et al.  Distributed QoS-aware scheduling in storm , 2015, DEBS.

[2]  Hamid Arabnejad,et al.  List Scheduling Algorithm for Heterogeneous Systems by an Optimistic Cost Table , 2014, IEEE Transactions on Parallel and Distributed Systems.

[3]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[4]  Rizos Sakellariou,et al.  Stochastic DAG scheduling using a Monte Carlo approach , 2013, J. Parallel Distributed Comput..

[5]  Hui Liu,et al.  HSIP: A Novel Task Scheduling Algorithm for Heterogeneous Computing , 2016, Sci. Program..

[6]  P. P. Chakrabarti,et al.  Online Scheduling of Dynamic Task Graphs with Communication and Contention for Multiprocessors , 2012, IEEE Transactions on Parallel and Distributed Systems.

[7]  Fatma A. Omara,et al.  Dynamic task scheduling algorithm with load balancing for heterogeneous computing system , 2012 .

[8]  Kenli Li,et al.  Scheduling Precedence Constrained Stochastic Tasks on Heterogeneous Cluster Systems , 2015, IEEE Transactions on Computers.

[9]  Thomas L. Casavant,et al.  A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems , 1988, IEEE Trans. Software Eng..

[10]  Y.-K. Kwok,et al.  Static scheduling algorithms for allocating directed task graphs to multiprocessors , 1999, CSUR.

[11]  Ehsan Ullah Munir,et al.  SDBATS: A Novel Algorithm for Task Scheduling in Heterogeneous Computing Systems , 2013, 2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum.

[12]  Kenli Li,et al.  A self-adaptive scheduling algorithm for reduce start time , 2015, Future Gener. Comput. Syst..

[13]  Jorge G. Barbosa,et al.  Dynamic scheduling of a batch of parallel task jobs on heterogeneous clusters , 2011, Parallel Comput..

[14]  Jie Liu,et al.  Scheduling Functionally Heterogeneous Systems with Utilization Balancing , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[15]  Chee Sun Liew,et al.  A hybrid genetic algorithm for optimization of scheduling workflow applications in heterogeneous computing systems , 2016, J. Parallel Distributed Comput..

[16]  Hidenori Nakazato,et al.  Clustering-Based Task Scheduling in a Large Number of Heterogeneous Processors , 2016, IEEE Transactions on Parallel and Distributed Systems.

[17]  Ehsan Ullah Munir,et al.  PEGA: A Performance Effective Genetic Algorithm for Task Scheduling in Heterogeneous Systems , 2012, 2012 IEEE 14th International Conference on High Performance Computing and Communication & 2012 IEEE 9th International Conference on Embedded Software and Systems.

[18]  Hesham H. Ali,et al.  Task scheduling in parallel and distributed systems , 1994, Prentice Hall series in innovative technology.

[19]  Pierre Jouvelot,et al.  Parallelizing with BDSC, a resource-constrained scheduling algorithm for shared and distributed memory systems , 2015, Parallel Comput..