Unavailable Time Aware Scheduling of Hybrid Task on Heterogeneous Distributed System

The resource allocation for tasks in heterogeneous distributed system is a well known NP-hard problem. For the sake of making the makespan is minimized, it is hard to distribute the tasks to proper processors. The problem is even more complex and challenging when the processors have unavailable time and the tasks type are various. This paper investigates a resource allocation problem for hybrid tasks comprising both divisible and bag-of-tasks(BoT) in heterogeneous distributed system when the processors has unavailable time. First, the mathematical model, which minimizes the makespan of the hybrid tasks when the processors have unavailable time, is established. Second, we propose a scheduling algorithm referred to as bag-of-tasks allocate-pull and divisible task allocation (BoTAPDTA) algorithm for handling hybrid tasks on heterogeneous distributed systems. In addition, to solving the optimization model efficiently, a generic algorithm(GA) is proposed. For the sake of reducing the search space and solving the optimization model effectively, a two step scheduling algorithm(TSGA), which first allocate bag-of-tasks(BoT) using generic algorithm and then assign divisible task to processors like BoTAPDTA, is designed. Finally, numerical simulation experiments are conducted, and experimental results indicate the effectiveness of the proposed model and algorithm.

[1]  Xiao Qin,et al.  H2ACO: An Optimization Approach to Scheduling Tasks with Availability Constraint in Heterogeneous Systems , 2014 .

[2]  Thomas G. Robertazzi,et al.  Ten Reasons to Use Divisible Load Theory , 2003, Computer.

[3]  Bharadwaj Veeravalli,et al.  On the Influence of Start-Up Costs in Scheduling Divisible Loads on Bus Networks , 2000, IEEE Trans. Parallel Distributed Syst..

[4]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[5]  Yves Robert,et al.  Scheduling Concurrent Bag-of-Tasks Applications on Heterogeneous Platforms , 2010, IEEE Transactions on Computers.

[6]  Bharadwaj Veeravalli,et al.  Dynamic Scheduling of Hybrid Real-Time Tasks on Clusters , 2014, IEEE Transactions on Computers.

[7]  Yuping Wang,et al.  A new multi-objective bi-level programming model for energy and locality aware multi-job scheduling in cloud computing , 2014, Future Gener. Comput. Syst..

[8]  Thomas G. Robertazzi,et al.  Parallel Processor Configuration Design with Processing/Transmission Costs , 2000, IEEE Trans. Computers.

[9]  Mathematical Model and Computational Studies of Discrete Dislocation Dynamics , 2015 .

[10]  Bharadwaj Veeravalli,et al.  Requirement-Aware Scheduling of Bag-of-Tasks Applications on Grids with Dynamic Resilience , 2013, IEEE Transactions on Computers.

[11]  V. Mani,et al.  Divisible load scheduling in single-level tree networks: Optimal sequencing and arrangement in the nonblocking mode of communication , 2003 .

[12]  Bharadwaj Veeravalli,et al.  Performance Characterization on Handling Large-Scale Partitionable Workloads on Heterogeneous Networked Compute Platforms , 2017, IEEE Transactions on Parallel and Distributed Systems.

[13]  Jong Kim,et al.  On-line scheduling of scalable real-time tasks on multiprocessor systems , 2003, J. Parallel Distributed Comput..

[14]  Hoong Chuin Lau,et al.  Job Scheduling with Unfixed Availability Constraints , 2004 .

[15]  Xin-She Yang,et al.  A Discrete Firefly Algorithm for the Multi-Objective Hybrid Flowshop Scheduling Problems , 2014, IEEE Transactions on Evolutionary Computation.

[16]  Emmanouel A. Varvarigos,et al.  Fair Scheduling Algorithms in Grids , 2007, IEEE Transactions on Parallel and Distributed Systems.

[17]  Günter Schmidt,et al.  Scheduling with limited machine availability , 2000, Eur. J. Oper. Res..

[18]  Quan Shi,et al.  A more efficient attribute self-adaptive co-evolutionary reduction algorithm by combining quantum elitist frogs and cloud model operators , 2015, Inf. Sci..

[19]  T. C. Edwin Cheng,et al.  An approximation scheme for two-machine flowshop scheduling with setup times and an availability constraint , 2007, Comput. Oper. Res..

[20]  Behdin Vahedi-Nouri,et al.  Minimizing total flow time for the non-permutation flow shop scheduling problem with learning effects and availability constraints , 2013 .

[21]  Alexandru Iosup,et al.  The performance of bags-of-tasks in large-scale distributed systems , 2008, HPDC '08.

[22]  Athanasios V. Vasilakos,et al.  Availability-Aware Multimedia Scheduling in Heterogeneous Wireless Networks , 2011, IEEE Transactions on Vehicular Technology.

[23]  Zhiwei Xu,et al.  Incentive-Based Scheduling for Market-Like Computational Grids , 2008, IEEE Transactions on Parallel and Distributed Systems.

[24]  Alexander H. G. Rinnooy Kan,et al.  Single machine flow-time scheduling with a single breakdown , 1989, Acta Informatica.

[25]  Lu-Wen Liao,et al.  Scheduling machine-dependent jobs to minimize lateness on machines with identical speed under availability constraints , 2007, Comput. Oper. Res..

[26]  Larry Carter,et al.  Centralized versus Distributed Schedulers for Bag-of-Tasks Applications , 2008, IEEE Transactions on Parallel and Distributed Systems.

[27]  P. Raven,et al.  BUTTERFLIES AND PLANTS: A STUDY IN COEVOLUTION , 1964 .

[28]  Xinguang Peng,et al.  Security-aware data replica selection strategy for Bag-of-Tasks application in cloud computing , 2015, J. High Speed Networks.

[29]  Cherif Sadfi,et al.  Branch and bound and dynamic programming to minimize the total completion times on a single machine with availability constraints , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[30]  Yong Wang,et al.  An Availability-Aware Task Scheduling for Heterogeneous Systems Using Quantum-behaved Particle Swarm Optimization , 2010, ICSI.

[31]  Albert Y. Zomaya,et al.  Practical Scheduling of Bag-of-Tasks Applications on Grids with Dynamic Resilience , 2007, IEEE Transactions on Computers.

[32]  Keqin Li,et al.  Future Generation Computer Systems ( ) – Future Generation Computer Systems Multi-objective Scheduling of Many Tasks in Cloud Platforms , 2022 .

[33]  Unai Arronategui,et al.  Fair scheduling of bag-of-tasks applications on large-scale platforms , 2015, Future Gener. Comput. Syst..

[34]  Yuping Wang,et al.  New Model and Genetic Algorithm for Divisible Load Scheduling in Heterogeneous Distributed Systems , 2013, Int. J. Pattern Recognit. Artif. Intell..

[35]  Niraj K. Jha,et al.  Safety and Reliability Driven Task Allocation in Distributed Systems , 1999, IEEE Trans. Parallel Distributed Syst..

[36]  Chi Chung Ko,et al.  Design and analysis of load distribution strategies with start-up costs in scheduling divisible loads on distributed networks , 2000 .

[37]  Kenli Li,et al.  A QoS Scheduling Scheme with Availability Constraint in Distributed Systems , 2012, 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies.

[38]  Xiao Qin,et al.  An Availability-Aware Task Scheduling Strategy for Heterogeneous Systems , 2008, IEEE Transactions on Computers.

[39]  Cosimo Anglano,et al.  Scheduling algorithms for multiple Bag-of-Task applications on Desktop Grids: A knowledge-free approach , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[40]  Shang Mingsheng.  Optimal algorithm for scheduling large divisible workload on heterogeneous system , 2008 .

[41]  Nallig Leal,et al.  A Linear Programming Approach for 3 D Point Cloud Simplification , 2022 .

[42]  Wuning Tong,et al.  Fault-Tolerant Scheduling Algorithm with Re-allocation for Divisible Loads on Homogeneous Distributed System , 2018 .

[43]  Anthony A. Maciejewski,et al.  Makespan and Energy Robust Stochastic Static Resource Allocation of a Bag-of-Tasks to a Heterogeneous Computing System , 2015, IEEE Transactions on Parallel and Distributed Systems.

[44]  Fuh-Der Chou,et al.  PARTICLE SWARM OPTIMIZATION WITH COCKTAIL DECODING METHOD FOR HYBRID FLOW SHOP SCHEDULING PROBLEMS WITH MULTIPROCESSOR TASKS , 2013 .

[45]  Mohammad Shahid,et al.  Energy‐efficient scheduling algorithms for batch‐of‐tasks (BoT) applications on heterogeneous computing systems , 2016, Concurr. Comput. Pract. Exp..