Modeling the Cost of Redistribution in Scheduling

Distributed heterogeneous resources coordinated by fast networks provide a new platform for resource-intensive parallel applications. However, careful scheduling of such applications is required to achieve their performance potential. Since resource load varies dynamically, the scheduling mechanism may consider redistribution of application tasks to improve performance. In this paper, we focus on the development of dynamically parametrizable models to determine the cost (in terms of execution delay) of redistribution. When such models are combined with predictive models for application execution, a scheduler can determine whether redistribution is pro table at a given point in time.

[1]  R. F. Freund,et al.  SmartNet: a scheduling framework for heterogeneous computing , 1996, Proceedings Second International Symposium on Parallel Architectures, Algorithms, and Networks (I-SPAN'96).

[2]  Yacine Atif,et al.  Dynamic scheduling techniques for heterogeneous computing systems , 1995, Concurr. Pract. Exp..

[3]  Robert D. Blumofe,et al.  Scheduling large-scale parallel computations on networks of workstations , 1994, Proceedings of 3rd IEEE International Symposium on High Performance Distributed Computing.

[4]  Michael J. Quinn,et al.  A partitioning advisory system for networked data-parallel processing , 1995, Concurr. Pract. Exp..

[5]  Alexander Reinefeld,et al.  MARS - A framework for minimizing the job execution time in a metacomputing environment , 1996, Future Gener. Comput. Syst..

[6]  Miron Livny,et al.  Parallel Processing on Dynamic Resources with CARMI , 1995, JSSPP.

[7]  Volker Strumpen,et al.  Efficient Parallel Computing in Distributed Workstation Environments , 1993, Parallel Comput..

[8]  Andrew S. Grimshaw,et al.  Network partitioning of data parallel computations , 1994, Proceedings of 3rd IEEE International Symposium on High Performance Distributed Computing.

[9]  Erik Seligman,et al.  Dome: Parallel Programming in a Heteroge-neous Multi-User Environment , 1995 .

[10]  Srinivasan Parthasarathy,et al.  Customized dynamic load balancing for a network of workstations , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[11]  Francine Berman,et al.  Application-Level Scheduling on Distributed Heterogeneous Networks , 1996, Proceedings of the 1996 ACM/IEEE Conference on Supercomputing.

[12]  Francine Berman,et al.  Scheduling from the perspective of the application , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.