Heterogeneous Computing: Goals, Methods, and Open Problems

This paper discusses the material to be presented by H. J. Siegel in his keynote talk. Distributed high-performance heterogeneous computing (HC) environments are composed of machines with varied computational capabilities interconnected by high-speed links. These environments are well suited to meet the computational demands of large, diverse groups of applications. One key factor in achieving the best performance possible from HC environments is the ability to assign effectively the applications to machines and schedule their execution. Several factors must be considered during this assignment. A conceptual model for the automatic decomposition of an application into tasks and assignment of tasks to machines is presented. An example of a static matching and scheduling approach for an HC environment is summarized. Some examples of current HC technology and open research problems are discussed.

[1]  Robert Kyle Armstrong,et al.  Investigation of effect of different run-time distributions on SmartNet performance , 1997 .

[2]  Edward G. Coffman,et al.  Computer and job-shop scheduling theory , 1976 .

[3]  Ishfaq Ahmad,et al.  Optimal task assignment in heterogeneous distributed computing systems , 1998, IEEE Concurr..

[4]  John Shalf,et al.  Galaxies Collide On the I-Way: an Example of Heterogeneous Wide-Area Collaborative Supercomputing , 1996, Int. J. High Perform. Comput. Appl..

[5]  Bin Yao,et al.  A taxonomy for describing matching and scheduling heuristics for mixed-machine heterogeneous computing systems , 1998, Proceedings Seventeenth IEEE Symposium on Reliable Distributed Systems (Cat. No.98CB36281).

[6]  R. F. Freund,et al.  Scheduling resources in multi-user, heterogeneous, computing environments with SmartNet , 1998, Proceedings Seventh Heterogeneous Computing Workshop (HCW'98).

[7]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[8]  Howard Jay Siegel,et al.  Representing Task and Machine Heterogeneities for Heterogeneous Computing Systems , 2000 .

[9]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[10]  David Fernández-Baca,et al.  Allocating Modules to Processors in a Distributed System , 1989, IEEE Trans. Software Eng..

[11]  John K. Antonio,et al.  Software support for heterogeneous computing , 1996, CSUR.

[12]  Howard Jay Siegel,et al.  Heterogeneous distributed computing: off-line mapping heuristics for independent tasks and for tasks with dependencies, priorities, deadlines, and multiple versions , 2001 .

[13]  Jr. Allen B. Tucker,et al.  The Computer Science and Engineering Handbook , 1997 .

[14]  A.V. Malevsky,et al.  A Case Study in Metacomputing: Distributed Simulations of Mixing in Turbulent Convection , 1993, Proceedings. Workshop on Heterogeneous Processing,.

[15]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..

[16]  Viktor K. Prasanna,et al.  Collective value QoS: a performance measure framework for distributed heterogeneous networks , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[17]  Enrico Gobbetti,et al.  Encyclopedia of Electrical and Electronics Engineering , 1999 .

[18]  Viktor K. Prasanna,et al.  Heterogeneous computing: challenges and opportunities , 1993, Computer.

[19]  Hong Zhang,et al.  Segmented min-min: a static mapping algorithm for meta-tasks on heterogeneous computing systems , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[20]  Howard Jay Siegel,et al.  Heterogeneous Distributed Computing , 1999 .

[21]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[22]  Henry G. Dietz,et al.  Would You Run it Here or There? AHS: Automatic Heterogeneous Supercomputing , 1993, 1993 International Conference on Parallel Processing - ICPP'93.

[23]  Lonnie R. Welch,et al.  Heterogeneous resource management for dynamic real-time systems , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[24]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[25]  Arif Ghafoor,et al.  A distributed heterogeneous supercomputing management system , 1993, Computer.

[26]  A. A. Maciejewski,et al.  Heterogeneous Computing , 2002 .

[27]  R. F. Freund,et al.  Guest Editor's Introduction: Heterogeneous Processing , 1993 .

[28]  Michael W. Godfrey,et al.  An overview of MSHN: the Management System for Heterogeneous Networks , 1999, Proceedings. Eighth Heterogeneous Computing Workshop (HCW'99).

[29]  Ioana Banicescu,et al.  Performance of scheduling scientific applications with adaptive weighted factoring , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[30]  Oscar H. Ibarra,et al.  Heuristic Algorithms for Scheduling Independent Tasks on Nonidentical Processors , 1977, JACM.