On scheduling collaborative computations on the Internet, I: mesh-DAGs and their close relatives

Advancing technology has rendered the Internet a viable medium for collaborative computing, via mechanisms such as Web-based computing and Grid computing. We present a "pebble game" that abstracts the process of scheduling a computation-DAG (directed acyclic graph) for computing over the Internet, including a novel formal criterion for comparing the qualities of competing schedules. Within this formal setting, we identify a strategy for scheduling the task-nodes of a computation-DAG whose dependencies have the structure of a mesh of any finite dimensionality (a mesh-DAG), that is optimal to within a small constant factor (to within a low-order additive term for 2- and 3-dimensional mesh-DAG). We show that this strategy remains nearly optimal for a generalization of 2-dimensional mesh-DAG whose structures are determined by abelian monoids (a monoid-based version of Cayley graphs).

[1]  H. Casanova,et al.  ACM SIGACT news distributed computing column 8 , 2002, SIGA.

[2]  Hanns Ruder,et al.  XPulsar@home - schools help scientists , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[3]  Arnold L. Rosenberg Accountable Web-computing , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[4]  Arnold L. Rosenberg,et al.  Group Action Graphs and Parallel Architectures , 1990, SIAM J. Comput..

[5]  Arnold L. Rosenberg,et al.  Bandwidth and pebbling , 1983, Computing.

[6]  Stephen A. Cook,et al.  An observation on time-storage trade off , 1973, J. Comput. Syst. Sci..

[7]  David P. Anderson,et al.  SETI@home-massively distributed computing for SETI , 2001, Comput. Sci. Eng..

[8]  Stephen A. Cook,et al.  An Observation on Time-Storage Trade Off , 1974, J. Comput. Syst. Sci..

[9]  Carl Hewitt,et al.  Comparative Schematology , 1970 .

[10]  Tzong-Jer Yang,et al.  A comparison of clustering heuristics for scheduling dags on multiprocessors , 1990 .

[11]  H. T. Kung,et al.  I/O complexity: The red-blue pebble game , 1981, STOC '81.

[12]  Keith Marzullo,et al.  The computational Co-op: Gathering clusters into a metacomputer , 1999, Proceedings 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing. IPPS/SPDP 1999.

[13]  Renato J. O. Figueiredo,et al.  Fine-grain access control for securing shared resources in computational grids , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[14]  Arnold L. Rosenberg Addressable Data Graphs , 1972, JACM.

[15]  Arnold L. Rosenberg,et al.  Data Graphs and Addressing Schemes , 1971, J. Comput. Syst. Sci..

[16]  Vassilios V. Dimakopoulos,et al.  Optimal Total Exchange in Cayley Graphs , 2001, IEEE Trans. Parallel Distributed Syst..

[17]  Tao Yang,et al.  A Comparison of Clustering Heuristics for Scheduling Directed Acycle Graphs on Multiprocessors , 1992, J. Parallel Distributed Comput..

[18]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.