ACDS: Adapting computational data streams for high performance

Data-intensive, interactive applications are an important class of metacomputing (Grid) applications. They are characterized by large, time-varying data flows between data providers and consumers. The topic of this paper is the runtime adaptation of data streams, in response to changes in resource availability and/or in end user requirements, with the goal of continually providing to consumers data at the levels of quality they require. Our approach is one that associates computational objects with data streams. Runtime adaptation is achieved by adjusting objects' actions on streams, by splitting and merging objects, and by migrating them (and the streams on which they operate) across machines and network links. Adaptive streams also react to changes in resource availability detected by online monitoring.

[1]  Karsten Schwan,et al.  ILI: an adaptive infrastructure for dynamic interactive distributed applications , 1998, Proceedings. Fourth International Conference on Configurable Distributed Systems (Cat. No.98EX159).

[2]  Karsten Schwan,et al.  Dynamic adaptation of real-time software , 1991, TOCS.

[3]  Andrew S. Grimshaw,et al.  Legion-a view from 50,000 feet , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[4]  Srinivasan Parthasarathy,et al.  Customized Dynamic Load Balancing for a Network of Workstations , 1997, J. Parallel Distributed Comput..

[5]  R. Diekman,et al.  Load balancing strategies for distributed memory machines , 2000 .

[6]  Miron Livny,et al.  Checkpoint and Migration of UNIX Processes in the Condor Distributed Processing System , 1997 .

[7]  Karsten Schwan,et al.  An object-based infrastructure for program monitoring and steering , 1998, SPDT '98.

[8]  Karsten Schwan,et al.  Steering data streams in distributed computational laboratories , 1999, Proceedings. The Eighth International Symposium on High Performance Distributed Computing (Cat. No.99TH8469).

[9]  Arndt Bode,et al.  OMIS - on-line monitoring interface specification , 1996 .

[10]  Karsten Schwan,et al.  A parallel spectral model for atmospheric transport processes , 1996, Concurr. Pract. Exp..

[11]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[12]  Greg Eisenhauer.  The ECho Event Delivery System , 1999 .