A Self-Managing Wide-Area Data Streaming Service using Model-based Online Control

Efficient and robust data streaming services are a critical requirement of emerging Grid applications, which are based on seamless interactions and coupling between geographically distributed application components. Furthermore the dynamism of Grid environments and applications requires that these services be able to continually manage and optimize their operation based on system state and application requirements. This paper presents a design and implementation of such a self-managing data-streaming service based on online control strategies. A Grid-based fusion workflow scenario is used to evaluate the service and demonstrate its feasibility and performance.

[1]  Tariq Samad.  Control of Communication Networks , 2001 .

[2]  Scott Klasky,et al.  An autonomic service architecture for self-managing grid applications , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[3]  Chenyang Lu,et al.  Proceedings of the Fast 2002 Conference on File and Storage Technologies Aqueduct: Online Data Migration with Performance Guarantees , 2022 .

[4]  Sherif Abdelwahed,et al.  Online safety control of a class of hybrid systems , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[5]  Jason Lee,et al.  Enabling network-aware applications , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[6]  Saverio Mascolo.  Classical control theory for congestion avoidance in high-speed Internet , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[7]  Yixin Diao,et al.  Feedback Control of Computing Systems , 2004 .

[8]  K. Shin,et al.  Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach , 2002, IEEE Trans. Parallel Distributed Syst..

[9]  Micah Beck,et al.  The Logistical Computing Stack - A Design For Wide-Area, Scalable, Uninterruptible Computing , 2002 .

[10]  Manish Agarwal,et al.  Enabling autonomic compositions in grid environments , 2003, Proceedings. First Latin American Web Congress.

[11]  Nagarajan Kandasamy,et al.  Enabling Self-Managing Applications using Model-based Online Control Strategies , 2006, 2006 IEEE International Conference on Autonomic Computing.

[12]  Nagarajan Kandasamy,et al.  A control-based framework for self-managing distributed computing systems , 2004, WOSS '04.

[13]  Sang Hyuk Son,et al.  Feedback Control Real-Time Scheduling: Framework, Modeling, and Algorithms* , 2001, Real-Time Systems.

[14]  Kevin Skadron,et al.  Control-theoretic dynamic frequency and voltage scaling for multimedia workloads , 2002, CASES '02.

[15]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[16]  Wu-chun Feng,et al.  Optimizing GridFTP through dynamic right-sizing , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[17]  Scott Klasky,et al.  High performance threaded data streaming for large scale simulations , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[18]  Arie Shoshani,et al.  Data management on the fusion computational pipeline , 2005 .

[19]  Karl-Erik Årzén,et al.  Feedback–Feedforward Scheduling of Control Tasks , 2002, Real-Time Systems.

[20]  Manish Parashar,et al.  Accord: a programming system for autonomic self-managing applications , 2005 .

[21]  Bradford Nichols,et al.  Pthreads programming , 1996 .

[22]  Kevin Skadron,et al.  Power-aware QoS management in Web servers , 2003, RTSS 2003. 24th IEEE Real-Time Systems Symposium, 2003.