Management of real‐time streaming data Grid services

We discuss our message‐based approach to managing real‐time data streams and building higher level services to produce and consume them. Our messaging system acts as a substrate that can be used to provide qualities of service to various streaming applications ranging from audio–video collaboration systems to sensor Grids. The messaging substrates are composed of distributed, hierarchically arranged message broker networks. Services such as filters are deployed along the edges of the network. We discuss the role of management systems for both broker networks and filter services: broker network topologies must be created and maintained, and distributed filters must be arranged in appropriate sequences. These managed broker networks may be applied to a wide range of problems. We discuss applications to audio–video collaboration in some detail and also describe applications to streaming Global Positioning System data streams. These provide specific application filters that can transform and republish message streams to the broker system. Copyright © 2006 John Wiley & Sons, Ltd.

[1]  Geoffrey C. Fox,et al.  Design and Implementation of a Collaboration Web-services System , 2004, Neural Parallel Sci. Comput..

[2]  Rajkumar Buyya,et al.  A Taxonomy of Workflow Management Systems for Grid Computing , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[3]  Geoffrey C. Fox,et al.  NaradaBrokering: A Distributed Middleware Framework and Architecture for Enabling Durable Peer-to-Peer Grids , 2003, Middleware.

[4]  Pu Liu,et al.  Toward characterizing the performance of SOAP toolkits , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[5]  Geoffrey C. Fox,et al.  Managing grid messaging middleware , 2006, 2006 IEEE Challenges of Large Applications in Distributed Environments.

[6]  Geoffrey C. Fox,et al.  Global multimedia collaboration system , 2004, Concurr. Pract. Exp..

[7]  Geoffrey C. Fox,et al.  Information Services for Dynamically Assembled Semantic Grids , 2005, 2005 First International Conference on Semantics, Knowledge and Grid.

[8]  Geoffrey Fox,et al.  Special Issue: Workflow in Grid Systems , 2006, Concurr. Comput. Pract. Exp..

[9]  Geoffrey C. Fox,et al.  On the creation & discovery of topics in distributed publish/subscribe systems , 2005, GRID.

[10]  Geoffrey C. Fox,et al.  Workflow in Grid Systems , 2004 .

[11]  Rajkumar Buyya,et al.  A taxonomy of scientific workflow systems for grid computing , 2005, SGMD.

[12]  Yan Yan,et al.  A Security Framework for Distributed Brokering Systems , 2003 .

[13]  Luis Felipe Cabrera.  Web Services Eventing (WS-Eventing) , 2004 .

[14]  E. Hirschorn,et al.  Open Geospatial Consortium , 2004 .

[15]  Geoffrey C. Fox,et al.  On the Discovery of Brokers in Distributed Messaging Infrastructures , 2005, 2005 IEEE International Conference on Cluster Computing.

[16]  Geoffrey C. Fox,et al.  Adapting H.323 terminals in a service-oriented collaboration system , 2005, IEEE Internet Computing.

[17]  Geoffrey C. Fox,et al.  Implementing a Prototype of the Security Framework for Distributed Brokering Systems , 2003, Security and Management.

[18]  S. Pallickara,et al.  Management of Data Streams for a Real Time Flood Simulation , 2004 .

[19]  Geoffrey C. Fox,et al.  An Architecture for Supporting Information in Dynamically Assembled Semantic Grids , 2005 .

[20]  Madhusudhan Govindaraju,et al.  Investigating the limits of SOAP performance for scientific computing , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[21]  Pu Liu,et al.  A Benchmark Suite for SOAP-based Communication in Grid Web Services , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[22]  Shrideep Pallickara,et al.  Building messaging substrates for Web and Grid applications , 2005, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[23]  Brian T. Murray,et al.  Web Services Base Notification 1.3 (WS-BaseNotification) , 2006 .

[24]  Geoffrey C. Fox,et al.  A scheme for reliable delivery of events in distributed middleware systems , 2004, International Conference on Autonomic Computing, 2004. Proceedings..

[25]  Geoffrey C. Fox,et al.  Implementing a NTP-based time service within a distributed middleware system , 2004, PPPJ.

[26]  Geoffrey C. Fox,et al.  Investigating the performance of audio/video service architecture I: single broker , 2005, Proceedings of the 2005 International Symposium on Collaborative Technologies and Systems, 2005..

[27]  Geoffrey C. Fox,et al.  Optimized communication using the SOAP infoset for mobile multimedia collaboration applications , 2005, Proceedings of the 2005 International Symposium on Collaborative Technologies and Systems, 2005..

[28]  Geoffrey C. Fox,et al.  Grids for the GiG and Real Time Simulations , 2005, DS-RT.

[29]  Geoffrey C. Fox,et al.  Message-based mvc architecture for distributed and desktop applications , 2005 .

[30]  Geoffrey C. Fox,et al.  On the matching of events in distributed brokering systems , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[31]  Geoffrey C. Fox,et al.  Scalable service oriented architecture for audio/video conferencing , 2005 .

[32]  Geoffrey C. Fox,et al.  A scripting based architecture for management of streams and services in real-time grid applications , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..