Publish-subscribe for high-performance computing

High-performance computing could significantly benefit from publish-subscribe communication, but current systems don't deliver the kind of performance required by applications in that domain. In response, the authors developed Echo, a high-performance event-delivery middleware designed to scale to the data rates typically found in grid environments. This article provides an overview of Echo, the infrastructure on which it's built, and the techniques used to implement it.

[1]  Karsten Schwan,et al.  Efficient Wire Formats for High Performance Computing , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[2]  Guruduth Banavar,et al.  Gryphon: An Information Flow Based Approach to Message Brokering , 1998, ArXiv.

[3]  Karsten Schwan,et al.  Open Metadata Formats: Efficient XML-Based Communication for High Performance Computing , 2004, Cluster Computing.

[4]  Greg Eisenhauer.  Dynamic Code Generation with the E-Code Language , 2005 .

[5]  Patrick Th. Eugster,et al.  Distributed Asynchronous Collections: Abstractions for Publish/Subscribe Interaction , 2000, ECOOP.

[6]  Karsten Schwan,et al.  Lightweight Morphing Support for Evolving Middleware Data Exchanges in Distributed Applications , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[7]  David S. Rosenblum,et al.  Challenges for Distributed Event Services: Scalability vs. Expressiveness , 1999 .

[8]  Karsten Schwan,et al.  The active streams approach to adaptive distributed applications and services , 2001 .

[9]  Greg Eisenhauer,et al.  Fast heterogeneous binary data interchange , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[10]  Anne-Marie Kermarrec,et al.  The many faces of publish/subscribe , 2003, CSUR.

[11]  Scott Pakin,et al.  Efficient layering for high speed communication: Fast Messages 2.x , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[12]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, Foundations of Intrusion Tolerant Systems, 2003 [Organically Assured and Survivable Information Systems].

[13]  Emin Gün Sirer,et al.  Corona: A High Performance Publish-Subscribe System for the World Wide Web , 2006, NSDI.

[14]  Fabián E. Bustamante,et al.  Resilient peer-to-peer multicast without the cost , 2005, IS&T/SPIE Electronic Imaging.

[15]  Karsten Schwan,et al.  Event services for high performance computing , 2000, Proceedings the Ninth International Symposium on High-Performance Distributed Computing.

[16]  Karsten Schwan,et al.  Event Services in High Performance Systems , 2001, Cluster Computing.

[17]  Greg Eisenhauer.  The ECho Event Delivery System , 1999 .

[18]  David S. Rosenblum,et al.  Challenges for Distributed Event Services: Scalability vs , 1999 .

[19]  Karsten Schwan,et al.  IQ-RUDP: coordinating application adaptation with network transport , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.