End-to-End Congestion Control for Content-Based Networks

Publish/subscribe or "push" communication has been proposed as a new network service. In particular, in a content-based network, messages sent by publishers are delivered to subscribers based on the message content and on subscribers' long-term interests (subscriptions). In most systems that implement this form of communication, messages are treated as datagrams transmitted without end-to-end or in-network acknowledgments or without any form of flow control. In such systems, publishers do not avoid or even detect congestion, and brokers/routers respond to congestion by simply dropping overflowing messages. These systems are therefore unable to provide fair resource allocation and to properly handle traffic anomalies, and therefore are not suitable for large-scale deployments. With this motivation, we propose an end-to-end congestion control for content-based networks. In particular, we propose a practical and effective congestion-control protocol that is also content-aware, meaning that it modulates specific content-based traffic flows along a congested path. Inspired by an existing rate-control scheme for IP multicast, this protocol uses an equation-based flow-control algorithm that reacts to congestion in a manner similar to and compatible with TCP. We demonstrate experimentally that the protocol improves fairness among concurrent data flows and also reduces message loss significantly.

[1]  Pekka Nikander,et al.  LIPSIN: line speed publish/subscribe inter-networking , 2009, SIGCOMM '09.

[2]  Mark Handley,et al.  Equation-based congestion control for unicast applications , 2000, SIGCOMM.

[3]  Donald F. Towsley,et al.  The loss path multiplicity problem in multicast congestion control , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[4]  Michael Mitzenmacher,et al.  FLID-DL: congestion control for layered multicast , 2000, COMM '00.

[5]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, TOCS.

[6]  Fernando Pedone,et al.  End-to-end reliability for best-effort content-based publish/subscribe networks , 2011, DEBS '11.

[7]  Jean-Yves Le Boudec,et al.  On the long-run behavior of equation-based rate control , 2002, IEEE/ACM Transactions on Networking.

[8]  Hans-Arno Jacobsen,et al.  The PADRES Distributed Publish/Subscribe System , 2005, FIW.

[9]  Giovanni Toffetti Carughi,et al.  Practical High-Throughput Content-Based Routing Using Unicast State and Probabilistic Encodings , 2009 .

[10]  Saurabh Bagchi,et al.  Exactly-once delivery in a content-based publish-subscribe system , 2002, Proceedings International Conference on Dependable Systems and Networks.

[11]  Alex C. Snoeren,et al.  Mesh-based content routing using XML , 2001, SOSP.

[12]  Reza Sherafat Kazemzadeh,et al.  Reliable and Highly Available Distributed Publish/Subscribe Service , 2009, 2009 28th IEEE International Symposium on Reliable Distributed Systems.

[13]  Jörg Widmer,et al.  Extending equation-based congestion control to multicast applications , 2001, SIGCOMM '01.

[14]  Luigi Rizzo,et al.  pgmcc: a TCP-friendly single-rate multicast congestion control scheme , 2000, SIGCOMM.

[15]  Peter R. Pietzuch,et al.  Hermes: a distributed event-based middleware architecture , 2002, Proceedings 22nd International Conference on Distributed Computing Systems Workshops.

[16]  Krishan K. Sabnani,et al.  Fundamental observations on multicast congestion control in the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[17]  Peter R. Pietzuch,et al.  Congestion Control in a Reliable Scalable Message-Oriented Middleware , 2003, Middleware.

[18]  Mark Handley,et al.  Equation-based congestion control for unicast applications , 2000, SIGCOMM 2000.

[19]  Deborah Estrin,et al.  Recommendations on Queue Management and Congestion Avoidance in the Internet , 1998, RFC.

[20]  Deepak Bansal,et al.  Dynamic behavior of slowly-responsive congestion control algorithms , 2001, SIGCOMM.