High Performance Publish/Subscribe Middleware in Software-Defined Networks

With the increasing popularity of software-defined networking (SDN), ternary content-addressable memory of switches can be directly accessed by a publish/subscribe middleware to perform filtering operations at low latency. In this way, three important requirements for a publish/subscribe middleware can be fulfilled, namely, bandwidth efficiency, line-rate performance, and low latency in forwarding messages between producers and consumers. Nevertheless, it is challenging to sustain line-rate performance in the presence of dynamically changing interests of producers and consumers. In this paper, we realize a scalable, SDN-based publish/subscribe middleware, called PLEROMA, that performs efficient forwarding at line-rate. Moreover, PLEROMA offers methods to efficiently reconfigure a deployed topology in the presence of dynamic subscriptions and advertisements. We evaluate the performance of both the data plane and the control plane of PLEROMA to support our claim. Furthermore, we evaluate and benchmark the performances of SDN-compliant hardware and software switches in the context of our middleware.

[1]  Jim Esch,et al.  Software-Defined Networking: A Comprehensive Survey , 2015, Proc. IEEE.

[2]  Kurt Rothermel,et al.  Hybrid Content-Based Routing Using Network and Application Layer Filtering , 2016, 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS).

[3]  Christof Fetzer,et al.  StreamHub: a massively parallel architecture for high-performance content-based publish/subscribe , 2013, DEBS '13.

[4]  David Walker,et al.  Abstractions for network update , 2012, SIGCOMM '12.

[5]  Ronald L. Graham,et al.  Bounds on Multiprocessing Timing Anomalies , 1969, SIAM Journal of Applied Mathematics.

[6]  Kurt Rothermel,et al.  Efficient content-based routing with network topology inference , 2013, DEBS.

[7]  Nick McKeown,et al.  A network in a laptop: rapid prototyping for software-defined networks , 2010, Hotnets-IX.

[8]  Bo Yan,et al.  CAB: a reactive wildcard rule caching system for software-defined networks , 2014, HotSDN.

[9]  Yoav Tock,et al.  SpiderCast: a scalable interest-aware overlay for topic-based pub/sub communication , 2007, DEBS '07.

[10]  Hans-Arno Jacobsen,et al.  Green Resource Allocation Algorithms for Publish/Subscribe Systems , 2011, 2011 31st International Conference on Distributed Computing Systems.

[11]  Anja Feldmann,et al.  Logically centralized?: state distribution trade-offs in software defined networks , 2012, HotSDN '12.

[12]  Fang Hao,et al.  Towards an elastic distributed SDN controller , 2013, HotSDN '13.

[13]  H. Jonathan Chao,et al.  JumpFlow: Reducing flow table usage in software-defined networks , 2015, Comput. Networks.

[14]  David Walker,et al.  Infinite CacheFlow in software-defined networks , 2014, HotSDN.

[15]  Kurt Rothermel,et al.  Bandwidth-efficient content-based routing on software-defined networks , 2016, DEBS.

[16]  Kaiwen Zhang,et al.  SDN-like: The Next Generation of Pub/Sub , 2013, ArXiv.

[17]  Nalini Venkatasubramanian,et al.  DYNATOPS: a dynamic topic-based publish/subscribe architecture , 2013, DEBS '13.

[18]  Alex C. Snoeren,et al.  High-fidelity switch models for software-defined network emulation , 2013, HotSDN '13.

[19]  Liang Yue Subscription Partitioning and Routing in Content-based Publish / Subscribe Systems , 2007 .

[20]  Helen J. Wang,et al.  Subscription Partitioning and Routing in Content-based Publish/Subscribe Systems , 2005 .

[21]  Yashar Ganjali,et al.  HyperFlow: A Distributed Control Plane for OpenFlow , 2010, INM/WREN.

[22]  Reza Sherafat Kazemzadeh,et al.  The PADRES Publish/Subscribe System , 2010, Principles and Applications of Distributed Event-Based Systems.

[23]  H. Jonathan Chao,et al.  Improving the performance of load balancing in software-defined networks through load variance-based synchronization , 2014, Comput. Networks.

[24]  Helge Parzyjegla,et al.  Self-organizing broker topologies for publish/subscribe systems , 2007, SAC '07.

[25]  Ming Li,et al.  A Scalable and Elastic Publish/Subscribe Service , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[26]  Brighten Godfrey,et al.  Enforcing Customizable Consistency Properties in Software-Defined Networks , 2015, NSDI.

[27]  Frank Dürr,et al.  The power of software-defined networking: line-rate content-based routing using OpenFlow , 2012, MW4NG '12.

[28]  George Vaněček BRep-Index: a multidimensional space partitioning tree , 1990 .

[29]  Thomas S. Heinze,et al.  Elastic Scaling of a High-Throughput Content-Based Publish/Subscribe Engine , 2014, 2014 IEEE 34th International Conference on Distributed Computing Systems.

[30]  Martín Casado,et al.  Onix: A Distributed Control Platform for Large-scale Production Networks , 2010, OSDI.

[31]  Kurt Rothermel,et al.  Distributed control plane for software-defined networks: a case study using event-based middleware , 2015, DEBS.

[32]  Amy L. Murphy,et al.  Minimizing the reconfiguration overhead in content-based publish-subscribe , 2004, SAC '04.

[33]  Petr Kuznetsov,et al.  A distributed and robust SDN control plane for transactional network updates , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[34]  Gunjan Tank,et al.  Software-Defined Networking-The New Norm for Networks , 2012 .

[35]  Hans-Arno Jacobsen,et al.  Infrastructure-Free Content-Based Publish/Subscribe , 2014, IEEE/ACM Transactions on Networking.

[36]  Nisheeth Shrivastava,et al.  Scalable Content-Based Routing in Pub/Sub Systems , 2009, IEEE INFOCOM 2009.

[37]  Kurt Rothermel,et al.  PLEROMA: a SDN-based high performance publish/subscribe middleware , 2014, Middleware.

[38]  Patrick Th. Eugster,et al.  Parametric Subscriptions for Content-Based Publish/Subscribe Networks , 2010, Middleware.

[39]  Kurt Rothermel,et al.  Moving range queries in distributed complex event processing , 2012, DEBS.

[40]  Pekka Nikander,et al.  LIPSIN: line speed publish/subscribe inter-networking , 2009, SIGCOMM '09.