Using Machine Learning to Provide Reliable Differentiated Services for IoT in SDN-Like Publish/Subscribe Middleware †

At present, most publish/subscribe middlewares suppose that there are equal Quality of Service (QoS) requirements for all users. However, in many real-world Internet of Things (IoT) service scenarios, different users may have different delay requirements. How to provide reliable differentiated services has become an urgent problem. The rise of Software-Defined Networking (SDN) provides endless possibilities to improve the QoS of publish/subscribe middlewares due to its greater programmability. We can encode event topics and priorities into flow entries of SDN switches directly to meet customized requirements. In this paper, we first propose an SDN-like publish/subscribe middleware architecture and describe how to use this architecture and priority queues supported by OpenFlow switches to realize differentiated services. Then we present a machine learning method using the eXtreme Gradient Boosting (XGBoost) model to solve the difficult issue of getting the queuing delay of switches accurately. Finally, we propose a reliable differentiated services guarantee mechanism according to the queuing delay and the programmability of SDN to improve QoS, namely, a two-layer queue management mechanism. Experimental evaluations show that the delay predicted by the XGBoost method is closer to the real value; our mechanism can save end-to-end delay, reduce packet loss rate, and allocate bandwidth more reasonably.

[1]  Aniruddha S. Gokhale,et al.  Publish/subscribe-enabled software defined networking for efficient and scalable IoT communications , 2015, IEEE Communications Magazine.

[2]  Richard Blum Network Performance Open Source Toolkit: Using Netperf, tcptrace, NISTnet, and SSFNet , 2003 .

[3]  Douglas C. Schmidt,et al.  Using machine learning to maintain pub/sub system QoS in dynamic environments , 2009, ARM '09.

[4]  Kurt Rothermel,et al.  Meeting subscriber‐defined QoS constraints in publish/subscribe systems , 2011, Concurr. Comput. Pract. Exp..

[5]  Karsten Schwan,et al.  Flexpath: Type-Based Publish/Subscribe System for Large-Scale Science Analytics , 2014, 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[6]  Anne H. H. Ngu,et al.  QoS-aware middleware for Web services composition , 2004, IEEE Transactions on Software Engineering.

[7]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[8]  Chuan Chen,et al.  An Embedding Based Factorization Machine Approach for Web Service QoS Prediction , 2017, ICSOC.

[9]  Vlado Handziski,et al.  Meeting IoT platform requirements with open pub/sub solutions , 2016, Annals of Telecommunications.

[10]  Yishay Mansour,et al.  Competitive queue policies for differentiated services , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[11]  Antonio Pescapè,et al.  Available bandwidth measurement in software defined networks , 2016, SAC.

[12]  Thierry Turletti,et al.  A Survey of Software-Defined Networking: Past, Present, and Future of Programmable Networks , 2014, IEEE Communications Surveys & Tutorials.

[13]  Antonio Pescapè,et al.  Do you trust your software-based traffic generator? , 2010, IEEE Communications Magazine.

[14]  B. Melamed,et al.  Traffic modeling for telecommunications networks , 1994, IEEE Communications Magazine.

[15]  Patrick Th. Eugster,et al.  Type-based publish/subscribe: Concepts and experiences , 2007, TOPL.

[16]  Kaiwen Zhang,et al.  SDN-like: The Next Generation of Pub/Sub , 2013, ArXiv.

[17]  Yonggang Wen,et al.  “ A Survey of Software Defined Networking , 2020 .

[18]  Nick Feamster,et al.  Improving network management with software defined networking , 2013, IEEE Commun. Mag..

[19]  Nalini Venkatasubramanian,et al.  DYNATOPS: a dynamic topic-based publish/subscribe architecture , 2013, DEBS '13.

[20]  Kurt Rothermel,et al.  PLEROMA: a SDN-based high performance publish/subscribe middleware , 2014, Middleware.

[21]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[22]  Basem Almadani QoS-aware real-time pub/sub middleware for drilling data management in petroleum industry , 2016, J. Ambient Intell. Humaniz. Comput..

[23]  Aniruddha S. Gokhale,et al.  Supporting SIP-based end-to-end Data Distribution Service QoS in WANs , 2014, J. Syst. Softw..

[24]  Fernando M. V. Ramos,et al.  Software-Defined Networking: A Comprehensive Survey , 2014, Proceedings of the IEEE.

[25]  Yu Zhang,et al.  Pub/Sub on stream: a multi-core based message broker with QoS support , 2012, DEBS.

[26]  B. Chandrasekaran Survey of Network Traffic Models , 2006 .

[27]  Anne-Marie Kermarrec,et al.  The many faces of publish/subscribe , 2003, CSUR.

[28]  Voratas Kachitvichyanukul,et al.  Poisson Random Variate Generation. , 1981 .

[29]  Hans-Arno Jacobsen,et al.  Algorithms Based on Divide and Conquer for Topic-Based Publish/Subscribe Overlay Design , 2016, IEEE/ACM Transactions on Networking.

[30]  Pekka Nikander,et al.  LIPSIN: line speed publish/subscribe inter-networking , 2009, SIGCOMM '09.

[31]  Ludger Fiege,et al.  On Quality-of-Service and Publish-Subscribe , 2006, 26th IEEE International Conference on Distributed Computing Systems Workshops (ICDCSW'06).

[32]  Abdul Bais,et al.  Comparative analysis of software defined networking (SDN) controllers — In terms of traffic handling capabilities , 2016, 2016 19th International Multi-Topic Conference (INMIC).

[33]  Patrick Th. Eugster,et al.  Parametric Content-Based Publish/Subscribe , 2013, TOCS.

[34]  Aniruddha S. Gokhale,et al.  Data-centric publish/subscribe routing middleware for realizing proactive overlay software-defined networking , 2016, DEBS.

[35]  Douglas C. Schmidt,et al.  Maintaining QoS for publish/subscribe middleware in dynamic environments , 2009, DEBS '09.

[36]  Klara Nahrstedt,et al.  Probabilistic QoS modeling for reliability/timeliness prediction in distributed content-based publish/subscribe systems over best-effort networks , 2010, ICAC '10.

[37]  Carl H. Hauser,et al.  Smart Generation and Transmission With Coherent, Real-Time Data , 2011, Proceedings of the IEEE.

[38]  Siobhán Clarke,et al.  Middleware for Internet of Things: A Survey , 2016, IEEE Internet of Things Journal.

[39]  Hamid Farhadi,et al.  Software-Defined Networking: A survey , 2015, Comput. Networks.

[40]  Kurt Rothermel,et al.  Hybrid Content-Based Routing Using Network and Application Layer Filtering , 2016, 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS).

[41]  Antonio Pescapè,et al.  A tool for the generation of realistic network workload for emerging networking scenarios , 2012, Comput. Networks.

[42]  Aniruddha S. Gokhale,et al.  Supporting end-to-end quality of service properties in OMG data distribution service publish/subscribe middleware over wide area networks , 2013, J. Syst. Softw..

[43]  Zheng Wang,et al.  An Architecture for Differentiated Services , 1998, RFC.

[44]  QUTdN QeO,et al.  Random early detection gateways for congestion avoidance , 1993, TNET.

[45]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[46]  Yang Zhang,et al.  Using Machine Learning to Provide Differentiated Services in SDN-like Publish/Subscribe Systems for IoT , 2018, ICSOC.

[47]  Hui Lei,et al.  Monitoring the QoS for Web Services , 2007, ICSOC.

[48]  Kurt Rothermel,et al.  Dynamic Publish/Subscribe to Meet Subscriber-Defined Delay and Bandwidth Constraints , 2010, Euro-Par.

[49]  Frank Dürr,et al.  High Performance Publish/Subscribe Middleware in Software-Defined Networks , 2017, IEEE/ACM Transactions on Networking.

[50]  Yoav Tock,et al.  SpiderCast: a scalable interest-aware overlay for topic-based pub/sub communication , 2007, DEBS '07.

[51]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[52]  Hans-Arno Jacobsen,et al.  The PADRES Distributed Publish/Subscribe System , 2005, FIW.

[53]  Ailton Akira Shinoda,et al.  Using Mininet for emulation and prototyping Software-Defined Networks , 2014, 2014 IEEE Colombian Conference on Communications and Computing (COLCOM).

[54]  E. Barrett,et al.  Predicting the Available Bandwidth on Intra Cloud Network Links for Deadline Constrained Workflow Scheduling in Public Clouds , 2017, ICSOC.

[55]  Yang Zhang,et al.  Pursuing Differentiated Services in a SDN-Based IoT-Oriented Pub/Sub System , 2017, 2017 IEEE International Conference on Web Services (ICWS).

[56]  Frank Dürr,et al.  The power of software-defined networking: line-rate content-based routing using OpenFlow , 2012, MW4NG '12.

[57]  Deniz Gurkan,et al.  OpenFlow Configuration Protocol: Implementation for the of Management Plane , 2013, 2013 Second GENI Research and Educational Experiment Workshop.

[58]  Wei Liu,et al.  QoS-Aware Publish-Subscribe Service for Real-Time Data Acquisition , 2008, BIRTE.

[59]  Christof Fetzer,et al.  StreamHub: a massively parallel architecture for high-performance content-based publish/subscribe , 2013, DEBS '13.