Scalable and Locality-Aware Distributed Topic-Based Pub/Sub Messaging for IoT

Topic-based pub/sub (TBPS) messaging plays an important role in building event-driven Internet of Things (IoT) applications. In IoT applications, scalability and locality-awareness are important properties that help to achieve low-latency message delivery and efficient usage of network resources. However, none of the existing distributed TBPS methods can simultaneously achieve a sufficient level of both properties. This paper proposes a new TBPS overlay method called 'Skip Graph-based TBPS with Locality-Awareness' (STLA), which extends existing Skip Graph-based TBPS messaging by adding locality- awareness. STLA determines the order of the keys on a Skip Graph overlay network according to the network hierarchy structure using 'locality-aware topic keys' (LATK). Using 'split-forward broadcasting' (SFB) with LATK, the locality-awareness can be dramatically improved. Simulation results show that our method can achieve locality-awareness and reduce the average latency of message delivery for 100,000 subscribers by 76% compared with existing methods. In addition, we have conducted experiments on real distributed data centers using an STLA prototype system, and have confirmed the practicality and feasibility of the proposed method.

[1]  Steve Hodges,et al.  Prototyping Connected Devices for the Internet of Things , 2013, Computer.

[2]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[3]  James Aspnes,et al.  Skip graphs , 2003, SODA '03.

[4]  Anne-Marie Kermarrec,et al.  The many faces of publish/subscribe , 2003, CSUR.

[5]  Sateesh Addepalli,et al.  Fog computing and its role in the internet of things , 2012, MCC '12.

[6]  Bo Cheng,et al.  A Low-Delay, Lightweight Publish/Subscribe Architecture for Delay-Sensitive IOT Services , 2013, 2013 IEEE 20th International Conference on Web Services.

[7]  Michiharu Takemoto,et al.  SFB: a scalable method for handling range queries on Skip Graphs , 2015 .

[8]  Miguel Castro,et al.  Scribe: a large-scale and decentralized application-level multicast infrastructure , 2002, IEEE J. Sel. Areas Commun..

[9]  Ben Y. Zhao,et al.  Bayeux: an architecture for scalable and fault-tolerant wide-area data dissemination , 2001, NOSSDAV '01.

[10]  Sarunas Girdzijauskas,et al.  Locality-Awareness in a Peer-to-Peer Publish/Subscribe Network , 2012, DAIS.

[11]  Amir H. Payberah,et al.  Vitis: A Gossip-based Hybrid Overlay for Internet-scale Publish/Subscribe Enabling Rendezvous Routing in Unstructured Overlay Networks , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[12]  Masahiro Jibiki,et al.  A Low Cost Hierarchy-Awareness Extension of Skip Graph for World-Wide Range Retrievals , 2014, 2014 IEEE 38th Annual Computer Software and Applications Conference.

[13]  Michiharu Takemoto,et al.  Designing Overlay Networks for Handling Exhaust Data in a Distributed Topic-based Pub/Sub Architecture , 2015, J. Inf. Process..

[14]  Yolande Berbers,et al.  DisCoTec Workshop on Context-Aware Adaptation Mechanisms for Pervasive and Ubiquitous Services ( CAMPUS 2010 ) Middleware for the Internet of Things , Design Goals and Challenges 1 , 2010 .