Distributed Uniform Streaming Framework: An Elastic Fog Computing Platform for Event Stream Processing and Platform Transparency

The increase of Internet of Things devices and the rise of more computationally intense applications presents challenges for future Internet of Things architectures. We envision a future in which edge, fog, and cloud devices work together to execute future applications. Because the entire application cannot run on smaller edge or fog devices, we will need to split the application into smaller application components. These application components will send event messages to each other to create a single application from multiple application components. The execution location of the application components can be optimized to minimize the resource consumption. In this paper, we describe the Distributed Uniform Stream (DUST) framework that creates an abstraction between the application components and the middleware which is required to make the execution location transparent to the application component. We describe a real-world application that uses the DUST framework for platform transparency. Next to the DUST framework, we also describe the distributed DUST Coordinator, which will optimize the resource consumption by moving the application components to a different execution location. The coordinators will use an adapted version of the Contract Net Protocol to find local minima in resource consumption.

[1]  Jianli Pan,et al.  Future Edge Cloud and Edge Computing for Internet of Things Applications , 2018, IEEE Internet of Things Journal.

[2]  Dries Naudts,et al.  Smart Highway : ITS-G5 and C2VX based testbed for vehicular communications in real environments enhanced by edge/cloud technologies , 2019 .

[3]  Reinout Eyckerman,et al.  Context-Aware Distribution In Constrained IoT Environments , 2018, 3PGCIC.

[4]  Jay Kreps,et al.  Kafka : a Distributed Messaging System for Log Processing , 2011 .

[5]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[6]  Michael Wooldridge,et al.  An introduction to multiagent systems Wiley , 2002 .

[7]  Antonio Iera,et al.  The Internet of Things: A survey , 2010, Comput. Networks.

[8]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[9]  Charles C. Byers,et al.  Architectural Imperatives for Fog Computing: Use Cases, Requirements, and Architectural Techniques for Fog-Enabled IoT Networks , 2017, IEEE Communications Magazine.

[10]  Siegfried Mercelis,et al.  Distributed Uniform Streaming Framework: Towards an Elastic Fog Computing Platform for Event Stream Processing , 2018, 3PGCIC.

[11]  Khaled A. Harras,et al.  Femto Clouds: Leveraging Mobile Devices to Provide Cloud Service at the Edge , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[12]  Schahram Dustdar,et al.  Elastic stream processing in the Cloud , 2013, WIREs Data Mining Knowl. Discov..

[13]  Siegfried Mercelis,et al.  Context-Aware Optimization of Distributed Resources in Internet of Things Using Key Performance Indicators , 2017, 3PGCIC.

[14]  Hiroaki Harai,et al.  Dynamic Data Flow Processing in Edge Computing Environments , 2017, 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC).

[15]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.