Fog Fragment Cooperation on Bandwidth Management Based on Reinforcement Learning

The term big data has emerged in network concepts since the Internet of Things (IoT) made data generation faster through various smart environments. In contrast, bandwidth improvement has been slower; therefore, it has become a bottleneck, creating the need to solve bandwidth constraints. Over time, due to smart environment extensions and the increasing number of IoT devices, the number of fog nodes has increased. In this study, we introduce fog fragment computing in contrast to conventional fog computing. We address bandwidth management using fog nodes and their cooperation to overcome the extra required bandwidth for IoT devices with emergencies and bandwidth limitations. We formulate the decision-making problem of the fog nodes using a reinforcement learning approach and develop a Q-learning algorithm to achieve efficient decisions by forcing the fog nodes to help each other under special conditions. To the best of our knowledge, there has been no research with this objective thus far. Therefore, we compare this study with another scenario that considers a single fog node to show that our new extended method performs considerably better.

[1]  Xiaoli Chu,et al.  Computation Offloading and Resource Allocation in Mixed Fog/Cloud Computing Systems With Min-Max Fairness Guarantee , 2018, IEEE Transactions on Communications.

[2]  Axel Jantsch,et al.  Fog Computing in the Internet of Things , 2018 .

[3]  Thomas Fahringer,et al.  A reliability-aware resource provisioning scheme for real-time industrial applications in a Fog-integrated smart factory , 2019, Microprocess. Microsystems.

[4]  Yang Yang,et al.  Fair Task Offloading among Fog Nodes in Fog Computing Networks , 2018, 2018 IEEE International Conference on Communications (ICC).

[5]  Woongsup Kim,et al.  Toward Developing Fog Decision Making on the Transmission Rate of Various IoT Devices Based on Reinforcement Learning , 2020, IEEE Internet of Things Magazine.

[6]  Yangwoo Kim,et al.  A Two-Stage Big Data Analytics Framework with Real World Applications Using Spark Machine Learning and Long Short-Term Memory Network , 2018, Symmetry.

[7]  György Dán,et al.  Decentralized Algorithm for Randomized Task Allocation in Fog Computing Systems , 2019, IEEE/ACM Transactions on Networking.

[8]  Byeong-Hee Roh,et al.  An Efficient Superframe Structure with Optimal Bandwidth Utilization and Reduced Delay for Internet of Things Based Wireless Sensor Networks , 2020, Sensors.

[9]  Eduardo F. Morales,et al.  An Introduction to Reinforcement Learning , 2011 .

[10]  Carlos Francisco Simões Gomes,et al.  Big Data: A Global Overview , 2018, Studies in Big Data.

[11]  Qiang Wu,et al.  Smart fog based workflow for traffic control networks , 2019, Future Gener. Comput. Syst..

[12]  Yang Yang,et al.  FEMOS: Fog-Enabled Multitier Operations Scheduling in Dynamic Wireless Networks , 2018, IEEE Internet of Things Journal.

[13]  Yousaf Bin Zikria,et al.  Multimedia Internet of Things: A Comprehensive Survey , 2020, IEEE Access.

[14]  Muhammad Ikram Ashraf,et al.  Joint Cloudlet Selection and Latency Minimization in Fog Networks , 2018, IEEE Transactions on Industrial Informatics.

[15]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[16]  Zhisheng Niu,et al.  Exploiting Moving Intelligence: Delay-Optimized Computation Offloading in Vehicular Fog Networks , 2019, IEEE Communications Magazine.

[17]  Reham S. Saad,et al.  Bandwidth Consumption Gains for Improving Smart Grid QoS , 2019, J. Commun..