Resource Management Approaches in Fog Computing: a Comprehensive Review

In recent years, the Internet of Things (IoT) has been one of the most popular technologies that facilitate new interactions among things and humans to enhance the quality of life. With the rapid development of IoT, the fog computing paradigm is emerging as an attractive solution for processing the data of IoT applications. In the fog environment, IoT applications are executed by the intermediate computing nodes in the fog, as well as the physical servers in cloud data centers. On the other hand, due to the resource limitations, resource heterogeneity, dynamic nature, and unpredictability of fog environment, it necessitates the resource management issues as one of the challenging problems to be considered in the fog landscape. Despite the importance of resource management issues, to the best of our knowledge, there is not any systematic, comprehensive and detailed survey on the field of resource management approaches in the fog computing context. In this paper, we provide a systematic literature review (SLR) on the resource management approaches in fog environment in the form of a classical taxonomy to recognize the state-of-the-art mechanisms on this important topic and providing open issues as well. The presented taxonomy are classified into six main fields: application placement, resource scheduling, task offloading, load balancing, resource allocation, and resource provisioning. The resource management approaches are compared with each other according to the important factors such as the performance metrics, case studies, utilized techniques, and evaluation tools as well as their advantages and disadvantages are discussed.

[1]  Muhammad Ikram Ashraf,et al.  Joint Cloudlet Selection and Latency Minimization in Fog Networks , 2018, IEEE Transactions on Industrial Informatics.

[2]  Dusit Niyato,et al.  Auction Mechanisms in Cloud/Fog Computing Resource Allocation for Public Blockchain Networks , 2018, IEEE Transactions on Parallel and Distributed Systems.

[3]  Rong Yu,et al.  Scalable Fog Computing with Service Offloading in Bus Networks , 2016, 2016 IEEE 3rd International Conference on Cyber Security and Cloud Computing (CSCloud).

[4]  Mehdi Dehghan,et al.  A comprehensive survey of energy-aware routing protocols in wireless body area sensor networks , 2016, Journal of Medical Systems.

[5]  Joel J. P. C. Rodrigues,et al.  Towards energy-aware fog-enabled cloud of things for healthcare , 2018, Comput. Electr. Eng..

[6]  Choong Seon Hong,et al.  Multi-agent and reinforcement learning based code offloading in mobile fog , 2016, 2016 International Conference on Information Networking (ICOIN).

[7]  Neelanarayanan Venkataraman,et al.  A Novel Approach to Address Interoperability Concern in Cloud Computing , 2015 .

[8]  Fan Bin,et al.  Research on services modeling in LTE networks , 2016 .

[9]  Xin Li,et al.  SDLB: A Scalable and Dynamic Software Load Balancer for Fog and Mobile Edge Computing , 2017, MECOMM@SIGCOMM.

[10]  Zhan Qiang,et al.  Fog computing dynamic load balancing mechanism based on graph repartitioning , 2016, China Communications.

[11]  Rajkumar Buyya,et al.  Mobility-Aware Application Scheduling in Fog Computing , 2017, IEEE Cloud Computing.

[12]  T. Gyimothy,et al.  A Mobile IoT Device Simulator for IoT-Fog-Cloud Systems , 2018, Journal of Grid Computing.

[13]  Yacine Ghamri-Doudane,et al.  Offloading Content with Self-Organizing Mobile Fogs , 2017, 2017 29th International Teletraffic Congress (ITC 29).

[14]  Xiaohui Zhao,et al.  An Energy Consumption Oriented Offloading Algorithm for Fog Computing , 2016, QSHINE.

[15]  Mohamed Mohamed,et al.  Foggy: A Framework for Continuous Automated IoT Application Deployment in Fog Computing , 2017, 2017 IEEE International Conference on AI & Mobile Services (AIMS).

[16]  Deze Zeng,et al.  Towards energy efficient service composition in green energy powered Cyber-Physical Fog Systems , 2018, Future Gener. Comput. Syst..

[17]  Wenyu Zhang,et al.  Cooperative Fog Computing for Dealing with Big Data in the Internet of Vehicles: Architecture and Hierarchical Resource Management , 2017, IEEE Communications Magazine.

[18]  Yan Zhang,et al.  Software Defined Machine-to-Machine Communication for Smart Energy Management , 2017, IEEE Communications Magazine.

[19]  Yan Lindsay Sun,et al.  Multi-objective Optimization of Resource Scheduling in Fog Computing Using an Improved NSGA-II , 2018, Wirel. Pers. Commun..

[20]  Victor C. M. Leung,et al.  Resource Allocation in Software Defined Fog Vehicular Networks , 2017, DIVANet@MSWiM.

[21]  Rajkumar Buyya,et al.  C2OF2N: a low power cooperative code offloading method for femtolet-based fog network , 2018, The Journal of Supercomputing.

[22]  Antonio Brogi,et al.  QoS-Aware Deployment of IoT Applications Through the Fog , 2017, IEEE Internet of Things Journal.

[23]  Nejib Ben Hadj-Alouane,et al.  A platform as-a-service for hybrid cloud/fog environments , 2016, 2016 IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN).

[24]  Jörg Domaschka,et al.  Reliable capacity provisioning for distributed cloud/edge/fog computing applications , 2017, 2017 European Conference on Networks and Communications (EuCNC).

[25]  Harsh Kumar Singh,et al.  An efficient data replication and load balancing technique for fog computing environment , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[26]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[27]  Hemant Kumar Rath,et al.  Resource Constrained Offloading in Fog Computing , 2016, MECC@Middleware.

[28]  Hesham A. Ali,et al.  A fog based load forecasting strategy for smart grids using big electrical data , 2018, Cluster Computing.

[29]  Chun-Cheng Lin,et al.  Cost-Efficient Deployment of Fog Computing Systems at Logistics Centers in Industry 4.0 , 2018, IEEE Transactions on Industrial Informatics.

[30]  Xavier Masip-Bruin,et al.  Towards a proper service placement in combined Fog-to-Cloud (F2C) architectures , 2018, Future Gener. Comput. Syst..

[31]  Rajkumar Buyya,et al.  FOCAN: A Fog-supported Smart City Network Architecture for Management of Applications in the Internet of Everything Environments , 2017, J. Parallel Distributed Comput..

[32]  Philipp Leitner,et al.  Resource Provisioning for IoT Services in the Fog , 2016, 2016 IEEE 9th International Conference on Service-Oriented Computing and Applications (SOCA).

[33]  Enzo Baccarelli,et al.  Design and energy-efficient resource management of virtualized networked Fog architectures for the real-time support of IoT applications , 2018, The Journal of Supercomputing.

[34]  Qiliang Zhu,et al.  Task offloading decision in fog computing system , 2017, China Communications.

[35]  Vijay K. Bhargava,et al.  Price-Based Resource Allocation for Edge Computing: A Market Equilibrium Approach , 2018, IEEE Transactions on Cloud Computing.

[36]  Song Guo,et al.  Joint Optimization of Task Scheduling and Image Placement in Fog Computing Supported Software-Defined Embedded System , 2016, IEEE Transactions on Computers.

[37]  Mauro Conti,et al.  Fog over virtualized IoT: new opportunity for context-aware networked applications and a case study , 2017 .

[38]  Nima Jafari Navimipour,et al.  Formal verification approaches and standards in the cloud computing: A comprehensive and systematic review , 2018, Comput. Stand. Interfaces.

[39]  Wei Li,et al.  A dynamic tradeoff data processing framework for delay-sensitive applications in Cloud of Things systems , 2018, J. Parallel Distributed Comput..

[40]  Nima Jafari Navimipour,et al.  An improved genetic algorithm for task scheduling in the cloud environments using the priority queues: Formal verification, simulation, and statistical testing , 2017, J. Syst. Softw..

[41]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[42]  Sergio Barbarossa,et al.  The Fog Balancing: Load Distribution for Small Cell Cloud Computing , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[43]  Zhiyuan Ren,et al.  A novel load balancing strategy of software-defined cloud/fog networking in the Internet of Vehicles , 2016, China Communications.

[44]  Marília Curado,et al.  Service placement for latency reduction in the internet of things , 2016, Annals of Telecommunications.

[45]  Arnab Sarkar,et al.  Real time resource allocation on a dynamic two level symbiotic fog architecture , 2016, 2016 Sixth International Symposium on Embedded Computing and System Design (ISED).

[46]  Bruno Volckaert,et al.  Resource provisioning for IoT application services in smart cities , 2017, 2017 13th International Conference on Network and Service Management (CNSM).

[47]  Alireza Souri,et al.  Software as a service based CRM providers in the cloud computing: Challenges and technical issues , 2017, J. Serv. Sci. Res..

[48]  Rajkumar Buyya,et al.  iFogSim: A toolkit for modeling and simulation of resource management techniques in the Internet of Things, Edge and Fog computing environments , 2016, Softw. Pract. Exp..

[49]  Heiko Ludwig,et al.  Zenith: Utility-Aware Resource Allocation for Edge Computing , 2017, 2017 IEEE International Conference on Edge Computing (EDGE).

[50]  Lei Wang,et al.  Offloading in Internet of Vehicles: A Fog-Enabled Real-Time Traffic Management System , 2018, IEEE Transactions on Industrial Informatics.

[51]  Jeremy Singer,et al.  Experience report , 2019, Inroads.

[52]  Sandeep K. Sood,et al.  SNA Based Resource Optimization in Optical Network using Fog and Cloud Computing , 2017, Opt. Switch. Netw..

[53]  Mostafa Ghobaei-Arani,et al.  An efficient approach for improving virtual machine placement in cloud computing environment , 2017, J. Exp. Theor. Artif. Intell..

[54]  B. B. Gupta,et al.  An optimized service broker routing policy based on differential evolution algorithm in fog/cloud environment , 2017, Cluster Computing.

[55]  Hao Liang,et al.  Optimal Workload Allocation in Fog-Cloud Computing Toward Balanced Delay and Power Consumption , 2016, IEEE Internet of Things Journal.

[56]  Mohsen Nickray,et al.  Scheduling of fog networks with optimized knapsack by symbiotic organisms search , 2017, 2017 21st Conference of Open Innovations Association (FRUCT).

[57]  Amir Masoud Rahmani,et al.  A Survey for Replica Placement Techniques in Data Grid Environment , 2014 .

[58]  Zhiyuan Ren,et al.  Research on Load Balancing for Software Defined Cloud-Fog Network in Real-Time Mobile Face Recognition , 2016, ChinaCom.

[59]  Salvatore Venticinque,et al.  A methodology for deployment of IoT application in fog , 2018, Journal of Ambient Intelligence and Humanized Computing.

[60]  Kin K. Leung,et al.  Dynamic service migration and workload scheduling in edge-clouds , 2015, Perform. Evaluation.

[61]  Daniele Tarchi,et al.  An Energy-Aware Offloading Clustering Approach (EAOCA) in fog computing , 2017, 2017 International Symposium on Wireless Communication Systems (ISWCS).

[62]  Nima Jafari Navimipour,et al.  Behavioral modeling and formal verification of a resource discovery approach in Grid computing , 2014, Expert Syst. Appl..

[63]  Zheng Chang,et al.  Socially Aware Dynamic Computation Offloading Scheme for Fog Computing System With Energy Harvesting Devices , 2018, IEEE Internet of Things Journal.

[64]  Eui-Nam Huh,et al.  IoT Resource Estimation Challenges and Modeling in Fog , 2018 .

[65]  Suresh Subramaniam,et al.  Deadline-Aware Task Scheduling in a Tiered IoT Infrastructure , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[66]  Enda Barrett,et al.  An enhanced sum rate in the cluster based cognitive radio relay network using the sequential approach for the future Internet of Things , 2018, Hum. centric Comput. Inf. Sci..

[67]  Sherali Zeadally,et al.  Offloading in fog computing for IoT: Review, enabling technologies, and research opportunities , 2018, Future Gener. Comput. Syst..

[68]  Rajkumar Buyya,et al.  Distributed data stream processing and edge computing: A survey on resource elasticity and future directions , 2017, J. Netw. Comput. Appl..

[69]  Yong Xiang,et al.  Cost Efficient Resource Management in Fog Computing Supported Medical Cyber-Physical System , 2017, IEEE Transactions on Emerging Topics in Computing.

[70]  Mohammad Sadegh Aslanpour,et al.  CSA-WSC: cuckoo search algorithm for web service composition in cloud environments , 2018, Soft Comput..

[71]  Tapani Ristaniemi,et al.  Energy Efficient Optimization for Computation Offloading in Fog Computing System , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[72]  Amir Masoud Rahmani,et al.  A moth‐flame optimization algorithm for web service composition in cloud computing: Simulation and verification , 2018, Softw. Pract. Exp..

[73]  Rajkumar Buyya,et al.  Latency-Aware Application Module Management for Fog Computing Environments , 2018, ACM Trans. Internet Techn..

[74]  Doan B. Hoang,et al.  FBRC: Optimization of task Scheduling in Fog-Based Region and Cloud , 2017, 2017 IEEE Trustcom/BigDataSE/ICESS.

[75]  Corrado Santoro,et al.  JarvSis: a distributed scheduler for IoT applications , 2017, Cluster Computing.

[76]  Zhigang Chen,et al.  Workload scheduling toward worst-case delay and optimal utility for single-hop Fog-IoT architecture , 2018, IET Commun..

[77]  Thar Baker,et al.  ControCity: An Autonomous Approach for Controlling Elasticity Using Buffer Management in Cloud Computing Environment , 2019, IEEE Access.

[78]  Sherali Zeadally,et al.  Fog computing job scheduling optimization based on bees swarm , 2018, Enterp. Inf. Syst..

[79]  Xiaohui Zhao,et al.  Joint resource allocation and coordinated computation offloading for fog radio access networks , 2016, China Communications.

[80]  Roch H. Glitho,et al.  A Comprehensive Survey on Fog Computing: State-of-the-Art and Research Challenges , 2017, IEEE Communications Surveys & Tutorials.

[81]  Cosimo Anglano,et al.  Profit-aware Resource Management for Edge Computing Systems , 2018, EdgeSys@MobiSys.

[82]  Mohsen Nickray,et al.  A hyper heuristic algorithm for scheduling of fog networks , 2017, 2017 21st Conference of Open Innovations Association (FRUCT).

[83]  NavimipourNima Jafari,et al.  Formal verification approaches and standards in the cloud computing , 2018 .

[84]  Zhu Han,et al.  Computing Resource Allocation in Three-Tier IoT Fog Networks: A Joint Optimization Approach Combining Stackelberg Game and Matching , 2017, IEEE Internet of Things Journal.

[85]  Xavier Masip-Bruin,et al.  Managing resources continuity from the edge to the cloud: Architecture and performance , 2018, Future Gener. Comput. Syst..

[86]  Xingming Sun,et al.  Dynamic Resource Allocation for Load Balancing in Fog Environment , 2018, Wirel. Commun. Mob. Comput..

[87]  Rajkumar Buyya,et al.  Modelling and Simulation of Fog and Edge Computing Environments using iFogSim Toolkit , 2018, ArXiv.

[88]  Li-Der Chou,et al.  A Lightweight Autoscaling Mechanism for Fog Computing in Industrial Applications , 2018, IEEE Transactions on Industrial Informatics.

[89]  Gustavo Rau de Almeida Callou,et al.  An algorithm to optimise the load distribution of fog environments , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[90]  Rajkumar Buyya,et al.  Computational Intelligence Based QoS-Aware Web Service Composition: A Systematic Literature Review , 2017, IEEE Transactions on Services Computing.

[91]  Mung Chiang,et al.  Leveraging fog and cloud computing for efficient computational offloading , 2017, 2017 IEEE MIT Undergraduate Research Technology Conference (URTC).

[92]  Gerard Jounghyun Kim,et al.  IoT + AR: pervasive and augmented environments for “Digi-log” shopping experience , 2019, Human-centric Computing and Information Sciences.

[93]  Klervie Toczé,et al.  A Taxonomy for Management and Optimization of Multiple Resources in Edge Computing , 2018, Wirel. Commun. Mob. Comput..

[94]  Philipp Leitner,et al.  Optimized IoT service placement in the fog , 2017, Service Oriented Computing and Applications.

[95]  Luís Veiga,et al.  A Lightweight Service Placement Approach for Community Network Micro-Clouds , 2018, Journal of Grid Computing.

[96]  Amir Masoud Rahmani,et al.  Load-balancing algorithms in cloud computing: A survey , 2017, J. Netw. Comput. Appl..

[97]  Sai Peck Lee,et al.  A semantic interoperability framework for software as a service systems in cloud computing environments / Reza Rezaei , 2014 .

[98]  Chungang Yan,et al.  Resource Allocation Strategy in Fog Computing Based on Priced Timed Petri Nets , 2017, IEEE Internet of Things Journal.

[99]  Eui-nam Huh,et al.  Towards task scheduling in a cloud-fog computing system , 2016, 2016 18th Asia-Pacific Network Operations and Management Symposium (APNOMS).

[100]  Mostafa Ghobaei-Arani,et al.  A learning‐based approach for virtual machine placement in cloud data centers , 2018, Int. J. Commun. Syst..

[101]  Jafarnejad GhomiEinollah,et al.  Load-balancing algorithms in cloud computing , 2017 .

[102]  Khaled Salah,et al.  Efficient and dynamic scaling of fog nodes for IoT devices , 2017, The Journal of Supercomputing.

[103]  Wenzhong Li,et al.  Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing , 2015, IEEE/ACM Transactions on Networking.

[104]  Xuehai Zhou,et al.  SSLB: Self-Similarity-Based Load Balancing for Large-Scale Fog Computing , 2018 .

[105]  Rajkumar Buyya,et al.  Quality of Experience (QoE)-aware placement of applications in Fog computing environments , 2019, J. Parallel Distributed Comput..

[106]  Chen-Khong Tham,et al.  Latency aware mobile task assignment and load balancing for edge cloudlets , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[107]  Roberto Beraldi,et al.  Cooperative load balancing scheme for edge computing resources , 2017, 2017 Second International Conference on Fog and Mobile Edge Computing (FMEC).

[108]  Tapani Ristaniemi,et al.  Multiobjective Optimization for Computation Offloading in Fog Computing , 2018, IEEE Internet of Things Journal.

[109]  Mirjana Ivanovic,et al.  Context Aware Resource and Service Provisioning Management in Fog Computing Systems , 2017, IDC.

[110]  Choong Seon Hong,et al.  An Architecture of IoT Service Delegation and Resource Allocation Based on Collaboration between Fog and Cloud Computing , 2016, Mob. Inf. Syst..

[111]  Chuan Pham,et al.  A proximal algorithm for joint resource allocation and minimizing carbon footprint in geo-distributed fog computing , 2014, 2015 International Conference on Information Networking (ICOIN).

[112]  Chuan Pham,et al.  OaaS: offload as a service in fog networks , 2017, Computing.

[113]  Zhu Han,et al.  Cloud/Fog Computing Resource Management and Pricing for Blockchain Networks , 2017, IEEE Internet of Things Journal.

[114]  Li Peng,et al.  A secure-efficient data collection algorithm based on self-adaptive sensing model in mobile Internet of vehicles , 2016 .

[115]  Enrique Saurez,et al.  Incremental deployment and migration of geo-distributed situation awareness applications in the fog , 2016, DEBS.

[116]  Monire Norouzi,et al.  A State-of-the-Art Survey on Formal Verification of the Internet of Things Applications , 2019, J. Serv. Sci. Res..

[117]  Mostafa Ghobaei-Arani,et al.  An autonomous resource provisioning framework for massively multiplayer online games in cloud environment , 2019, J. Netw. Comput. Appl..

[118]  Zhu Han,et al.  A Hierarchical Game Framework for Resource Management in Fog Computing , 2017, IEEE Communications Magazine.

[119]  Shaolei Ren,et al.  Online Learning for Offloading and Autoscaling in Renewable-Powered Mobile Edge Computing , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[120]  Wei Wang,et al.  Delay-Constrained Hybrid Computation Offloading With Cloud and Fog Computing , 2017, IEEE Access.

[121]  Raja Lavanya,et al.  Fog Computing and Its Role in the Internet of Things , 2019, Advances in Computer and Electrical Engineering.

[122]  Michail Matthaiou,et al.  ENORM: A Framework For Edge NOde Resource Management , 2017, IEEE Transactions on Services Computing.

[123]  Daniele Tarchi,et al.  An Energy and Delay-Efficient Partial Offloading Technique for Fog Computing Architectures , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[124]  Hamid Reza Arkian,et al.  MIST: Fog-based data analytics scheme with cost-efficient resource provisioning for IoT crowdsensing applications , 2017, J. Netw. Comput. Appl..

[125]  Dimitra I. Kaklamani,et al.  A Cooperative Fog Approach for Effective Workload Balancing , 2017, IEEE Cloud Computing.

[126]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A tertiary study , 2010, Inf. Softw. Technol..

[127]  Valeria Cardellini,et al.  Multi-Level Elasticity for Wide-Area Data Streaming Systems: A Reinforcement Learning Approach , 2018, Algorithms.

[128]  Quang Tran Minh,et al.  Toward service placement on Fog computing landscape , 2017, 2017 4th NAFOSTED Conference on Information and Computer Science.

[129]  Alan Davy,et al.  Resource aware placement of IoT application modules in Fog-Cloud Computing Paradigm , 2017, 2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[130]  BuyyaRajkumar,et al.  Distributed data stream processing and edge computing , 2018 .

[131]  Xiao Chen,et al.  Exploring Fog Computing-Based Adaptive Vehicular Data Scheduling Policies Through a Compositional Formal Method—PEPA , 2017, IEEE Communications Letters.

[132]  Vincenzo Grassi,et al.  On QoS-aware scheduling of data stream applications over fog computing infrastructures , 2015, 2015 IEEE Symposium on Computers and Communication (ISCC).

[133]  Miao Li,et al.  Edge cloud computing service composition based on modified bird swarm optimization in the internet of things , 2018, Cluster Computing.

[134]  Paulo F. Pires,et al.  Cost-Effective Processing in Fog-Integrated Internet of Things Ecosystems , 2017, MSWiM.

[135]  Paolo Bellavista,et al.  Elastic Provisioning of Internet of Things Services Using Fog Computing: An Experience Report , 2018, 2018 6th IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud).

[136]  Zhangjie Fu,et al.  Heterogeneous cloudlet deployment and user‐cloudlet association toward cost effective fog computing , 2017, Concurr. Comput. Pract. Exp..

[137]  Nan Zhang,et al.  A resource-sharing model based on a repeated game in fog computing , 2017, Saudi journal of biological sciences.

[138]  Ioannis Galanis,et al.  Fog Computing and Efficient Resource Management in the era of Internet-of-Video Things (IoVT) , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[139]  Alireza Souri,et al.  A new probable decision making approach for verification of probabilistic real-time systems , 2015, 2015 6th IEEE International Conference on Software Engineering and Service Science (ICSESS).

[140]  Rajkumar Buyya,et al.  Fog Computing: Principles, Architectures, and Applications , 2016, ArXiv.