Efficient and dynamic scaling of fog nodes for IoT devices

It is predicted by the year 2020, more than 50 billion devices will be connected to the Internet. Traditionally, cloud computing has been used as the preferred platform for aggregating, processing, and analyzing IoT traffic. However, the cloud may not be the preferred platform for IoT devices in terms of responsiveness and immediate processing and analysis of IoT data and requests. For this reason, fog or edge computing has emerged to overcome such problems, whereby fog nodes are placed in close proximity to IoT devices. Fog nodes are primarily responsible of the local aggregation, processing, and analysis of IoT workload, thereby resulting in significant notable performance and responsiveness. One of the open issues and challenges in the area of fog computing is efficient scalability in which a minimal number of fog nodes are allocated based on the IoT workload and such that the SLA and QoS parameters are satisfied. To address this problem, we present a queuing mathematical and analytical model to study and analyze the performance of fog computing system. Our mathematical model determines under any offered IoT workload the number of fog nodes needed so that the QoS parameters are satisfied. From the model, we derived formulas for key performance metrics which include system response time, system loss rate, system throughput, CPU utilization, and the mean number of messages request. Our analytical model is cross-validated using discrete event simulator simulations.

[1]  R.H. Katz,et al.  Tech Titans Building Boom , 2009, IEEE Spectrum.

[2]  D. Yao,et al.  Fundamentals of Queueing Networks: Performance, Asymptotics, and Optimization , 2001, IEEE Transactions on Automatic Control.

[3]  Eui-nam Huh,et al.  Fog Computing and Smart Gateway Based Communication for Cloud of Things , 2014, 2014 International Conference on Future Internet of Things and Cloud.

[4]  Lisandro Zambenedetti Granville,et al.  Data Center Network Virtualization: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[5]  Giuseppe Serazzi,et al.  JMT: performance engineering tools for system modeling , 2009, PERV.

[6]  Rajkumar Buyya,et al.  Fog Computing: Helping the Internet of Things Realize Its Potential , 2016, Computer.

[7]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1997, TNET.

[8]  Mohammad S. Obaidat,et al.  On Theoretical Modeling of Sensor Cloud: A Paradigm Shift From Wireless Sensor Network , 2017, IEEE Systems Journal.

[9]  Feng Xia,et al.  Cloudlet deployment in local wireless networks: Motivation, architectures, applications, and open challenges , 2016, J. Netw. Comput. Appl..

[10]  G. R. Dattatreya,et al.  Performance Analysis of Queuing and Computer Networks , 2008 .

[11]  Y. Navaneeth Krishnan,et al.  Fog computing — Network based cloud computing , 2015, 2015 2nd International Conference on Electronics and Communication Systems (ICECS).

[12]  U. Narayan Bhat,et al.  An Introduction to Queueing Theory: Modeling and Analysis in Applications , 2006 .

[13]  Hao Hu,et al.  Improving Web Sites Performance Using Edge Servers in Fog Computing Architecture , 2013, 2013 IEEE Seventh International Symposium on Service-Oriented System Engineering.

[14]  Madoka Yuriyama,et al.  Sensor-Cloud Infrastructure - Physical Sensor Management with Virtualized Sensors on Cloud Computing , 2010, 2010 13th International Conference on Network-Based Information Systems.

[15]  Arslan Munir,et al.  IFCIoT: Integrated Fog Cloud IoT Architectural Paradigm for Future Internet of Things , 2017, ArXiv.

[16]  Raouf Boutaba,et al.  An Analytical Model for Estimating Cloud Resources of Elastic Services , 2015, Journal of Network and Systems Management.

[17]  Jiang Zhu,et al.  Fog Computing: A Platform for Internet of Things and Analytics , 2014, Big Data and Internet of Things.

[18]  Song Guo,et al.  Joint Optimization of Task Scheduling and Image Placement in Fog Computing Supported Software-Defined Embedded System , 2016, IEEE Transactions on Computers.

[19]  Kin K. Leung,et al.  Dynamic service migration and workload scheduling in edge-clouds , 2015, Perform. Evaluation.

[20]  Sudip Misra,et al.  Theoretical modelling of fog computing: a green computing paradigm to support IoT applications , 2016, IET Networks.

[21]  P. Burke.  The Output of a Queuing System , 1956 .

[22]  Arslan Munir,et al.  IFCIoT: Integrated Fog Cloud IoT: A novel architectural paradigm for the future Internet of Things. , 2017, IEEE Consumer Electronics Magazine.

[23]  Khaled Salah,et al.  Stochastic modelling and analysis of cloud computing data center , 2017, 2017 20th Conference on Innovations in Clouds, Internet and Networks (ICIN).

[24]  Ejaz Ahmed,et al.  A survey on mobile edge computing , 2016, 2016 10th International Conference on Intelligent Systems and Control (ISCO).

[25]  Rajkumar Buyya,et al.  Fog Computing: Principles, Architectures, and Applications , 2016, ArXiv.

[26]  Kishor S. Trivedi,et al.  Performance and Reliability Analysis of Computer Systems: An Example-Based Approach Using the SHARPE Software Package , 2012 .

[27]  Muhammad Ghulam,et al.  Smart Health Solution Integrating IoT and Cloud: A Case Study of Voice Pathology Monitoring , 2017, IEEE Communications Magazine.

[28]  Khaled Salah,et al.  Performance modeling and analysis of hypoexponential network servers , 2017, Telecommunication Systems.

[29]  Pradipta De,et al.  Computation Offloading from Mobile Devices: Can Edge Devices Perform Better Than the Cloud? , 2016, ARMS-CC@PODC.

[30]  Raja Lavanya,et al.  Fog Computing and Its Role in the Internet of Things , 2019, Advances in Computer and Electrical Engineering.

[31]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[32]  Paulo F. Pires,et al.  System modelling and performance evaluation of a three-tier Cloud of Things , 2017, Future Gener. Comput. Syst..

[33]  Eui-Nam Huh,et al.  Cloud of Things: Integrating Internet of Things and cloud computing and the issues involved , 2014, Proceedings of 2014 11th International Bhurban Conference on Applied Sciences & Technology (IBCAST) Islamabad, Pakistan, 14th - 18th January, 2014.

[34]  Myron Hlynka,et al.  Queueing Networks and Markov Chains (Modeling and Performance Evaluation With Computer Science Applications) , 2007, Technometrics.

[35]  Dave Evans,et al.  How the Next Evolution of the Internet Is Changing Everything , 2011 .

[36]  K. Mani Chandy,et al.  Approximate Methods for Analyzing Queueing Network Models of Computing Systems , 1978, CSUR.

[37]  Masayuki Murata,et al.  Priority control based on website categories in edge computing , 2016, 2016 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[38]  Harry G. Perros,et al.  Service Performance and Analysis in Cloud Computing , 2009, 2009 Congress on Services - I.

[39]  Sudip Misra,et al.  Assessment of the Suitability of Fog Computing in the Context of Internet of Things , 2018, IEEE Transactions on Cloud Computing.

[40]  Antonio Pescapè,et al.  Integration of Cloud computing and Internet of Things: A survey , 2016, Future Gener. Comput. Syst..

[41]  Johan Tordsson,et al.  How Beneficial Are Intermediate Layer Data Centers in Mobile Edge Networks? , 2016, 2016 IEEE 1st International Workshops on Foundations and Applications of Self* Systems (FAS*W).

[42]  Mohd Bazli Ab Karim,et al.  Extending Cloud Resources to the Edge: Possible Scenarios, Challenges, and Experiments , 2016, 2016 International Conference on Cloud Computing Research and Innovations (ICCCRI).

[43]  Teruo Higashino,et al.  Edge-centric Computing: Vision and Challenges , 2015, CCRV.

[44]  Randolph D. Nelson,et al.  Probability, stochastic processes, and queueing theory - the mathematics of computer performance modeling , 1995 .

[45]  Paulo F. Pires,et al.  Cost-effective processing for Delay-sensitive applications in Cloud of Things systems , 2016, 2016 IEEE 15th International Symposium on Network Computing and Applications (NCA).

[46]  Choong Seon Hong,et al.  An Architecture of IoT Service Delegation and Resource Allocation Based on Collaboration between Fog and Cloud Computing , 2016, Mob. Inf. Syst..

[47]  Tim Schmitz.  Discrete Event Simulation Modeling Programming And Analysis , 2016 .

[48]  Chuan Pham,et al.  A proximal algorithm for joint resource allocation and minimizing carbon footprint in geo-distributed fog computing , 2014, 2015 International Conference on Information Networking (ICOIN).