Applying queue theory for modeling of cloud computing: A systematic review

The cloud computing paradigm is an important service in the Internet for sharing and providing resources in a cost‐efficient way. Modeling of a cloud system is not an easy task because of the complexity and large scale of such systems. Cloud reliability could be improved by modeling the various aspects of cloud systems, including scheduling, service time, wait time, and hardware and software failures. The aim of this study is to survey research studies done on the modeling of cloud computing using the queuing system in order to identify where more emphasis should be placed in both current and future research directions. This paper follows the goal by investigating the articles published between 2008 and January 2017 in journals and conferences. A systematic mapping study combined with a systematic literature review was performed to find the related literature, and 71 articles were selected as primary studies that were classified in relation to the focus, research type, and contribution type. We classified the modeling techniques of cloud computing using the queuing theory in seven categories based on their focus area: (1) performance, (2) quality of service, (3) workflow scheduling, (4) energy savings, (5) resource management, (6) priority‐based servicing, and (7) reliability. A majority of the primary articles focus on performance (37%), 15% of them focus on resource management, 14% of them focus on quality of service, 13% of them focus on workflow scheduling, 13% of them focus on energy savings, 4% of them focus on priority‐based servicing for requests, and 4% of them focus on reliability. This work summarizes and classifies the research efforts conducted on applying queue theory for modeling of cloud computing (AQTMCC), providing a good starting point for further research in this area.

[1]  Saeed Sharifian,et al.  A hybrid heuristic queue based algorithm for task assignment in mobile cloud , 2017, Future Gener. Comput. Syst..

[2]  Yuxiong He,et al.  Power-effiicent resource allocation in MapReduce clusters , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[3]  Jelena V. Misic,et al.  Performance Analysis of Cloud Computing Centers Using M/G/m/m+r Queuing Systems , 2012, IEEE Transactions on Parallel and Distributed Systems.

[4]  Jelena V. Misic,et al.  Modelling of Cloud Computing Centers Using M/G/m Queues , 2011, 2011 31st International Conference on Distributed Computing Systems Workshops.

[5]  A. Anupama,et al.  Using Queuing theory the performance measures of cloud with infinite servers , 2014 .

[6]  Fang Dong,et al.  Resource provisioning optimization for service hosting on cloud platform , 2016, 2016 IEEE 20th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[7]  Rosa Filgueira,et al.  The cloud paradigm applied to e-Health , 2013, BMC Medical Informatics and Decision Making.

[8]  Yu Gong,et al.  Energy and performance management in large data centers: A queuing theory perspective , 2015, 2015 International Conference on Computing, Networking and Communications (ICNC).

[9]  Anatoly D. Khomonenko,et al.  A cloud computing model using multi-channel queuing system with cooling , 2016, 2016 XIX IEEE International Conference on Soft Computing and Measurements (SCM).

[10]  Thomas Begin,et al.  Multi-server preemptive priority queue with general arrivals and service times , 2017, Perform. Evaluation.

[11]  Xuan Wang,et al.  Resource provision algorithms in cloud computing: A survey , 2016, J. Netw. Comput. Appl..

[12]  A. O. Akingbesote,et al.  Performance analysis of non-preemptive priority with application to cloud E-marketplaces , 2014, 2014 IEEE 6th International Conference on Adaptive Science & Technology (ICAST).

[13]  Nasser Yazdani,et al.  Modeling and performance analysis of cloudlet in Mobile Cloud Computing , 2017, Perform. Evaluation.

[14]  Dharmendra Prasad Mahato,et al.  Reliability Modeling and Analysis for Deadline-Constrained Grid Service , 2018, 2018 32nd International Conference on Advanced Information Networking and Applications Workshops (WAINA).

[15]  M. V. Rama Sundari,et al.  Performance analysis of cloud computing using Queuing models , 2012, 2012 International Conference on Cloud Computing Technologies, Applications and Management (ICCCTAM).

[16]  Marin Litoiu,et al.  Resource provisioning for cloud computing , 2009, CASCON.

[17]  Amin Jula,et al.  Cloud computing service composition: A systematic literature review , 2014, Expert Syst. Appl..

[19]  Said El Kafhali,et al.  Cloud Computing Performance Evaluation under Dynamic Resource Utilization and Traffic Control , 2017, BDCA'17.

[20]  Vinu Sundararaj,et al.  Optimal Task Assignment in Mobile Cloud Computing by Queue Based Ant-Bee Algorithm , 2018, Wirel. Pers. Commun..

[21]  Luqun Li,et al.  An Optimistic Differentiated Service Job Scheduling System for Cloud Computing Service Users and Providers , 2009, 2009 Third International Conference on Multimedia and Ubiquitous Engineering.

[22]  Ling Guan,et al.  Optimal resource allocation for multimedia cloud based on queuing model , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[23]  José Antonio Lozano,et al.  A Review of Auto-scaling Techniques for Elastic Applications in Cloud Environments , 2014, Journal of Grid Computing.

[24]  Ling Guan,et al.  Queueing model based resource optimization for multimedia cloud , 2014, J. Vis. Commun. Image Represent..

[25]  Xu An Wang,et al.  Queuing-Oriented Job Optimizing Scheduling In Cloud Mapreduce , 2016, 3PGCIC.

[26]  Haleh Khojasteh,et al.  Prioritization of Overflow Tasks to Improve Performance of Mobile Cloud , 2019, IEEE Transactions on Cloud Computing.

[27]  Pearl Brereton,et al.  The educational value of mapping studies of software engineering literature , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[28]  Dimitrios Katsaros,et al.  Architectural Requirements for Cloud Computing Systems: An Enterprise Cloud Approach , 2011, Journal of Grid Computing.

[29]  Kai Petersen,et al.  Guidelines for conducting systematic mapping studies in software engineering: An update , 2015, Inf. Softw. Technol..

[30]  Veena Goswami,et al.  Performance analysis of cloud with queue-dependent virtual machines , 2012, 2012 1st International Conference on Recent Advances in Information Technology (RAIT).

[31]  Siddharth Swarup Rautaray,et al.  A Comprehensive Survey on Cloud Computing , 2015 .

[32]  Rodrigo N. Calheiros,et al.  Auto-scaling Web Applications in Clouds: A Taxonomy and Survey , 2016 .

[33]  Keyvan RahimiZadeh,et al.  Performance modeling and analysis of virtualized multi-tier applications under dynamic workloads , 2015, J. Netw. Comput. Appl..

[34]  Leonardo Mostarda,et al.  Analytical Modelling and Performability Analysis for Cloud Computing Using Queuing System , 2015, 2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC).

[35]  Frederico Araújo Durão,et al.  A Systematic Mapping Study on Cloud Computing , 2013, ArXiv.

[36]  Hind Castel-Taleb,et al.  Stochastic Bounding Models for Performance Analysis of Clouds , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[37]  Adel Nadjaran Toosi,et al.  Auto-scaling web applications in clouds: A cost-aware approach , 2017, J. Netw. Comput. Appl..

[39]  Shyan-Ming Yuan,et al.  A small world based overlay network for improving dynamic load-balancing , 2015, J. Syst. Softw..

[40]  Pearl Brereton,et al.  The value of mapping studies - A participant-observer case study , 2010, EASE.

[41]  Bin Wang,et al.  Modeling Active Virtual Machines on IaaS Clouds Using an M/G/m/m+K Queue , 2016, IEEE Transactions on Services Computing.

[42]  Emiliano Casalicchio,et al.  Mechanisms for SLA provisioning in cloud-based service providers , 2013, Comput. Networks.

[43]  Jelena V. Misic,et al.  A Fine-Grained Performance Model of Cloud Computing Centers , 2013, IEEE Transactions on Parallel and Distributed Systems.

[44]  Riktesh Srivastava.  Analysis Of Job Scheduling Algorithm For An E-Business Model In A Cloud Computing Environment Via GI/G/3/N/K Queuing Model , 1970 .

[45]  Wei Tan,et al.  TRS: Temporal Request Scheduling with bounded delay assurance in a green cloud data center , 2016, Inf. Sci..

[46]  Hamed Mohsenian Rad,et al.  Energy and Performance Management of Green Data Centers: A Profit Maximization Approach , 2013, IEEE Transactions on Smart Grid.

[47]  Sunilkumar S. Manvi,et al.  Resource management for Infrastructure as a Service (IaaS) in cloud computing: A survey , 2014, J. Netw. Comput. Appl..

[48]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[49]  Jordi Vilaplana,et al.  A queuing theory model for cloud computing , 2014, The Journal of Supercomputing.

[50]  Pearl Brereton,et al.  Using mapping studies as the basis for further research - A participant-observer case study , 2011, Inf. Softw. Technol..

[51]  Jeonghoon Mo,et al.  Performance Modeling of Communication Networks with Markov Chains , 2010, Performance Modeling of Communication Networks with Markov Chains.

[52]  N.Ani Brown Mary,et al.  Performance Factors of Cloud Computing Data Centers Using [(M/G/1) : (∞/Gdmodel)] Queuing Systems , 2013 .

[53]  Holger Karl,et al.  Response time-optimized distributed cloud resource allocation , 2014, DCC '14.

[54]  Xiaodong Liu,et al.  A queuing model considering resources sharing for cloud service performance , 2015, The Journal of Supercomputing.

[55]  Prasant Kumar Pattnaik,et al.  A Simulation-based Approach to Optimize the Execution Time and Minimization of Average Waiting Time Using Queuing Model in Cloud Computing Environment , 2016 .

[56]  Young Myoung Ko,et al.  Stabilizing the virtual response time in single-server processor sharing queues with slowly time-varying arrival rates , 2018, Annals of Operations Research.

[57]  Weiwei Lin,et al.  Random task scheduling scheme based on reinforcement learning in cloud computing , 2015, Cluster Computing.

[58]  Halima Elbiaze,et al.  GreenPOD: Leveraging queuing networks for reducing energy consumption in data centers , 2018, 2018 21st Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN).

[59]  Jordi Vilaplana,et al.  A performance model for scalable cloud computing , 2015 .

[60]  Ying Wang,et al.  An Energy-Saving Task Scheduling Strategy Based on Vacation Queuing Theory in Cloud Computing , 2015 .

[61]  Ali Movaghar-Rahimabadi,et al.  Modeling and Evaluation of Power-Aware Software Rejuvenation in Cloud Systems , 2018, Algorithms.

[62]  Enzo Baccarelli,et al.  Energy-efficient adaptive networked datacenters for the QoS support of real-time applications , 2014, The Journal of Supercomputing.

[63]  Binh Minh Nguyen,et al.  Enhancing service capability with multiple finite capacity server queues in cloud data centers , 2016, Cluster Computing.

[64]  Xiaodong Liu,et al.  Performance analysis of cloud computing services considering resources sharing among virtual machines , 2014, The Journal of Supercomputing.

[65]  Mohamed Cheriet,et al.  Preemptive cloud resource allocation modeling of processing jobs , 2018, The Journal of Supercomputing.

[66]  D Khomonenko Anatoly,et al.  A cloud computing model using multi-channel queuing system with cooling , 2016 .

[67]  Xiaohong Jiang,et al.  An Energy-Efficient Scheme for Cloud Resource Provisioning Based on CloudSim , 2011, 2011 IEEE International Conference on Cluster Computing.

[68]  Miroslav Zivkovic,et al.  Performance of Cloud Computing Centers with Multiple Priority Classes , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[69]  Dongyu Qiu,et al.  Modeling of the resource allocation in cloud computing centers , 2015, Comput. Networks.

[70]  Harry G. Perros,et al.  SLA-based resource allocation in cluster computing systems , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[71]  Shijun Liu,et al.  Integrating Theoretical Modeling and Experimental Measurement for Soft Resource Allocation in Multi-tier Web Systems , 2016, 2016 IEEE International Conference on Web Services (ICWS).

[72]  V. Viji Rajendran,et al.  Queuing Model for Improving QoS in Cloud Service Discovery , 2015, FICTA.

[73]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[74]  Halima Aminu,et al.  Mathematical Analysis on Quality of Service in Cloud servers , 2015 .

[75]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[76]  S. Venugopal,et al.  An Optimal Model for Priority based Service Scheduling Policy for Cloud Computing Environment , 2011 .

[77]  Khaled Salah,et al.  Modeling and Analysis of Performance and Energy Consumption in Cloud Data Centers , 2018 .

[78]  János Sztrik,et al.  Queuing Management with Feedback in Cloud Computing Centers with Large Numbers of Web Servers , 2018 .

[79]  Liang Luo,et al.  Performance Analysis of Cloud Service Considering Reliability , 2016, 2016 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C).

[80]  Jin Shunfu,et al.  An energy-saving strategy based on multi-server vacation queuing theory in cloud data center , 2018, The Journal of Supercomputing.

[81]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[82]  Harry G. Perros,et al.  Service Performance and Analysis in Cloud Computing , 2009, 2009 Congress on Services - I.

[83]  Ling Guan,et al.  Optimal resource allocation for multimedia cloud in priority service scheme , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[84]  Mohammed Atiquzzaman,et al.  Scheduling internet of things applications in cloud computing , 2016, Annals of Telecommunications.

[85]  Utpal Biswas,et al.  A smart job scheduling system for cloud computing service providers and users: Modeling and simulation , 2012, 2012 1st International Conference on Recent Advances in Information Technology (RAIT).

[86]  Xin Yao,et al.  A Survey and Taxonomy of Self-Aware and Self-Adaptive Cloud Autoscaling Systems , 2016, ACM Comput. Surv..

[87]  M. Z. Rashad,et al.  Enhancing Cloud Computing Scheduling based on Queuing Models , 2014 .

[88]  Abdul Razaque,et al.  Incorporation of weighted linear prediction technique and M/M/1 Queuing Theory for improving energy efficiency of Cloud computing datacenters , 2016, 2016 IEEE Long Island Systems, Applications and Technology Conference (LISAT).

[89]  Enver Ever,et al.  Performability analysis of cloud computing centers with large numbers of servers , 2017, The Journal of Supercomputing.

[90]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[91]  Mukaddim Pathan,et al.  A two-stage approach for task and resource management in multimedia cloud environment , 2014, Computing.

[92]  Rajkumar Buyya,et al.  CloudSim: A Novel Framework for Modeling and Simulation of Cloud Computing Infrastructures and Services , 2009, ArXiv.

[93]  Rui Kang,et al.  Service reliability modeling and evaluation of active-active cloud data center based on the IT infrastructure , 2017, Microelectron. Reliab..

[94]  Wei-Hua Bai,et al.  Performance Analysis of Heterogeneous Data Centers in Cloud Computing Using a Complex Queuing Model , 2015 .