A survey of mathematical models, simulation approaches and testbeds used for research in cloud computing

The first hurdle for carrying out research on cloud computing is the development of a suitable research platform. While cloud computing is primarily commercially-driven and commercial clouds are naturally realistic as research platforms, they do not provide to the scientist enough control for dependable experiments. On the other hand, research carried out using simulation, mathematical modelling or small prototypes may not necessarily be applicable in real clouds of larger scale. Previous surveys on cloud performance and energy-efficiency have focused on the technical mechanisms proposed to address these issues. Researchers of various disciplines and expertise can use them to identify areas where they can contribute with innovative technical solutions. This paper is meant to be complementary to these surveys. By providing the landscape of research platforms for cloud systems, our aim is to help researchers identify a suitable approach for modelling, simulation or prototype implementation on which they can develop and evaluate their technical solutions.

[1]  Liam O'Brien,et al.  On a Catalogue of Metrics for Evaluating Commercial Cloud Services , 2012, 2012 ACM/IEEE 13th International Conference on Grid Computing.

[2]  Henri Casanova,et al.  Scheduling distributed applications: the SimGrid simulation framework , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[3]  George Loukas,et al.  On the Feasibility of Automated Semantic Attacks in the Cloud , 2012, ISCIS.

[4]  Fabien Hermenier,et al.  Cluster-wide context switch of virtualized jobs , 2010, HPDC '10.

[5]  Wilhelm Hasselbring,et al.  Cloud User-Centric Enhancements of the Simulator CloudSim to Improve Cloud Deployment Option Analysis , 2012, ESOCC.

[6]  Gabriel Antoniu,et al.  A performance evaluation of Azure and Nimbus clouds for scientific applications , 2012, CloudCP '12.

[7]  Albert Y. Zomaya,et al.  A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems , 2010, Adv. Comput..

[8]  Wei Lu,et al.  AzureBlast: a case study of developing science applications on the cloud , 2010, HPDC '10.

[9]  Xiaohong Jiang,et al.  An Energy-Efficient Scheme for Cloud Resource Provisioning Based on CloudSim , 2011, 2011 IEEE International Conference on Cluster Computing.

[10]  Srivatsan Jagannathan,et al.  Comparison and Evaluation of Open-source Cloud Management Software , 2012 .

[11]  Gagan Agrawal,et al.  Evaluating caching and storage options on the Amazon Web Services Cloud , 2010, 2010 11th IEEE/ACM International Conference on Grid Computing.

[12]  Christian Baun,et al.  Performance Measurement of a Private Cloud in the OpenCirrusTM Testbed , 2009, Euro-Par Workshops.

[13]  Giovanni Giuliani,et al.  Cloud computing and its interest in saving energy: the use case of a private cloud , 2012, Journal of Cloud Computing: Advances, Systems and Applications.

[14]  Ian T. Foster,et al.  GangSim: a simulator for grid scheduling studies , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[15]  Daniel A. Menascé,et al.  TPC-W: A Benchmark for E-Commerce , 2002, IEEE Internet Comput..

[16]  Marty Humphrey,et al.  A quantitative analysis of high performance computing with Amazon's EC2 infrastructure: The death of the local cluster? , 2009, 2009 10th IEEE/ACM International Conference on Grid Computing.

[17]  Liang Zhong,et al.  EnaCloud: An Energy-Saving Application Live Placement Approach for Cloud Computing Environments , 2009, 2009 IEEE International Conference on Cloud Computing.

[18]  Yaser Jararweh,et al.  TeachCloud: a cloud computing educational toolkit , 2013, Int. J. Cloud Comput..

[20]  Renato Figueiredo,et al.  Science Clouds: Early Experiences in Cloud Computing for Scientific Applications , 2008 .

[21]  Alexandru Iosup,et al.  GRENCHMARK: A Framework for Analyzing, Testing, and Comparing Grids , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[22]  Antonio Corradi,et al.  VM consolidation: A real case based on OpenStack Cloud , 2014, Future Gener. Comput. Syst..

[23]  Glauco Estácio Gonçalves,et al.  A Survey on Open-source Cloud Computing Solutions , 2010 .

[24]  Jianxin Li,et al.  CyberGuarder: A virtualization security assurance architecture for green cloud computing , 2012, Future Gener. Comput. Syst..

[25]  Helen D. Karatza,et al.  Evaluation of gang scheduling performance and cost in a cloud computing system , 2010, The Journal of Supercomputing.

[26]  Xiaohui Gu,et al.  CloudScale: elastic resource scaling for multi-tenant cloud systems , 2011, SoCC.

[27]  Chandra Krintz,et al.  An Evaluation of Distributed Datastores Using the AppScale Cloud Platform , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[28]  Changsheng Xie,et al.  Avoiding performance fluctuation in cloud storage , 2010, 2010 International Conference on High Performance Computing.

[29]  Rolf Stadler,et al.  Dynamic resource allocation with management objectives—Implementation for an OpenStack cloud , 2012, 2012 8th international conference on network and service management (cnsm) and 2012 workshop on systems virtualiztion management (svm).

[30]  Feng Zhao,et al.  Energy aware consolidation for cloud computing , 2008, CLUSTER 2008.

[31]  Alexandru Iosup,et al.  A Performance Analysis of EC2 Cloud Computing Services for Scientific Computing , 2009, CloudComp.

[32]  Chita R. Das,et al.  MDCSim: A multi-tier data center simulation, platform , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[33]  Yasir Saleem,et al.  Network Simulator NS-2 , 2015 .

[34]  Srinath Perera,et al.  WSO2 Stratos: An Application Stack to Support Cloud Computing , 2011, it Inf. Technol..

[35]  Rocco Aversa,et al.  Proceedings of the Federated Conference on Computer Science and Information Systems pp. 973–980 ISBN 978-83-60810-22-4 An Analysis of mOSAIC ontology for Cloud Resources annotation , 2022 .

[36]  Abdellatif Medouri,et al.  Towards a next generation ofscientific c omputing in the Cloud , 2012 .

[37]  Jean-Marc Menaud,et al.  btrScript : a safe management system for virtualized data center , 2012, ICAS 2012.

[38]  Ernesto Damiani,et al.  Scalability Patterns for Platform-as-a-Service , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[39]  Rajkumar Buyya,et al.  GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing , 2002, Concurr. Comput. Pract. Exp..

[40]  Antonio Puliafito,et al.  Improving Virtual Machine Migration in Federated Cloud Environments , 2010, 2010 2nd International Conference on Evolving Internet.

[41]  Jesús Carretero,et al.  Design of a New Cloud Computing Simulation Platform , 2011, ICCSA.

[42]  Rajkumar Buyya,et al.  CloudSim: A Novel Framework for Modeling and Simulation of Cloud Computing Infrastructures and Services , 2009, ArXiv.

[43]  Hamed Mohsenian Rad,et al.  Optimal integration of renewable energy resources in data centers with behind-the-meter renewable generator , 2012, 2012 IEEE International Conference on Communications (ICC).

[44]  Rodney S. Tucker,et al.  Green Cloud Computing: Balancing Energy in Processing, Storage, and Transport , 2011, Proceedings of the IEEE.

[45]  Alexandru Iosup,et al.  On the Performance Variability of Production Cloud Services , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[46]  Jean-Marc Menaud,et al.  Performance and Power Management for Cloud Infrastructures , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[47]  Jorge-Arnulfo Quiané-Ruiz,et al.  Runtime measurements in the cloud , 2010, Proc. VLDB Endow..

[48]  Robert L. Grossman,et al.  The Open Cloud Testbed: A Wide Area Testbed for Cloud Computing Utilizing High Performance Network Services , 2009, ArXiv.

[49]  M. Tech Student,et al.  Improvising the Infrastructure as a Service Cloud , 2012 .

[50]  Yasushi Inoguchi,et al.  Performance evaluation of a Green Scheduling Algorithm for energy savings in Cloud computing , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[51]  Xavier Perramon,et al.  Improving the quality of the Practicum. The use of Moodle and Google Docs in monitoring the Practicum process after the EHEA , 2012 .

[52]  Kevin Lee,et al.  How a consumer can measure elasticity for cloud platforms , 2012, ICPE '12.

[53]  Jesús Carretero,et al.  iCanCloud: A Flexible and Scalable Cloud Infrastructure Simulator , 2012, Journal of Grid Computing.

[54]  Kurt Maly,et al.  Analysis of Energy Efficiency in Clouds , 2009, 2009 Computation World: Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns.

[55]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[56]  Richard Wolski,et al.  The Eucalyptus Open-Source Cloud-Computing System , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[57]  Jesús Carretero,et al.  SIMCAN: a SIMulator framework for computer architectures and storage networks , 2008, SimuTools.

[58]  Amir-Hamed Mohsenian-Rad,et al.  Energy-Information Transmission Tradeoff in Green Cloud Computing , 2010 .

[59]  Erol Gelenbe,et al.  Choosing a Local or Remote Cloud , 2012, 2012 Second Symposium on Network Cloud Computing and Applications.

[60]  Tom White,et al.  Hadoop: The Definitive Guide , 2009 .

[61]  Jianxin Li,et al.  An Efficient Resource Management System for On-Line Virtual Cluster Provision , 2009, 2009 IEEE International Conference on Cloud Computing.

[62]  Wei Lu,et al.  Performing Large Science Experiments on Azure: Pitfalls and Solutions , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[63]  Gang Yin,et al.  Online Self-Reconfiguration with Performance Guarantee for Energy-Efficient Large-Scale Cloud Computing Data Centers , 2010, 2010 IEEE International Conference on Services Computing.

[64]  Rajkumar Buyya,et al.  Environment-conscious scheduling of HPC applications on distributed Cloud-oriented data centers , 2011, J. Parallel Distributed Comput..

[65]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[66]  Rajkumar Buyya,et al.  Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers , 2010, MGC '10.

[67]  Qin Li,et al.  CIVIC: a Hypervisor based Virtual Computing Environment , 2007, 2007 International Conference on Parallel Processing Workshops (ICPPW 2007).

[68]  Antonio Puliafito,et al.  How to Enhance Cloud Architectures to Enable Cross-Federation , 2010, IEEE CLOUD.

[69]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[70]  Jean-Yves Marion,et al.  LARGE-SCALE MALWARE EXPERIMENTS: WHY, HOW, AND SO WHAT? , 2010 .

[71]  Evangelos Koukis.  ~okeanos IaaS , 2012 .

[72]  Ross Mcnab,et al.  Simjava: A Discrete Event Simulation Library For Java , 1998 .

[73]  Dejan S. Milojicic,et al.  Open Cirrus: A Global Cloud Computing Testbed , 2010, Computer.

[74]  Ian Lumb,et al.  A Taxonomy and Survey of Cloud Computing Systems , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[75]  Rim Moussa.  Massive Data Analytics in the Cloud: TPC-H Experience on Hadoop Clusters , 2012, Int. J. Web Appl..

[76]  Massimiliano Rak,et al.  Intrusion Tolerance in Cloud Applications: The mOSAIC Approach , 2012, 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems.

[77]  Alexandru Iosup,et al.  Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing , 2011, IEEE Transactions on Parallel and Distributed Systems.

[78]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[79]  Rajkumar Buyya,et al.  NetworkCloudSim: Modelling Parallel Applications in Cloud Simulations , 2011, 2011 Fourth IEEE International Conference on Utility and Cloud Computing.

[80]  Dzmitry Kliazovich,et al.  GreenCloud: a packet-level simulator of energy-aware cloud computing data centers , 2010, The Journal of Supercomputing.

[81]  Daniel A. Menascé,et al.  TPC-W: a benchmark for E-commerce - Internet Computing, IEEE , 2001 .

[82]  Helen D. Karatza,et al.  Performance and cost evaluation of Gang Scheduling in a Cloud Computing system with job migrations and starvation handling , 2011, 2011 IEEE Symposium on Computers and Communications (ISCC).

[83]  Xue-Jie Zhang,et al.  Comparison of open-source cloud management platforms: OpenStack and OpenNebula , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[84]  Erol Gelenbe,et al.  Investigating the Tradeoffs between Power Consumption and Quality of Service in a Backbone Network , 2013, Future Internet.

[85]  Gregor von Laszewski,et al.  Efficient resource management for Cloud computing environments , 2010, International Conference on Green Computing.