A methodology for validating cloud models using metamorphic testing

Cloud computing is a paradigm that provides access to a flexible, elastic and on-demand computing infrastructure, allowing users to dynamically request virtual resources. However, researchers typically cannot experiment with critical parts of cloud systems such as the underlying cloud architecture, resource-provisioning policies and the configuration of resource virtualisation. This problem can be partially addressed through using simulations of cloud systems. Unfortunately, the problem of testing cloud systems is still challenging due to the many parameters that such systems typically have and the difficulty in determining whether an observed behaviour is correct. In order to alleviate these issues, we propose a methodology to semi-automatically test and validate cloud models by integrating simulation techniques and metamorphic testing.

[1]  Jesús Carretero,et al.  iCanCloud: A Flexible and Scalable Cloud Infrastructure Simulator , 2012, Journal of Grid Computing.

[2]  Yves Le Traon,et al.  Model-Based Testing for the Cloud , 2010, Practical Software Testing: Tool Automation and Human Factors.

[3]  Zhenyu Zhang,et al.  Modeling and testing of cloud applications , 2009, 2009 IEEE Asia-Pacific Services Computing Conference (APSCC).

[4]  Robert M. Hierons,et al.  Implementation relations and test generation for systems with distributed interfaces , 2011, Distributed Computing.

[5]  Rajkumar Buyya,et al.  A toolkit for modelling and simulating data Grids: an extension to GridSim , 2008, Concurr. Comput. Pract. Exp..

[6]  Paloma Martínez,et al.  Toward an Equal Opportunity Web: Applications, Standards, and Tools that Increase Accessibility , 2011, Computer.

[7]  Jesús Carretero,et al.  SIMCAN: A flexible, scalable and expandable simulation platform for modelling and simulating distributed architectures and applications , 2012, Simul. Model. Pract. Theory.

[8]  Robert M. Hierons,et al.  Mutation Testing , 2010, Encyclopedia of Software Engineering.

[9]  Huai Liu,et al.  A Metamorphic Relation-Based Approach to Testing Web Services Without Oracles , 2012, Int. J. Web Serv. Res..

[10]  Dzmitry Kliazovich,et al.  GreenCloud: A Packet-Level Simulator of Energy-Aware Cloud Computing Data Centers , 2010, GLOBECOM.

[11]  Rajkumar Buyya,et al.  Power-aware provisioning of Cloud resources for real-time services , 2009, MGC '09.

[12]  Rajkumar Buyya,et al.  Energy-Efficient Management of Data Center Resources for Cloud Computing: A Vision, Architectural Elements, and Open Challenges , 2010, PDPTA.

[13]  Stephen S. Yau,et al.  Testing context-sensitive middleware-based software applications , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[14]  George Candea,et al.  Cloud9: a software testing service , 2010, OPSR.

[15]  Rajkumar Buyya,et al.  Building an automated and self‐configurable emulation testbed for grid applications , 2010, Softw. Pract. Exp..

[16]  Jesús Carretero,et al.  E-mc2: A formal framework for energy modelling in cloud computing , 2013, Simul. Model. Pract. Theory.

[17]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[18]  T. H. Tse,et al.  Data flow testing of service choreography , 2009, ESEC/FSE '09.

[19]  Baowen Xu,et al.  Testing and validating machine learning classifiers by metamorphic testing , 2011, J. Syst. Softw..

[20]  Beatriz Marín,et al.  Towards testing future Web applications , 2011, 2011 FIFTH INTERNATIONAL CONFERENCE ON RESEARCH CHALLENGES IN INFORMATION SCIENCE.

[21]  Karyn Hede News Briefs , 2013, Genetics in Medicine.

[22]  Elaine J. Weyuker,et al.  On Testing Non-Testable Programs , 1982, Comput. J..

[23]  Bruno Schulze,et al.  Proceedings of the 7th International Workshop on Middleware for Grids, Clouds and e-Science , 2009, Middleware 2009.

[24]  Koushik Sen,et al.  PREFAIL: a programmable tool for multiple-failure injection , 2011, OOPSLA '11.

[25]  Rajkumar Buyya,et al.  Modeling and simulation of scalable Cloud computing environments and the CloudSim toolkit: Challenges and opportunities , 2009, 2009 International Conference on High Performance Computing & Simulation.