An Ontology for Guiding Performance Testing

Software test is a technique to obtain information about software systems quality. Performance test is a type of software test that aims at evaluating software performance at a given load scenario, but it requires specialized knowledge about tools, activities and metrics of the domain. Since ontology is a promising knowledge representation technique, this paper presents a literature review to identify trends and compare researches of ontologies in the fields of software testing and software performance. Also, to investigate this issue from a practical perspective, it was developed an ontology for representing the core knowledge of performance testing. This paper presents the ontology and compare it with related ones. Then, semantic technologies are explored to demonstrate the practical feasibility of developing ontology-based applications for assisting testers with performance test planning and management.

[1]  Carlos Juiz,et al.  Performance assessment of intelligent distributed systems through software performance ontology engineering (SPOE) , 2007, Software Quality Journal.

[2]  Weichang Du,et al.  An Ontology-based Software Test Generation Framework , 2010, SEKE.

[3]  Yinong Chen,et al.  Automatic Mutation Testing and Simulation on OWL-S Specified Web Services , 2008, 41st Annual Simulation Symposium (anss-41 2008).

[4]  Elisa Yumi Nakagawa,et al.  Exploring ontologies to support the establishment of reference architectures: An example on software testing , 2009, 2009 Joint Working IEEE/IFIP Conference on Software Architecture & European Conference on Software Architecture.

[5]  Wei-Tek Tsai,et al.  Ontology-Based Test Modeling and Partition Testing of Web Services , 2008, 2008 IEEE International Conference on Web Services.

[6]  Martin J. O'Connor,et al.  SQWRL: A Query Language for OWL , 2009, OWLED.

[7]  Weiqin Tong,et al.  An application of ontology to test case reuse , 2011, 2011 International Conference on Mechatronic Science, Electric Engineering and Computer (MEC).

[8]  Xuexiang Li,et al.  Ontology-Based Testing Platform for Reusing , 2012, 2012 Sixth International Conference on Internet Computing for Science and Engineering.

[9]  Alain Abran,et al.  Guide to the Software Engineering Body of Knowledge : 2004 Version , 2005 .

[10]  Standard Glossary of Software Engineering Terminology , 1990 .

[11]  N. F. Noy,et al.  Ontology Development 101: A Guide to Creating Your First Ontology , 2001 .

[12]  BechhoferSean,et al.  The OWL API: A Java API for OWL ontologies , 2011 .

[13]  Karla Okada,et al.  SwTO I ( Software Test Ontology Integrated ) and its Application in Linux Test , 2009 .

[14]  Weichang Du,et al.  Knowledge-based Software Test Generation , 2009, SEKE.

[15]  2009 15th IEEE Pacific Rim International Symposium on Dependable Computing, PRDC 2009, Shanghai, China, 16-18 November 2009 , 2009, PRDC.

[16]  Carlos Juiz,et al.  An approach to ontology-aided performance engineering through NFR framework , 2007, WOSP '07.

[17]  Hong Zhu,et al.  Ontology for Service Oriented Testing of Web Services , 2008, 2008 IEEE International Symposium on Service-Oriented System Engineering.

[18]  Elisa Yumi Nakagawa,et al.  Towards the Establishment of an Ontology of Software Testing , 2006, SEKE.

[19]  Jongmoon Baik,et al.  A Strategic Test Process Improvement Approach Using an Ontological Description for MND-TMM , 2008, Seventh IEEE/ACIS International Conference on Computer and Information Science (icis 2008).

[20]  Carlos Juiz,et al.  Web Performance and Behavior Ontology , 2008, 2008 International Conference on Complex, Intelligent and Software Intensive Systems.

[21]  Sean Bechhofer,et al.  The OWL API: A Java API for OWL ontologies , 2011, Semantic Web.

[22]  Yarden Katz,et al.  Pellet: A practical OWL-DL reasoner , 2007, J. Web Semant..

[23]  Zhenyu Liu,et al.  Test Case Reuse Based on Ontology , 2009, 2009 15th IEEE Pacific Rim International Symposium on Dependable Computing.

[24]  Hong Zhu,et al.  Collaborative Testing of Web Services , 2012, IEEE Transactions on Services Computing.

[25]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A tertiary study , 2010, Inf. Softw. Technol..

[26]  Juan-Zi Li,et al.  Ontology-Based Test Case Generation for Testing Web Services , 2007, Eighth International Symposium on Autonomous Decentralized Systems (ISADS'07).

[27]  L. Stein,et al.  OWL Web Ontology Language - Reference , 2004 .

[28]  Gu Guochang,et al.  Research and Implementation of Knowledge Management Methods in Software Testing Process , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[29]  Vittorio Cortellessa.  How far are we from the definition of a common software performance ontology? , 2005, WOSP '05.

[30]  Carlos Juiz,et al.  Performance assessment on ambient intelligent applications through ontologies , 2005, WOSP '05.