Software Testing Techniques Revisited for OWL Ontologies

Ontologies are an essential component of semantic knowledge bases and applications, and nowadays they are used in a plethora of domains. Despite the maturity of ontology languages, support tools and engineering techniques, the testing and validation of ontologies is a field which still lacks consolidated approaches and tools. This paper attempts at partly bridging that gap, taking a first step towards the extension of some traditional software testing techniques to ontologies expressed in a widely-used format. Mutation testing and coverage testing, revisited in the light of the peculiar features of the ontology language and structure, can can assist in designing better test suites to validate them, and overall help in the engineering and refinement of ontologies and software based on them.

[1]  Cesare Bartolini,et al.  Mutating OWLs: Semantic Mutation Testing for Ontologies , 2016, AMARETTO@MODELSWARD.

[2]  A. Jefferson Offutt,et al.  Mutation 2000: uniting the orthogonal , 2001 .

[3]  Leon J Osterweil,et al.  Data Flow Analysis as an Aid in Documentation, Assertion, Generation, Validation, and Error Detection ; CU-CS-055-74 , 1974 .

[4]  Mark Harman,et al.  An Analysis and Survey of the Development of Mutation Testing , 2011, IEEE Transactions on Software Engineering.

[5]  Yves Le Traon,et al.  Mutation Analysis Testing for Model Transformations , 2006, ECMDA-FA.

[6]  Li Ma,et al.  Towards a Complete OWL Ontology Benchmark , 2006, ESWC.

[7]  Eva Blomqvist,et al.  Ontology Testing - Methodology and Tool , 2012, EKAW.

[8]  Frank van Harmelen,et al.  Web Ontology Language: OWL , 2004, Handbook on Ontologies.

[9]  Aldo Gangemi,et al.  Modelling Ontology Evaluation and Validation , 2006, ESWC.

[10]  Pompeu Casanovas,et al.  Ontology-Driven Legal Support-System in the Air Transport Passenger Domain , 2014, SW4LAW+DC@JURIX.

[11]  A. Jefferson Offutt,et al.  MuJava: an automated class mutation system , 2005, Softw. Test. Verification Reliab..

[12]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[13]  Paul Ammann,et al.  Building Testing Tools , 2008 .

[14]  Cristiana Santos,et al.  Using Ontologies to Model Data Protection Requirements in Workflows , 2015, JSAI-isAI Workshops.

[15]  A. Jefferson Offutt,et al.  A semantic model of program faults , 1996, ISSTA '96.

[16]  A. J. Offutt.  A practical system for mutation testing: help for the common programmer , 1994, Proceedings., International Test Conference.

[17]  Juan-Zi Li,et al.  Ontology-Based Test Case Generation for Testing Web Services , 2007, Eighth International Symposium on Autonomous Decentralized Systems (ISADS'07).

[18]  Cesare Bartolini,et al.  Reconciling Data Protection Rights and Obligations: An Ontology of the Forthcoming EU Regulation , 2015 .

[19]  Deborah L. McGuinness,et al.  An Environment for Merging and Testing Large Ontologies , 2000, KR.

[20]  Robert Stevens,et al.  The Manchester OWL Syntax , 2006, OWLED.

[21]  Hong Zhu,et al.  Software unit test coverage and adequacy , 1997, ACM Comput. Surv..

[22]  Pompeu Casanovas,et al.  A model of Air Transport Passenger Incidents and Rights , 2014, JURIX.

[23]  William E. Howden,et al.  Weak Mutation Testing and Completeness of Test Sets , 1982, IEEE Transactions on Software Engineering.

[24]  Dieter Pfoser.  Indexing the Trajectories of Moving Objects , 2002 .

[25]  Qian Yang,et al.  A survey of coverage based testing tools , 2006, AST '06.

[26]  Viviane Reding.  The Upcoming Data Protection Reform for the European Union , 2011 .

[27]  Asunción Gómez-Pérez,et al.  Common Pitfalls in Ontology Development , 2009, CAEPIA.

[28]  Luciano Serafini,et al.  An Ontological Framework for Decision Support , 2012, JIST.

[29]  J. C. Huang,et al.  An Approach to Program Testing , 1975, CSUR.

[30]  John A. Clark,et al.  Semantic Mutation Testing , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[31]  Vijayan Sugumaran,et al.  A semiotic metrics suite for assessing the quality of ontologies , 2005, Data Knowl. Eng..

[32]  Ian Horrocks,et al.  What Are Ontologies Good For , 2013 .

[33]  M R Quillian,et al.  Word concepts: a theory and simulation of some basic semantic capabilities. , 1967, Behavioral science.

[34]  Michael Marcotty,et al.  A genealogy of control structures , 1975, CACM.

[35]  Yinong Chen,et al.  Automatic Mutation Testing and Simulation on OWL-S Specified Web Services , 2008, 41st Annual Simulation Symposium (anss-41 2008).

[36]  Jeffrey K. Hollingsworth,et al.  Efficient instrumentation for code coverage testing , 2002, ISSTA '02.

[37]  Nicola Guarino,et al.  An Overview of OntoClean , 2004, Handbook on Ontologies.

[38]  Richard G. Hamlet,et al.  Testing Programs with the Aid of a Compiler , 1977, IEEE Transactions on Software Engineering.

[39]  Johanna Völker,et al.  Knowledge Engineering and Knowledge Management , 2012, Lecture Notes in Computer Science.

[40]  Eda Marchetti,et al.  Data Flow-Based Validation of Web Services Compositions: Perspectives and Examples , 2008, WADS.

[41]  Abraham Otero,et al.  OntologyTest: A Tool to Evaluate Ontologies through Tests Defined by the User , 2009, IWANN.

[42]  Aldo Gangemi,et al.  Unit Tests for Ontologies , 2006, OTM Workshops.

[43]  Gregg Rothermel,et al.  An experimental determination of sufficient mutant operators , 1996, TSEM.

[44]  Arno Scharl,et al.  Automated Ontology Learning and Validation Using Hypothesis Testing , 2007, AWIC.

[45]  Jerry R. Hobbs,et al.  DAML-S: Semantic Markup for Web Services , 2001, SWWS.

[46]  Alan L. Rector,et al.  Debugging OWL-DL Ontologies: A Heuristic Approach , 2005, SEMWEB.

[47]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[48]  Edith Schonberg,et al.  A View of OWL From the Field: Use-cases and Experiences , 2006, OWLED.

[49]  Asunción Gómez-Pérez,et al.  Validating Ontologies with OOPS! , 2012, EKAW.

[50]  Paul Ammann,et al.  Syntax-Based Testing , 2008 .