OOPS! (OntOlogy Pitfall Scanner!): An On-line Tool for Ontology Evaluation

This paper presents two contributions to the field of Ontology Evaluation. First, a live catalogue of pitfalls that extends previous works on modeling errors with new pitfalls resulting from an empirical analysis of over 693 ontologies. Such a catalogue classifies pitfalls according to the Structural, Functional and Usability-Profiling dimensions. For each pitfall, we incorporate the value of its importance level (critical, important and minor) and the number of ontologies where each pitfall has been detected. Second, OOPS! (OntOlogy Pitfall Scanner!), a tool for detecting pitfalls in ontologies and targeted at newcomers and domain experts unfamiliar with description logics and ontology implementation languages. The tool operates independently of any ontology development platform and is available online. The evaluation of the system is provided both through a survey of users' satisfaction and worldwide usage statistics. In addition, the system is also compared with existing ontology evaluation tools in terms of coverage of pitfalls detected.

[1]  Andreas Harth,et al.  Weaving the Pedantic Web , 2010, LDOW.

[2]  Tom Heath,et al.  Linked Data: Evolving the Web into a Global Data Space , 2011, Linked Data.

[3]  Marietjie Schutte.  The Semantic Web for Knowledge and Data Management: Technologies and Practices , 2009 .

[4]  Asunción Gómez-Pérez,et al.  Natural Language-Based Approach for Helping in the Reuse of Ontology Design Patterns , 2008, EKAW.

[5]  Nicola Guarino,et al.  An Overview of OntoClean , 2004, Handbook on Ontologies.

[6]  Jeff Z. Pan,et al.  The Ubiquitous Semantic Web: Promises, Progress and Challenges , 2014, Int. J. Semantic Web Inf. Syst..

[7]  Asunción Gómez-Pérez,et al.  Detecting Good Practices and Pitfalls when Publishing Vocabularies on the Web , 2013, WOP.

[8]  A. Sheth.  International Journal on Semantic Web & Information Systems , .

[9]  Rim Djedidi,et al.  ONTO-EVOAL an Ontology Evolution Approach Guided by Pattern Modeling and Quality Evaluation , 2010, FoIKS.

[10]  Asunción Gómez-Pérez,et al.  Building a chemical ontology using Methontology and the Ontology Design Environment , 1999, IEEE Intell. Syst..

[11]  Manuel P. Cuéllar,et al.  A survey on ontologies for human behavior recognition , 2014, ACM Comput. Surv..

[12]  Steffen Staab,et al.  Knowledge Processes and Ontologies , 2001, IEEE Intell. Syst..

[13]  Asunción Gómez-Pérez,et al.  Lights and shadows in creating a glossary about ontology engineering , 2013 .

[14]  Martin Boeker,et al.  OntoCheck: verifying ontology naming conventions and metadata completeness in Protégé 4 , 2012, J. Biomed. Semant..

[15]  Mihály Héder,et al.  Semantic Web for the Working Ontologist, Second dition: Effective modeling in RDFS and OWL by Allemang Dean and Hendler James, Morgan Kaufmann, 384 pp., $55, ISBN 0-123-85965-4 , 2013, The Knowledge Engineering Review.

[16]  Asunción Gómez-Pérez,et al.  Ontology Engineering in a Networked World , 2012, Springer Berlin Heidelberg.

[17]  Asunción Gómez-Pérez,et al.  Validating Ontologies with OOPS! , 2012, EKAW.

[18]  Vijayan Sugumaran,et al.  A semiotic metrics suite for assessing the quality of ontologies , 2005, Data Knowl. Eng..

[19]  Nathalie Aussenac-Gilles,et al.  OQuaRE: A SQuaRE-based Approach for Evaluating the Quality of Ontologies , 2011, J. Res. Pract. Inf. Technol..

[20]  Aldo Gangemi,et al.  Modelling Ontology Evaluation and Validation , 2006, ESWC.

[21]  María Poveda-Villalón,et al.  Benefits of Natural Language Techniques in Ontology Evaluation : the OOPS! Case , 2013 .

[22]  Darijus Strasunskas,et al.  The role of ontology in enhancing semantic searches: the EvOQS framework and its initial validation , 2008, Int. J. Knowl. Learn..

[23]  R. L. Winkler,et al.  Statistics : Probability, Inference and Decision , 1975 .

[24]  R. Doyle.  The American terrorist. , 2001, Scientific American.

[25]  N. F. Noy,et al.  Ontology Development 101: A Guide to Creating Your First Ontology , 2001 .

[26]  Bruce E. Barrett,et al.  Decision quality using ranked attribute weights , 1996 .

[27]  Steffen Stadtmüller,et al.  RaDON - Repair and Diagnosis in Ontology Networks , 2009, ESWC.

[28]  Aldo Gangemi,et al.  Experiments on pattern-based ontology design , 2009, K-CAP '09.

[29]  María Poveda-Villalón,et al.  The Current Landscape of Pitfalls in Ontologies , 2013, KEOD.

[30]  Tim Berners-Lee,et al.  Linked data , 2020, Semantic Web for the Working Ontologist.

[31]  Robert Stevens,et al.  OWL Pizzas: Practical Experience of Teaching OWL-DL: Common Errors & Common Patterns , 2004, EKAW.

[32]  Francesco M. Donini,et al.  Semantic-Based Bluetooth-RFID Interaction for Advanced Resource Discovery in Pervasive Contexts , 2008, Int. J. Semantic Web Inf. Syst..

[33]  Asunción Gómez-Pérez,et al.  A Double Classification of Common Pitfalls in Ontologies , 2010 .

[34]  Steffen Staab,et al.  DILIGENT: Towards a fine-grained methodology for Distributed, Loosely-controlled and evolving Engineering of oNTologies , 2004, ECAI.