Evaluation of Ontology Building Methodologies - A Method based on Balanced Scorecards

Ontology building methodologies concern techniques and methods related to ontology creation that starts from capturing ontology users’ requirements and concludes by releasing the final ontology. Despite the several ontology building methodologies (OBMs) developed, endowed with different characteristics, there is not yet a method to evaluate them. This paper describes an evaluation method of OBMs based on Balanced Scorecards (BSCs), a novel approach for strategic management of enterprises that we apply to the assessment of OBMs. Then, as a case study, the proposed evaluation method is applied to the UPON OBM. Finally, we show the major strengths of the BSCs’ multi-disciplinary approach.

[1]  Nicola Guarino,et al.  Evaluating ontological decisions with OntoClean , 2002, CACM.

[2]  Antonio De Nicola,et al.  Benchmarking Criteria to Evaluate Ontology Building Methodologies , 2006, EMOI-INTEROP.

[3]  K. D. Joshi,et al.  A collaborative approach to ontology design , 2002, CACM.

[4]  Volker Haarslev,et al.  Description of the RACER System and its Applications , 2001, Description Logics.

[5]  Steffen Staab,et al.  Ontology Engineering Revisited: An Iterative Case Study , 2006, ESWC.

[6]  Barry W. Boehm,et al.  Software development cost estimation approaches — A survey , 2000, Ann. Softw. Eng..

[7]  R. Dorf,et al.  The Balanced Scorecard: Translating Strategy Into Action , 1997, Proceedings of the IEEE.

[8]  Alain Abran,et al.  How functional size measurement supports the balanced scorecard framework for ICT , 2001 .

[9]  Jean Véronis,et al.  EXTRACTING KNOWLEDGE BASES FROM MACHINE- READABLE DICTIONARIES : HAVE WE WASTED OUR TIME? , 1999 .

[10]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[11]  N. F. Noy,et al.  Ontology Development 101: A Guide to Creating Your First Ontology , 2001 .

[12]  Michael Gruninger,et al.  Methodology for the Design and Evaluation of Ontologies , 1995, IJCAI 1995.

[13]  Darijus Strasunskas,et al.  Choosing Appropriate Method Guidelines for Web-Ontology Building , 2005, ER.

[14]  William E. McCarthy,et al.  The Ontological Foundation of REA Enterprise Information Systems , 2000 .

[15]  Michael Winikoff,et al.  Comparing Agent-Oriented Methodologies , 2003, AOIS.

[16]  Steffen Staab,et al.  On-To-Knowledge Methodology (OTKM) , 2004, Handbook on Ontologies.

[17]  Gómez-PérezAsunción,et al.  Methodologies, tools and languages for building ontologies , 2003 .

[18]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[19]  Antonio De Nicola,et al.  A software engineering approach to ontology building , 2009, Inf. Syst..

[20]  Asunción Gómez-Pérez,et al.  Methodologies, tools and languages for building ontologies: Where is their meeting point? , 2003, Data Knowl. Eng..

[21]  Vijayan Sugumaran,et al.  A semiotic metrics suite for assessing the quality of ontologies , 2005, Data Knowl. Eng..

[22]  York Sure-Vetter,et al.  : A Cost Estimation Model for Ontology Engineering , 2006, SEMWEB.

[23]  Kevin Knight,et al.  Toward Distributed Use of Large-Scale Ontologies t , 1997 .

[24]  Fernandez Lopez,et al.  Overview Of Methodologies For Building Ontologies , 1999, IJCAI 1999.