Evaluation Metrics for Ontology Complexity and Evolution Analysis

With the tremendous development in size, the complexity of ontology increases. Thus ontology evaluation becomes extremely important for developers to determine the fundamental characteristics of ontologies in order to improve the quality, estimate cost and reduce future maintenance. Our research examines the concepts and their hierarchy in conceptual model, the common feature of the most ontologies, which reflects the fundamental complexity. We suggest a well-defined metrics suite of complexity, which mainly examine the quantity, ratio and correlativity of concepts and relationships, to evaluate ontologies from the viewpoint of complexity and its evolution. In the study, we measure three ontologies in GO to verify our metrics. The results indicate that this metrics suite works well, and the biological process ontology is the most complex one from the view of complexity, and the molecular function ontology is the unsteadiest one from the view of evolution

[1]  Vijayan Sugumaran,et al.  Assessing the Effectiveness of the DAML Ontologies for the Semantic Web , 2003, NLDB.

[2]  Letha H. Etzkorn,et al.  Cohesion Metrics for Ontology Design and Application , 2005 .

[3]  Michel C. A. Klein,et al.  Ontology Evolution: Not the Same as Schema Evolution , 2004, Knowledge and Information Systems.

[4]  Michel C. A. Klein,et al.  Ontology versioning on the Semantic Web , 2001, SWWS.

[5]  Tore Risch,et al.  EDUTELLA: a P2P networking infrastructure based on RDF , 2002, WWW.

[6]  Yuval Shahar,et al.  Representation of change in controlled medical terminologies , 1999, Artif. Intell. Medicine.

[7]  Boris Motik,et al.  User-Driven Ontology Evolution Management , 2002, EKAW.

[8]  Natalya F. Noy,et al.  A Component-Based Framework For Ontology Evolution , 2003 .

[9]  Wei Wu,et al.  Industrial Strength Ontology Management , 2001, The Emerging Semantic Web.

[10]  Steffen Staab,et al.  Knowledge Processes and Ontologies , 2001, IEEE Intell. Syst..

[11]  Ron Weber,et al.  Research Commentary: Information Systems and Conceptual Modeling - A Research Agenda , 2002, Inf. Syst. Res..

[12]  Helena Sofia Pinto,et al.  Evolving Ontologies in Distributed and Dynamic Settings , 2002, KR.

[13]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[14]  Asunción Gómez-Pérez,et al.  A Roadmap to Ontology Specification Languages , 2000, EKAW.

[15]  Baowen Xu,et al.  A complexity measure for ontology based on UML , 2004, Proceedings. 10th IEEE International Workshop on Future Trends of Distributed Computing Systems, 2004. FTDCS 2004..

[16]  Boris Motik,et al.  Ontology Evolution within Ontology Editors , 2002, EON.

[17]  James A. Hendler,et al.  Semi-automatic Composition ofWeb Services using Semantic Descriptions , 2003, WSMAI.

[18]  Idris Hsi,et al.  Analyzing the Conceptual Coherence of Computing Applications Through Ontological Excavation , 2004 .