Topic-Specific Trust and Open Rating Systems: An Approach for Ontology Evaluation

To achieve better interoperability among intelligent applications, and to relieve knowledge engineers from the burden of developing ontologies from scratch, it is critical to reuse ontologies. However, there are two main reasons why the reuse of ontologies is rare: (1) current ontology repositories allow only simple keyword-based search facilities, and (2) even when a user finds an ontology, the information about the ontology quality and (re)usability is not available. In this paper, we present an Open Rating System based approach for ontology evaluation. The core Open Rating System model is extended with topic-specific trust to provide more accurate personalized ontology rankings. Our model is partially implemented in Knowledge Zone—a webbased ontology repository where users can submit their ontologies, annotate them with metadata, search for existing ontologies, find out their rankings based on user reviews, post their own reviews, and rate reviews.

[1]  Asunción Gómez-Pérez,et al.  ONTOMETRIC: A Method to Choose the Appropriate Ontology , 2004, J. Database Manag..

[2]  Marko Grobelnik,et al.  A SURVEY OF ONTOLOGY EVALUATION TECHNIQUES , 2005 .

[3]  Yugyung Lee,et al.  OntoKhoj: a semantic web portal for ontology searching, ranking and classification , 2003, WIDM '03.

[4]  Nicola Guarino,et al.  Supporting ontological analysis of taxonomic relationships , 2001, Data Knowl. Eng..

[5]  Timothy W. Finin,et al.  Swoogle: a search and metadata engine for the semantic web , 2004, CIKM '04.

[6]  Yugyung Lee,et al.  Characterizing Quality of Knowledge on Semantic Web , 2004, FLAIRS Conference.

[7]  Jennifer Golbeck,et al.  Computing and Applying Trust in Web-based Social Networks , 2005 .

[8]  Daniel L. Rubin,et al.  Knowledge Zone: A Public Repository of Peer-Reviewed Biomedical Ontologies , 2007, MedInfo.

[9]  James A. Hendler,et al.  Spinning the Semantic Web: Bringing the World Wide Web to Its Full Potential , 2002 .

[10]  Keith E. Williamson,et al.  Ontology reuse and application , 1998 .

[11]  Gobinda G. Chowdhury,et al.  Spinning the Semantic Web: Bringing the World Wide Web to Its Full Potential , 2004 .

[12]  Peter Haase,et al.  OMV – Ontology Metadata Vocabulary , 2005 .

[13]  Deborah L. McGuinness,et al.  Ontologies Come of Age , 2003, Spinning the Semantic Web.

[14]  Ramanathan V. Guha,et al.  Propagation of trust and distrust , 2004, WWW '04.

[15]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[16]  R. Guha,et al.  Open Rating Systems , 2002 .

[17]  Ramanathan V. Guha,et al.  User Ratings of Ontologies: Who Will Rate the Raters? , 2005, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[18]  Carl Bedingfield Review of "Spinning the semantic web: Bringing the world wide web to its full potential" edited by Dieter Fensel, James Hendler, Henry Lieberman, and Wolfgang Wahlster, The MIT press , 2003, UBIQ.