Extending Open Rating Systems for Ontology Ranking and Reuse

Ontology reuse saves costs and improves interoperability between ontologies. Knowing which ontology to reuse is difficult without having a quality assessment. We employ user ratings to determine the user-perceived quality of ontologies. The combination of an Open Rating System (ORS), user ratings, and information on trust between users, allow us to compute a personalized ranking of ontologies. In this paper, we present our extension, the Topic-Specific Trust Open Rating System (TS-ORS). To overcome the limitations of the ORS, the TS-ORS features topic-specific trust and multi-faceted ratings. In a user study, we show that having user ratings and result ranking based on a TS-ORS significantly facilitates ontology assessment and selection for the end user.

[1]  R. Fisher.  On the Interpretation of χ 2 from Contingency Tables , and the Calculation of P Author , 2022 .

[2]  Holger Lewen.  Simulation-based Evaluation of the Topic-Specific Trust Open Rating System , 2009 .

[3]  Mathieu d'Aquin,et al.  Cupboard - A Place to Expose Your Ontologies to Applications and the Community , 2009, ESWC.

[4]  Enrico Motta,et al.  Collaborative Semantic Authoring , 2008, IEEE Intelligent Systems.

[5]  R. Guha,et al.  Open Rating Systems , 2002 .

[6]  Lora Aroyo,et al.  The Semantic Web: Research and Applications , 2009, Lecture Notes in Computer Science.

[7]  F. Yates.  Contingency Tables Involving Small Numbers and the χ2 Test , 1934 .

[8]  Ramanathan V. Guha,et al.  Propagation of trust and distrust , 2004, WWW '04.

[9]  R. Fildes.  Journal of the Royal Statistical Society (B): Gary K. Grunwald, Adrian E. Raftery and Peter Guttorp, 1993, “Time series of continuous proportions”, 55, 103–116.☆ , 1993 .

[10]  Elena Paslaru Bontas Simperl,et al.  ONTOCOM Revisited: Towards Accurate Cost Predictions for Ontology Development Projects , 2009, ESWC.

[11]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[12]  R. Fisher.  On the Interpretation of χ2 from Contingency Tables, and the Calculation of P , 2018, Journal of the Royal Statistical Society Series A (Statistics in Society).

[13]  Aldo Gangemi,et al.  Modelling Ontology Evaluation and Validation , 2006, ESWC.

[14]  Ramanathan V. Guha,et al.  User Ratings of Ontologies: Who Will Rate the Raters? , 2005, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[15]  Sharon L. Milgram,et al.  The Small World Problem , 1967 .