Usability evaluation of a web-based ontology browser: the case of TSONT

As the use of ontologies expands, their visualization is becoming increasingly important. In this study, an ontology browser for visualizing the Trajectory Simulation ONTology (TSONT) was evaluated in terms of usability by considering its subdimensions, which are effectiveness, efficiency, and user satisfaction. The methodology employed in this study for evaluating an ontology browser is reported along with the results of the evaluation. The TSONT browser is a tree-type ontology browser created to allow developers to visualize TSONT. Six ight simulation programmers with at least one year of experience participated in the study. The participants were given usability tasks and their voices and eye movements were recorded using a sound recorder and eye-tracker, respectively. The results not only showed that guidance and terminology in uence the efficiency, effectiveness, and user satisfaction of the ontology browser, but they also revealed important insights into the requisites of the general usability of ontologies, even in simple text-based interfaces.

[1]  Ian Horrocks,et al.  Description Logics , 2008, Handbook of Knowledge Representation.

[2]  Steffen Lohmann,et al.  WebVOWL: Web-based Visualization of Ontologies , 2014, EKAW.

[3]  Camilla Forsell,et al.  An Introduction and Guide to Evaluation of Visualization Techniques Through User Studies , 2014, Handbook of Human Centric Visualization.

[4]  Jesús Fontecha,et al.  A Context Model based on Ontological Languages: a Proposal for Information Visualization , 2010, J. Univers. Comput. Sci..

[5]  Boris Motik,et al.  Ontology Evolution within Ontology Editors , 2002, EON.

[6]  Olivier Corby,et al.  Assessment of Ontology-based Tools: Systemizing the Scenario Approach , 2002, EON.

[7]  Jakob Nielsen,et al.  Determining Usability Test Sample Size , 2006 .

[8]  Thorsten Pawletta,et al.  Ontology for Objective Flight Simulator Fidelity Evaluation , 2014 .

[9]  Fabio Vitali,et al.  Tools for the Automatic Generation of Ontology Documentation: A Task-Based Evaluation , 2013, Int. J. Semantic Web Inf. Syst..

[10]  Richard N. Shiffman,et al.  Review: Computer-based Guideline Implementation Systems: A Systematic Review of Functionality and Effectiveness , 1999, J. Am. Medical Informatics Assoc..

[11]  Arzu Çöltekin,et al.  Evaluating the Effectiveness of Interactive Map Interface Designs: A Case Study Integrating Usability Metrics with Eye-Movement Analysis , 2009 .

[12]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[13]  Dominique L. Scapin,et al.  User-Centered Evaluation of Information Visualization Techniques: Making the HCI-InfoVis Connection Explicit , 2014, Handbook of Human Centric Visualization.

[14]  Akrivi Katifori,et al.  Ontology visualization methods—a survey , 2007, CSUR.

[15]  Younghwa Lee,et al.  Understanding of website usability: Specifying and measuring constructs and their relationships , 2012, Decis. Support Syst..

[16]  Simone Braun,et al.  The Ontology Maturing Approach for Collaborative and Work Integrated Ontology Development: Evaluation Results and Future Directions , 2007, ESOE.

[17]  James A. Hendler,et al.  Swoop: A Web Ontology Editing Browser , 2006, J. Web Semant..

[18]  A. Gómez-Pérez,et al.  Evaluation of ontologies , 2001, Int. J. Intell. Syst..

[19]  Michael Uschold,et al.  Ontologies: principles, methods and applications , 1996, The Knowledge Engineering Review.

[20]  R. Carvalho,et al.  Ontology Development and Evolution in the Accident Investigation Domain , 2005, 2005 IEEE Aerospace Conference.

[21]  Umut Durak,et al.  Ontology-Based Domain Engineering for Trajectory Simulation Reuse , 2009, Int. J. Softw. Eng. Knowl. Eng..

[22]  Enrico Motta,et al.  Identifying Key Concepts in an Ontology, through the Integration of Cognitive Principles with Statistical and Topological Measures , 2008, ASWC.

[23]  Bo Fu,et al.  Eye tracking the user experience - An evaluation of ontology visualization techniques , 2016, Semantic Web.

[24]  Martin L. King,et al.  Towards a Methodology for Building Ontologies , 1995 .

[25]  Vijayan Sugumaran,et al.  Usability of upper level ontologies: The case of ResearchCyc , 2010, Data Knowl. Eng..

[26]  J R Lewis,et al.  Sample Sizes for Usability Studies: Additional Considerations , 1994, Human factors.

[27]  Enrico Motta,et al.  KC-Viz: A Novel Approach to Visualizing and Navigating Ontologies , 2010, EKAW.

[28]  Riichiro MIZOGUCHI,et al.  Towards Ontology Engineering , 1998 .

[29]  James A. Thom,et al.  Ontology evaluation using wikipedia categories for browsing , 2007, CIKM '07.

[30]  Asunción Gómez-Pérez,et al.  Ontology Evaluation , 2004, Handbook on Ontologies.

[31]  André P. Calitz,et al.  The added value of eye tracking in the usability evaluation of a network management tool , 2005 .

[32]  Thomas R. Gruber,et al.  Toward principles for the design of ontologies used for knowledge sharing? , 1995, Int. J. Hum. Comput. Stud..

[33]  Csongor Nyulas,et al.  WebProtégé: A collaborative ontology editor and knowledge acquisition tool for the Web , 2013, Semantic Web.

[34]  Aldo Gangemi,et al.  The Computational Ontology Perspective: Design Patterns for Web Ontologies , 2011, Approaches to Legal Ontologies.

[35]  Pari Delir Haghighi,et al.  Development and evaluation of ontology for intelligent decision support in medical emergency management for mass gatherings , 2013, Decis. Support Syst..

[36]  Umut Durak,et al.  An Ontology for Trajectory Simulation , 2006, Proceedings of the 2006 Winter Simulation Conference.