Assessing the User Satisfaction with an Ontology Engineering Tool Based on Social Processes

This study discusses one of the three measures defined within the usability testing, namely the user satisfaction, when evaluating an ontology engineering tool based on social processes. The motivation of our focus lays in the fact that being driven by communities through social interactions, the ontology engineering process depends on what the user does, sees and feels when using the system. The evaluation criteria proposed here are therefore developed by looking at the people involved, the processes and their outcomes, mostly taking into account the user experience, in an approach that goes beyond usability. The paper identifies the problems the users encounter when using the system, both at a technical level and psychometric level. A set of recommendations is proposed in order to overcome these problems and to improve the user experience with the system.

[1]  Robert Meersman,et al.  The Use of Lexicons and Other Computer-Linguistic Tools in Semantics, Design and Cooperation of Database Systems , 1999, CODAS.

[2]  Sang M. Lee,et al.  Assessing the Reliability, Validity and Adaptability of PSSUQ , 2005, AMCIS.

[3]  Andrew Dillon,et al.  Beyond usability: process, outcome and affect in human-computer interactions , 2001 .

[4]  Robert Meersman,et al.  Semantically Unlocking Database Content Through Ontology-Based Mediation , 2004, SWDB.

[5]  Robert Meersman,et al.  GOSPL: A Method and Tool for Fact-Oriented Hybrid Ontology Engineering , 2012, ADBIS.

[6]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[7]  Jonathan Grudin,et al.  Human Computer Interaction: The Year 2000 and Beyond , 1995, HCI.

[8]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[9]  James R. Lewis,et al.  Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies , 2002, Int. J. Hum. Comput. Interact..

[10]  Andrew Dillon,et al.  Group Dynamics Meet Cognition: Combining Socio-Technical Concepts and Usability Engineering in the Design of Information Systems , 2000 .

[11]  Christoph Bussler,et al.  Semantic Web and Databases, Second International Workshop, SWDB 2004, Toronto, Canada, August 29-30, 2004, Revised Selected Papers , 2005, SWDB.

[12]  Daniel A. Bell.  Toward the Year 2000 , 2000 .

[13]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[14]  Robert Meersman,et al.  Semantic Interoperation of Information Systems by Evolving Ontologies through Formalized Social Processes , 2011, ADBIS.

[15]  K. Eason.  Information Technology and Organizational Change , 1989 .