Domain Usability Evaluation

Contemporary software systems focus on usability and accessibility from the point of view of effectiveness and ergonomics. However, the correct usage of the domain dictionary and the description of domain relations and properties via their user interfaces are often neglected. We use the term domain usability (DU) to describe the aspects of the user interface related to the terminology and domain. Our experience showed that poor domain usability reduces the memorability and effectiveness of user interfaces. To address this problem, we describe a method called ADUE (Automatic Domain Usability Evaluation) for the automated evaluation of selected DU properties on existing user interfaces. As a prerequisite to the method, metrics for formal evaluation of domain usability, a form stereotype recognition algorithm, and general application terms filtering algorithm have been proposed. We executed ADUE on several real-world Java applications and report our findings. We also provide proposals to modify existing manual usability evaluation techniques for the purpose of domain usability evaluation.

[1]  Jessica Lee,et al.  Benefits of matching domain structure for planning software: the right stuff , 2011, CHI.

[2]  Michaela Bacíková,et al.  Ergonomic vs. domain usability of user interfaces , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[3]  J. C. Flanagan.  Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[4]  Lukas Galko,et al.  Experimental Design of Metrics for Domain Usability , 2017, CHIRA.

[5]  Michaela Ba.  Domain Analysis of Graphical User Interfaces of Software Systems , 2014 .

[6]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[7]  Ben Shneiderman,et al.  Response time and display rate in human performance with computers , 1984, CSUR.

[8]  Ken Eason,et al.  Towards the experimental study of usability , 1984 .

[9]  Authors ’ Information , 2022 .

[10]  Christian Gütl,et al.  Model your application domain, not your JSON structures , 2013, WWW '13 Companion.

[11]  Irina L. Artemieva.  Ontology Development for Domains with Complicated Structures , 2007, KONT/KPP.

[12]  Jaroslav Porubän,et al.  Domain Usability, User’s Perception , 2014 .

[13]  Martin Gaedke,et al.  Current trends in automating usability evaluation of websites: Can you manage what you can't measure? , 2016, 2016 11th International Forum on Strategic Technology (IFOST).

[14]  Christophe Kolski,et al.  State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions , 2010, Int. J. Hum. Comput. Interact..

[15]  Temple,et al.  Developing Likert-Scale Questionnaires , 2014 .

[16]  Michaela Bacíková,et al.  The design of manual domain usability evaluation techniques , 2018, Open Comput. Sci..

[17]  Christophe Kolski,et al.  A Rule-Based Approach to the Ergonomic "Static" Evaluation of Man-Machine Graphic Interface in Industrial Processes , 1991, Int. J. Man Mach. Stud..

[18]  Zoltán Porkoláb,et al.  Automatic classification of semantic user interface services , 2010, ODiSE'10.

[19]  Markus Krötzsch,et al.  Wikidata , 2014 .

[20]  Michaela Bačíková,et al.  Manual techniques for evaluating domain usability , 2017, 2017 IEEE 14th International Scientific Conference on Informatics.

[21]  Maria João Varanda Pereira,et al.  Ontological approach for DSL development , 2016, Comput. Lang. Syst. Struct..

[22]  Michaela Bacíková,et al.  Defining Domain Language of Graphical User Interfaces , 2013, SLATE.

[23]  David E. Kieras,et al.  A Guide to GOMS Model Usability Evaluation using NGOMSL , 1997 .

[24]  Arnold M. Lund,et al.  Expert Ratings of Usability Maxims , 1997 .

[25]  Mehregan Mahdavi,et al.  Fundamental Usability Guidelines for User Interface Design , 2008, 2008 International Conference on Computational Sciences and Its Applications.

[26]  Káthia Marçal de Oliveira,et al.  Standardized Usability Questionnaires: Features and Quality Focus , 2016 .

[27]  Andrew Muddimer,et al.  The effect of experience on system usability scale ratings , 2012 .

[28]  James R. Lewis,et al.  Usability: Lessons Learned … and Yet to Be Learned , 2014, Int. J. Hum. Comput. Interact..

[29]  Cathleen Wharton,et al.  The cognitive walkthrough method: a practitioner's guide , 1994 .

[30]  Brian Shackel,et al.  Usability - Context, framework, definition, design and evaluation , 1991, Interact. Comput..

[31]  Michaela Bacíková,et al.  Experiments with automated evaluation of domain usability , 2016, 2016 9th International Conference on Human System Interactions (HSI).

[32]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[33]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[34]  T S Tullis,et al.  The Formatting of Alphanumeric Displays: A Review and Analysis , 1983, Human factors.

[35]  Michaela Bacikova,et al.  Towards automated evaluation of domain usability , 2015, 2015 IEEE 13th International Scientific Conference on Informatics.

[36]  Toni Granollers,et al.  Assessing Usability Problems in Latin-American Academic Webpages with Cognitive Walkthroughs and Datamining Techniques , 2007, HCI.

[37]  Andrew Sears,et al.  AIDE: a step toward metric-based interface development tools , 1995, UIST '95.

[38]  David F. Feldon,et al.  Cognitive task analysis , 2009 .

[39]  Jacob O. Wobbrock,et al.  Understanding usability practices in complex domains , 2010, CHI.

[40]  Freddy Paz,et al.  Current Trends in Usability Evaluation Methods: A Systematic Review , 2014, 2014 7th International Conference on Advanced Software Engineering and Its Applications.

[41]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[42]  Alexander S. Kleshchev.  How Can Ontologies Contribute to Software Development? , 2007, KONT/KPP.

[43]  David F. Redmiles,et al.  Extracting usability information from user interface events , 2000, CSUR.

[44]  Ben Shneiderman,et al.  Visual and Textual Consistency Checking Tools for Graphical User Interfaces , 1997, IEEE Trans. Software Eng..

[45]  Abdallah Namoune,et al.  A Review of Automated Website Usability Evaluation Tools: Research Issues and Challenges , 2021, HCI.

[46]  Suvi Isohella,et al.  Connecting usability with terminology: Achieving usability by using appropriate terms , 2015, 2015 IEEE International Professional Communication Conference (IPCC).

[47]  Takashi Kato,et al.  What "Question-Asking Protocols" Can Say about the User Interface , 1986, Int. J. Man Mach. Stud..

[48]  Markus Krötzsch,et al.  Wikidata , 2014, Commun. ACM.

[49]  R. M. Young,et al.  Programmable user models for predictive evaluation of interface designs , 1989, CHI.

[50]  Shirley Ann Becker,et al.  A study of web usability for older adults seeking online health resources , 2004, TCHI.