Automation in model-based usability evaluation of adaptive user interfaces by simulating user interaction

The goal of adaptive user interfaces (UI) is offering the opportunity to adapt to changes in the context of use and thus provide potentially improved interaction capabilities for different users in specific situations. But, this poses the challenge of evaluating usability aspects of many different variants of the resulting UI. Consequently, usability evaluations with real users or experts tend to become complex and time-consuming especially in the domain of adaptive UIs. Model-based usability evaluations and specifically automated tools and approaches have proven to correctly predict usability relevant aspects in early stages of development. However, the creation and provision of required models and information tends to be complex and time consuming as well and further requires a high degree of expertise for the specific tool and applied method. This thesis describes an integrated approach that provides automation in model-based usability evaluation based on already existing development models of adaptive UIs. The approach is based on required information for describing the UI surface information and the interaction capabilities of the UI. With the help of this information usability relevant criteria are predicted using specific tools of automated usability evaluation. The implementation of the approach presents integration of an existing runtime framework for adaptive UIs with a cognitive user behavior model for simulation. Information required for simulating interactions is created automatically with the help of the UI development models and by this means saves time and costs when preparing and running simulations. Additionally, with the help of two studies, the resulting predictions are further improved by directly using information encoded in the existing development models without requiring specific expertise from designers and usability experts.

[1]  Peter Wittenburg,et al.  ELAN: a Professional Framework for Multimodality Research , 2006, LREC.

[2]  A. Newell Unified Theories of Cognition , 1990 .

[3]  Jean Vanderdonckt,et al.  Model-Driven Engineering of User Interfaces: Promises, Successes, Failures, and Challenges , 2008 .

[4]  Bonnie E. John,et al.  The Evolution of a Goal-Directed Exploration Model: Effects of Information Scent and GoBack Utility on Successful Exploration , 2011, Top. Cogn. Sci..

[5]  Rob Edlin-White,et al.  User Control in Adaptive User Interfaces for Accessibility , 2013, INTERACT.

[6]  Frank J. Lee,et al.  Simple cognitive modeling in a complex cognitive architecture , 2003, CHI '03.

[7]  Fabio Paternò,et al.  Model-based tools for pervasive usability , 2005, Interact. Comput..

[8]  Albrecht Schmidt,et al.  Implicit human computer interaction through context , 2000, Personal Technologies.

[9]  Elizabeth Boyle,et al.  The Evaluation of Adaptive Systems , 1990 .

[10]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[11]  Benjamin Michotte,et al.  USIXML: A Language Supporting Multi-path Development of User Interfaces , 2004, EHCI/DS-VIS.

[12]  John L. Bennett,et al.  Usability Engineering: Our Experience and Evolution , 1988 .

[13]  Leon Urbas,et al.  Applications for Cognitive User Modeling , 2007, User Modeling.

[14]  Yehya Mohamad,et al.  Prototype of a Virtual User Modeling Software Framework for Inclusive Design of Consumer Products and User Interfaces , 2013, HCI.

[15]  Klaus-Dieter Thoben,et al.  SUPPORTING INCLUSIVE PRODUCT DESIGN WITH VIRTUAL USER MODELS AT THE EARLY STAGES OF PRODUCT DEVELOPMENT , 2011 .

[16]  Myra B. Cohen,et al.  Easing the generation of predictive human performance models from legacy systems , 2012, CHI.

[17]  Jean-Sébastien Sottet,et al.  A Model-Driven Engineering Approach for the Usability of Plastic User Interfaces , 2008, EHCI/DS-VIS.

[18]  Marco Winckler,et al.  A model-based approach for supporting engineering usability evaluation of interaction techniques , 2011, EICS '11.

[19]  Mario E. Sánchez,et al.  An Execution Platform for Extensible Runtime Models , 2008 .

[20]  Boris Brandherm,et al.  Gumo - The General User Model Ontology , 2005, User Modeling.

[21]  Matthias Peissner,et al.  MyUI: generating accessible user interfaces from multimodal design patterns , 2012, EICS '12.

[22]  Sebastian Möller,et al.  Predicting task execution times by deriving enhanced cognitive models from user interface development models , 2014, EICS '14.

[23]  Jean-Sébastien Sottet,et al.  Model-Driven Adaptation for Plastic User Interfaces , 2007, INTERACT.

[24]  Geoffrey M. Underwood,et al.  Cognitive Processes in Eye Guidance: Algorithms for Attention in Image Processing , 2009, Cognitive Computation.

[25]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[26]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[27]  Aaron Ruß,et al.  Modeling Visual Attention for Rule-Based Usability Simulations of Elderly Citizen , 2011, HCI.

[28]  Anthony J. Hornof,et al.  GLEAN: a computer-based tool for rapid GOMS model usability evaluation of user interface designs , 1995, UIST '95.

[29]  Anthony J. Hornof,et al.  A minimal model for predicting visual search in human-computer interaction , 2007, CHI.

[30]  Bonnie E. John,et al.  Exploration of Costs and Benefits of Predictive Human Performance Modeling for Design , 2010 .

[31]  Brice Morin,et al.  Models@ Run.time to Support Dynamic Adaptation , 2009, Computer.

[32]  James D. Foley,et al.  A second generation user interface design environment: the model and the runtime architecture , 1993, INTERCHI.

[33]  Bonnie E. John,et al.  Multipurpose prototypes for assessing user interfaces in pervasive computing systems , 2005, IEEE Pervasive Computing.

[34]  Judy Kay,et al.  Personis: A Server for User Models , 2002, AH.

[35]  Sahin Albayrak,et al.  Meta-Modeling Runtime Models , 2010, Models@run.time.

[36]  Richard M. Young,et al.  Programmable user models for predictive evaluation of interface designs , 1989, CHI '89.

[37]  Angela Castronovo,et al.  Looking for Unexpected Consequences of Interface Design Decisions: The MeMo Workbench , 2007, TAMODIA.

[38]  S. Greenberg,et al.  The Psychology of Everyday Things , 2012 .

[39]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[40]  Peter Kolb,et al.  DISCO: A Multilingual Database of Distributionally Similar Words , 2008 .

[41]  Andrew Sears,et al.  AIDE: a step toward metric-based interface development tools , 1995, UIST '95.

[42]  Yehya Mohamad,et al.  Creative Design for Inclusion Using Virtual User Models , 2012, ICCHP.

[43]  Peter Robinson,et al.  Investigating the applicability of user models for motion-impaired users , 2000, Assets '00.

[44]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[45]  D. Kieras,et al.  MODELING HUMAN ERROR FOR EXPERIMENTATION , TRAINING , AND ERROR-TOLERANT DESIGN , 2002 .

[46]  Jan Stage,et al.  Feedback from Usability Evaluation to User Interface Design: Are Usability Reports Any Good? , 2005, INTERACT.

[47]  Marc Hassenzahl,et al.  How motivational orientation influences the evaluation and choice of hedonic and pragmatic interactive products: The role of regulatory focus , 2008, Interact. Comput..

[48]  Elaine Rich,et al.  User Modeling via Stereotypes , 1998, Cogn. Sci..

[49]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[50]  Shari Trewin,et al.  Keyboard and mouse errors due to motor disabilities , 1999, Int. J. Hum. Comput. Stud..

[51]  David E. Kieras,et al.  Computational GOMS modeling of a complex team task: lessons learned , 2004, CHI.

[52]  Fabio Paternò Model-Based Design and Evaluation of Interactive Applications , 2000 .

[53]  Francisco Casacuberta,et al.  Probabilistic finite-state machines - part I , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[55]  Michael Quade,et al.  Model-Based Evaluation of Adaptive User Interfaces , 2011, AmI Workshops.

[56]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[57]  David E. Kieras,et al.  Towards demystification of direct manipulation: cognitive modeling charts the gulf of execution , 2001, CHI.

[58]  Bonnie E. John,et al.  Human performance modeling for all: importing UI prototypes into cogtool , 2010, CHI EA '10.

[59]  Frank E. Ritter,et al.  High-level Behavior Representation Languages Revisited , 2006 .

[60]  Richard M. Young,et al.  A dual-space model of iteratively deepening exploratory learning , 1996, Int. J. Hum. Comput. Stud..

[61]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[62]  G. Rossi,et al.  Design Patterns for Context-Aware Adaptation , 2005, 2005 Symposium on Applications and the Internet Workshops (SAINT 2005 Workshops).

[63]  GrafiXML, a Multi-target User Interface Builder Based on UsiXML , 2008, Fourth International Conference on Autonomic and Autonomous Systems (ICAS'08).

[64]  Sahin Albayrak,et al.  Evaluating user interface adaptations at runtime by simulating user interaction , 2011, BCS HCI.

[65]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[66]  Klaus-Peter Engelbrecht,et al.  How Can Cognitive Modeling Benefit from Ontologies? Evidence from the HCI Domain , 2015, AGI.

[67]  J. Sadock Speech acts , 2007 .

[68]  Michael Quade,et al.  Rule-Based Approach for Simulating Age-Related Usability Problems , 2012 .

[69]  Otilia Kocsis,et al.  Context-Dependent User Modelling for Smart Homes , 2007, User Modeling.

[70]  Kenneth R. Koedinger,et al.  Predictive human performance modeling made easy , 2004, CHI.

[71]  Shunsuke Suzuki,et al.  Toward Cognitive Modeling for Predicting Usability , 2009, HCI.

[72]  Klaus-Peter Engelbrecht,et al.  A Predictive Model of Human Error based on User Interface Development Models and a Cognitive Architecture , 2015 .

[73]  Andreas Lüdtke,et al.  Automated UI evaluation based on a cognitive architecture and UsiXML , 2014, Sci. Comput. Program..

[74]  Kai R. Larsen,et al.  Exploring the Semantic Validity of Questionnaire Scales , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[75]  S. Albayrak,et al.  Towards An Enhanced Semantic Approach For Automatic Usability Evaluation , 2011 .

[76]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[77]  Fabio Paternò,et al.  Design and development of multidevice user interfaces through multiple logical descriptions , 2004, IEEE Transactions on Software Engineering.