Automating the evaluation of usability remotely for web applications via a model-based approach

Usability for software systems has emerged as an integral part of the continuous commercial success of IT companies. This is partly due to the vital need to satisfy customers' goals for systems becoming pervasive and ubiquitous within our daily life. In this research study, we have explored the use of task models to define how the user should interact with a given system. Based on empirical data collected from end-users participating within the usability evaluation of a web application, data analysis is conducted to infer the usability degree. This is carried out in compliance with the defined task model and usability metrics describing efficiency of use. The proposed approach is a milestone towards automating usability evaluation as most of the studies are reporting manual-based methods to assess the usability of software systems. Experimental results performed to assess the usability of a website shows the potency of the system to discover usability setbacks that can be addressed to improve the user experience.

[1]  Imed Bouchrika,et al.  Mockup-based navigational diagram for the development of interactive web applications , 2013, ISDOC.

[2]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[3]  Thomas S. Tullis,et al.  An Empirical Comparison of Lab and Remote Usability Testing of Web Sites , 2002 .

[4]  Fabio Paternò,et al.  Intelligent analysis of user interactions with web applications , 2002, IUI '02.

[5]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[6]  Thomas Tiedtke,et al.  AWUSA – A Tool for Automated Website Usability Analysis , 2002 .

[7]  Leandro Guarino de Vasconcelos,et al.  Towards an automatic evaluation of web applications , 2012, SAC '12.

[8]  Marie Christine Roy,et al.  The impact of interface usability on trust in Web retailers , 2001, Internet Res..

[9]  Fabio Paternò,et al.  Improving Support for Visual Task Modelling , 2012, HCSE.

[10]  Neville A Stanton,et al.  Hierarchical task analysis: developments, applications, and extensions. , 2006, Applied ergonomics.

[11]  Albrecht Schmidt,et al.  Tracking the interaction of users with AJAX applications for usability testing , 2007, CHI.

[12]  Patrick Harms,et al.  Usage-Based Automatic Detection of Usability Smells , 2014, HCSE.

[13]  Nguyen Thanh Binh,et al.  A new test modeling language for interactive applications based on task trees , 2013, SoICT '13.

[14]  Silvia Mara Abrahão,et al.  Usability evaluation methods for the web: A systematic mapping study , 2011, Inf. Softw. Technol..

[15]  Mickaël Baron,et al.  Increasing the expressive power of task analysis: Systematic comparison and empirical assessment of tool-supported task models , 2010, Interact. Comput..

[16]  Philippe A. Palanque,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2014, International Conference on Human Factors in Computing Systems.

[17]  Rudolf Ferenc,et al.  A Semi-automatic Usability Evaluation Framework , 2013, ICCSA.

[18]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[19]  Silviu Andrica,et al.  WaRR: A tool for high-fidelity web application record and replay , 2011, 2011 IEEE/IFIP 41st International Conference on Dependable Systems & Networks (DSN).