A Systematic Mapping Review of Usability Evaluation Methods for Software Development Process

Given that usability is one of the most important aspects of software quality, several methods have been developed in order to establish techniques capable of evaluating this attribute from early phases of the software development process. However, the choice of the most appropriate method for a particular scenario is still a difficult decision, due to the existence of a vast number of approaches that are described in the literature for this purpose. Therefore, a systematic mapping review was conducted in order to identify the most commonly used usability evaluation techniques in software developments. A total of 1169 studies were identified, of which only 215 studies were selected for this review. According to the analysis, most cases studies establish the use of usability questionnaires as assessment tool. In addition, health informatics and Web applications are the software domain and type of application that are frequently reported in these evaluations. This work has allowed to reach promising results in this area. It is intended to be a guide for specialists to support the choice of the most suitable method for a particular scenario.

[1]  David E. Rowley,et al.  The cognitive jogthrough: a fast-paced user interface evaluation procedure , 1992, CHI.

[2]  Clarisse Sieckenius de Souza,et al.  The semiotic inspection method , 2006, IHC '06.

[3]  Ben Shneiderman,et al.  Perspective-based Usability Inspection: An Empirical Validation of Efficacy , 1999, Empirical Software Engineering.

[4]  Freddy Paz,et al.  Usability Evaluation Methods for Software Development: A Systematic Mapping Review , 2015, 2015 8th International Conference on Advanced Software Engineering & Its Applications (ASEA).

[5]  Pam J. Mayhew,et al.  Generating a Domain Specific Inspection Evaluation Method through an Adaptive Framework , 2013 .

[6]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[7]  Silvia Mara Abrahão,et al.  Usability evaluation methods for the web: A systematic mapping study , 2011, Inf. Softw. Technol..

[8]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[9]  Silvia Mara Abrahão,et al.  A Web Usability Evaluation Process for Model-Driven Web Development , 2011, CAiSE.

[10]  Andreas Holzinger,et al.  Usability engineering methods for software developers , 2005, CACM.

[11]  José Antonio Pow-Sang,et al.  Experimental Evaluation of Usability Heuristics , 2013, 2013 10th International Conference on Information Technology: New Generations.

[12]  Rick Spencer,et al.  The streamlined cognitive walkthrough method, working around social constraints encountered in a software development company , 2000, CHI.

[13]  Al-Sakib Khan Pathan,et al.  On the Key Factors of Usability in Small-sized Mobile Touch-Screen Application , 2013 .

[14]  Najmeh Vatankhah,et al.  Usability Measurement of Malaysian Online Tourism Websites , 2014 .

[15]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[16]  Iain E. Buchan,et al.  Verbal Protocols for Assessing the Usability of Clinical Decision Support: The Retrospective Sense Making Protocol , 2013, MedInfo.

[17]  Alaa Mustafa.  Software Usability Evaluation Using Opinion Mining , 2014 .

[18]  Leo Lentz,et al.  Retrospective think-aloud method: using eye movements as an extra cue for participants' verbalizations , 2011, CHI.

[19]  Cristian Rusu,et al.  Evaluating the Usability of Transactional Web Sites , 2010, 2010 Third International Conference on Advances in Computer-Human Interactions.

[20]  Freddy Paz,et al.  Current Trends in Usability Evaluation Methods: A Systematic Review , 2014, 2014 7th International Conference on Advanced Software Engineering and Its Applications.