Usability Evaluation Practices within Agile Development

Despite having different underlying concepts, agile methods and User-Centered Design aim ultimately at producing high quality software. Aiming at providing better understanding on how usability evaluation is addressed within agile environments, we carried out multiple-case studies in two large IT companies. On the one hand, our studies corroborate the literature with regards to the execution of usability inspection evaluations on lightweight prototypes, taking advantage of the iterative nature of Agile. On the other hand, we observed contrary to the literature that this iterative nature of Agile has not facilitated the execution of user testing sessions. Furthermore, we noticed that it is extremely difficult to perform traditional user testing sessions due to the tight schedules inherent to Agile. Finally, we describe a set of practices that can help improve specific artifacts in different stages of an agile process in order to successfully evaluate software product usability.

[1]  Robert M. Davison,et al.  Principles of canonical action research , 2004, Inf. Syst. J..

[2]  Frank Maurer,et al.  User-Centered Design and Agile Methods: A Systematic Review , 2011, 2011 AGILE Conference.

[3]  Anselm L. Strauss,et al.  Basics of qualitative research : techniques and procedures for developing grounded theory , 1998 .

[4]  Marc McNeill,et al.  Agile Experience Design: A Digital Designer's Guide to Agile, Lean, and Continuous , 2011 .

[5]  Janaki Kumar,et al.  Gamification at Work: Designing Engaging Business Software , 2013, HCI.

[6]  Janice Singer,et al.  Studying Software Engineers: Data Collection Techniques for Software Field Studies , 2005, Empirical Software Engineering.

[7]  Robert Biddle,et al.  Agile Development Iterations and UI Design , 2007, Agile 2007 (AGILE 2007).

[8]  Lynn Miller.  Case study of customer input for a successful product , 2005, Agile Development Conference (ADC'05).

[9]  Jonathan Arnowitz,et al.  Effective Prototyping for Software Makers , 2006 .

[10]  Wolfgang Slany,et al.  Agile User-Centered Design Applied to a Mobile Multimedia Streaming Application , 2008, USAB.

[11]  Joseph S. Dumas,et al.  Usability in practice: formative usability evaluations - evolution and revolution , 2002, CHI Extended Abstracts.

[12]  Juliet M. Corbin,et al.  Basics of Qualitative Research (3rd ed.): Techniques and Procedures for Developing Grounded Theory , 2008 .

[13]  Lene Nielsen,et al.  The usability expert's fear of agility: an empirical study of global trends and emerging practices , 2012, NordiCHI.

[14]  Mick McGee,et al.  The Rapid Iterative Test and Evaluation Method: Better Products in Less Time , 2005 .

[15]  Gary Perlman,et al.  Book review: Human-Computer Interaction, by Jenny Preece, Yvonne Rogers, Helen Sharp, David Benyon, Simon Holland, and Tom Carey (Addison-Wesley, 1994) , 1994, SGCH.

[16]  Andraž Cej,et al.  Agile software development with Scrum , 2010 .

[17]  Gerard Meszaros,et al.  Adding usability testing to an agile project , 2006, AGILE 2006 (AGILE'06).

[18]  Theodore D. Hellmann,et al.  User Experience Design and Agile Development: From Theory to Practice , 2012 .

[19]  Jakob Nielsen,et al.  Usability engineering at a discount , 1989 .

[20]  Neil A. M. Maiden,et al.  Towards a Framework for Integrating Agile Development and User-Centred Design , 2006, XP.

[21]  N. Hoffart.  Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[22]  Karen Holtzblatt,et al.  An Agile Customer-Centered Method: Rapid Contextual Design , 2004, XP/Agile Universe.

[23]  Helen Sharp,et al.  Ethnographically-informed empirical studies of software practice , 2007, Inf. Softw. Technol..

[24]  J. Gosby.  MEDIA REVIEWS: Basics of Qualitative Research - Techniques and Procedures for Developing Grounded Theory 2nd Edition by A. Strauss and J. Corbin. Sage Publications, , 2000 .

[25]  Tom Carey,et al.  Human-computer interaction , 1994 .

[26]  Jonathan Earthy,et al.  The Benefits of Using ISO 13407: Human Centred Design Process for Interactive Systems , 2001, INTERACT.

[27]  Desirée Sy,et al.  Adapting usability investigations for agile user-centered design , 2007 .

[28]  Frank Maurer,et al.  Agile Methods and User-Centered Design: How These Two Methodologies are Being Successfully Integrated in Industry , 2008, Agile 2008 Conference.

[29]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[30]  Paul Hodgetts,et al.  Experiences integrating sophisticated user experience design practices into agile processes , 2005, Agile Development Conference (ADC'05).

[31]  Lynn Miller,et al.  Extreme usability: adapting research approaches for agile development , 2008, CHI Extended Abstracts.