Usability Work in Agile Systems Development Practice: A Systematic Review

In this chapter we present the results of a systematic literature review of the recommendations in the existing research literature on usability work in agile systems development. The review contributes by summarizing the literature in light of seven claims about how to integrate usability work into an agile development project. By analyzing the claims we show how the previous literature provides grounds, warrants, backing, rebuttal, and qualification with regard to each of them. From this comprehensive overview of the literature we then discuss a research agenda with a particular focus on how situational factors for the claims must be researched and how this must encompass identified rebuttals and qualifications.

[1]  Heather Williams,et al.  The UCD Perspective: Before and After Agile , 2007, Agile 2007 (AGILE 2007).

[2]  Richard T. Watson,et al.  Analyzing the Past to Prepare for the Future: Writing a Literature Review , 2002, MIS Q..

[3]  Andreas Holzinger,et al.  Investigating Agile User-Centered Design in Practice: A Grounded Theory Perspective , 2009, USAB.

[4]  Paul Hodgetts,et al.  Experiences integrating sophisticated user experience design practices into agile processes , 2005, Agile Development Conference (ADC'05).

[5]  Frank Maurer,et al.  User-Centered Design and Agile Methods: A Systematic Review , 2011, 2011 AGILE Conference.

[6]  Helen Sharp,et al.  User experience design and agile development: managing cooperation through articulation work , 2011, Softw. Pract. Exp..

[7]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[8]  Lily Cho.  Adopting an Agile Culture A User Experience Team's Journey , 2009, 2009 Agile Conference.

[9]  Júnia Gonçalves,et al.  POLVO - Software for Prototyping of Low-Fidelity Interfaces in Agile Development , 2011, HCI.

[10]  Tom Illmensee,et al.  5 Users Every Friday: A Case Study in Applied Research , 2009, 2009 Agile Conference.

[11]  Frank Maurer,et al.  Agile Methods and User-Centered Design: How These Two Methodologies are Being Successfully Integrated in Industry , 2008, Agile 2008 Conference.

[12]  Mark C. Detweiler,et al.  Managing UCD within agile projects , 2007, INTR.

[13]  Morten Hertzum,et al.  How do usability professionals construe usability? , 2012, Int. J. Hum. Comput. Stud..

[14]  Paul Baker,et al.  Improving Obama Campaign Software: Learning from Users , 2009, 2009 Agile Conference.

[15]  Maryam Najafi,et al.  Two Case Studies of User Experience Design and Agile Development , 2008, Agile 2008 Conference.

[16]  Karsten Nebe,et al.  Incorporating User Centered Requirement Engineering into Agile Software Development , 2007, HCI.

[17]  Donald A. Norman,et al.  Why doing user observations first is wrong , 2006, INTR.

[18]  Masaaki Kurosu,et al.  Human Centered Design, First International Conference, HCD 2009, Held as Part of HCI International 2009, San Diego, CA, USA, July 19-24, 2009, Proceedings , 2009, HCI.

[19]  Manfred Tscheligi,et al.  Integration of Extreme Programming and User-Centered Design: Lessons Learned , 2009, XP.

[20]  John Armitage,et al.  Are agile methods good for design? , 2004, INTR.

[21]  James Noble,et al.  Up-Front Interaction Design in Agile Development , 2007, XP.

[22]  Theodore D. Hellmann,et al.  Supporting Test-Driven Development of Graphical User Interfaces Using Agile Interaction Design , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[23]  Rory V. O'Connor,et al.  The situational factors that affect the software development process: Towards a comprehensive reference framework , 2012, Inf. Softw. Technol..

[24]  Ana Estela Antunes da Silva,et al.  A Conceptual Knowledge Base Representation for Agile Design of Human-Computer Interface , 2009, 2009 Third International Symposium on Intelligent Information Technology Application.

[25]  Mona Singh.  U-SCRUM: An Agile Methodology for Promoting Usability , 2008, Agile 2008 Conference.

[26]  Julie A. Jacko,et al.  Human-Computer Interaction. Design and Development Approaches , 2011, Lecture Notes in Computer Science.

[27]  Volker Paelke,et al.  Dynamic Maps for Future Navigation Systems: Agile Design Exploration of User Interface Concepts , 2009, HCI.

[28]  K. Todd Stevens,et al.  Examining the Foundations of Agile Usability with eXtreme Scenario-Based Design , 2009, 2009 Agile Conference.

[29]  Desirée Sy,et al.  Adapting usability investigations for agile user-centered design , 2007 .

[30]  Jukka Haikara.  Usability in Agile Software Development: Extending the Interaction Design Process with Personas Approach , 2007, XP.

[31]  Michael Herczeg,et al.  User-Centered Design Meets Feature-Driven Development: An Integrating Approach for Developing the Web Application myPIM , 2009, HCI.

[32]  Miklós Biró,et al.  The Usability Approach in Software Process Improvement , 2011, EuroSPI.

[33]  John Campbell,et al.  Little Design Up-Front: A Design Science Approach to Integrating Usability into Agile Requirements Engineering , 2009, HCI.

[34]  Theodore D. Hellmann,et al.  Distributed and Automated Usability Testing of Low-Fidelity Prototypes , 2010, 2010 Agile Conference.

[35]  Ann Blandford,et al.  The Importance of Identity and Vision to User Experience Designers on Agile Projects , 2009, 2009 Agile Conference.

[36]  Thomas Memmel,et al.  Agile human-centered software engineering , 2007, BCS HCI.

[37]  Jan Gulliksen,et al.  Key principles for user-centred systems design , 2003, Behav. Inf. Technol..

[38]  Tiziana Catarci,et al.  A Three-Fold Integration Framework to Incorporate User-Centered Design into Agile Software Development , 2011, HCI.

[39]  Kuldeep Kelkar,et al.  When user experience met agile: a case study , 2009, CHI Extended Abstracts.

[40]  Scott W. Ambler.  Tailoring Usability into Agile Software Development Projects , 2008, Maturing Usability.

[41]  Osvaldo Gervasi,et al.  USABAGILE_Web: A Web Agile Usability Approach for Web Site Design , 2010, ICCSA.

[42]  Jeff Patton.  Designing Requirements: Incorporating Usage-Centered Design into an Agile SW Development Process , 2002, XP/Agile Universe.

[43]  Julie A. Jacko,et al.  Interaction design and usability , 2007 .

[44]  Stuart Anderson,et al.  Requirements Evolution from Process to Product Oriented Management , 2001, PROFES.

[45]  Lisa Baker,et al.  Using Persona with XP at LANDesk Software, an Avocent Company , 2008, Agile 2008 Conference.

[46]  Alberto Sillitti.  Agile Processes in Software Engineering and Extreme Programming, 11th International Conference, XP 2010, Trondheim, Norway, June 1-4, 2010. Proceedings , 2010, XP.

[47]  Hakan Erdogmus,et al.  Extreme Programming and Agile Methods - XP/Agile Universe 2004 , 2004, Lecture Notes in Computer Science.

[48]  Jan Gulliksen,et al.  Human-Centered Software Engineering - Integrating Usability in the Software Development Lifecycle , 2011 .

[49]  Larry L. Constantine,et al.  Usage-Centered Engineering for Web Applications , 2002, IEEE Softw..

[50]  Neil A. M. Maiden,et al.  Towards a Framework for Integrating Agile Development and User-Centred Design , 2006, XP.

[51]  Begoña Losada,et al.  Efficient Building of Interactive Applications Guided by Requirements Models , 2009, ICWE.

[52]  Karen Holtzblatt,et al.  An Agile Customer-Centered Method: Rapid Contextual Design , 2004, XP/Agile Universe.

[53]  Melissa Federoff,et al.  Successful User Experience in an Agile Enterprise Environment , 2009, HCI.

[54]  Lynn Miller.  Case study of customer input for a successful product , 2005, Agile Development Conference (ADC'05).

[55]  Gavriel Salvendy,et al.  Designing information environments , 2009 .

[56]  Joshua Evnin,et al.  Are You Sure? Really? A Contextual Approach to Agile User Research , 2008, Agile 2008 Conference.

[57]  Pekka Abrahamsson,et al.  Usability Assessment of an Extreme Programming Project: Close Co-operation with the Customer Does Not Equal to Good Usability , 2004, PROFES.

[58]  Marcela Esteves,et al.  Designing Interaction Concepts, Managing Customer Expectation and Mastering Agile Development in Rich Application Product Development , 2011, HCI.

[59]  Ahmed Seffah,et al.  Comparing and reconciling usability-centered and use case-driven requirements engineering processes , 2001, Proceedings Second Australasian User Interface Conference. AUIC 2001.

[60]  Gerard Meszaros,et al.  Adding usability testing to an agile project , 2006, AGILE 2006 (AGILE'06).

[61]  Laurie Williams,et al.  Extreme Programming and Agile Methods — XP/Agile Universe 2002 , 2002, Lecture Notes in Computer Science.

[62]  Martin Albisetti,et al.  Launchpad's Quest for a Better and Agile User Interface , 2010, XP.

[63]  David Kane,et al.  Finding a place for discount usability engineering in agile development: throwing down the gauntlet , 2003, Proceedings of the Agile Development Conference, 2003. ADC 2003.

[64]  Stefan Blomkvist,et al.  Towards a Model for Bridging Agile Development and User-Centered Design , 2005 .

[65]  S. Toulmin,et al.  An introduction to reasoning , 1979 .

[66]  Jim Ungar.  The Design Studio: Interface Design for Agile Teams , 2008, Agile 2008 Conference.

[67]  Kari Rönkkö,et al.  Meeting Organisational Needs and Quality Assurance through Balancing Agile and Formal Usability Testing Results , 2008, CEE-SET.

[68]  Klaus Miesenberger,et al.  HCI and Usability for e-Inclusion, 5th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2009, Linz, Austria, November 9-10, 2009 Proceedings , 2009, USAB.

[69]  D. Scott McCrickard,et al.  Concept mapping in agile usability: a case study , 2010, CHI EA '10.

[70]  Nigel Bevan,et al.  What is the difference between the purpose of usability and user experience evaluation methods , 2009 .

[71]  Maria Cecília Calani Baranauskas,et al.  An Agile Process Model for Inclusive Software Development , 2009, ICEIS.

[72]  Matthias Finck,et al.  Scenario-based usability engineering techniques in agile development processes , 2008, CHI Extended Abstracts.

[73]  Michele Marchesi,et al.  Extreme Programming and Agile Processes in Software Engineering , 2003, Lecture Notes in Computer Science.

[74]  Kieran Conboy,et al.  Agility from First Principles: Reconstructing the Concept of Agility in Information Systems Development , 2009, Inf. Syst. Res..

[75]  Jan Bosch,et al.  Architecting for usability: a survey , 2004, J. Syst. Softw..

[76]  Khalid Khan,et al.  Integrating usability engineering and agile software development: A literature review , 2010, 2010 International Conference On Computer Design and Applications.