Whose Experience Do We Care About? Analysis of the Fitness of Scrum and Kanban to User Experience

Two project management approaches, Agile and Lean, have increasingly been adopted in recent years for software development. Meanwhile, in the field of human–computer interaction (HCI), user experience (UX) has become central in research and practice. The new hybrids between the two fields—Agile UX and Lean UX—were born a few years ago. As Agile, Lean, and UX have different principles and practices, one can query whether the couplings are well justified and whether Agile or Lean is more compatible with UX work. We have conducted a conceptual analysis and tended to conclude that Lean instantiated as Kanban fits UX work better than Agile instantiated as Scrum. To explore further our claim, we performed a secondary data analysis of 10 semistructured interviews with practitioners working with Scrum and Kanban in different sectors (Study 1). This study enabled us to gain insights into the applications of the two processes in real-life cases, their strengths and weaknesses, and factors influencing the practicality of implementing them. Both processes seem not favorable for UX work in practice. Among others, one intriguing observation is loose adherence to the related guidelines and principles. A query derived from the analyses of the interviews is that “customer,” as compared with “user,” has more frequently been referred to by our interviewees, irrespective of the process they adopted. We have then been motivated to investigate this issue, using a web-based survey with another batch of practitioners (N = 73) in the software industry (Study 2). Results of the survey indicate that the practitioners in general had a reasonable understanding of the concepts “user” and “customer,” although a minority tended to treat them as synonyms. Limitations of the current studies and implications for future work are discussed.

[1]  Jeff White,et al.  Agile user centered design: enter the design studio - a case study , 2008, CHI Extended Abstracts.

[2]  Donna L. Hoffman,et al.  Measuring the Customer Experience in Online Environments: A Structural Modeling Approach , 2000 .

[3]  Bernd H. Schmitt Customer Experience Management: A Revolutionary Approach to Connecting with Your Customers , 2003 .

[4]  Noam Tractinsky,et al.  Assessing dimensions of perceived visual aesthetics of web sites , 2004 .

[5]  Evangelos Karapanos,et al.  User experience over time , 2008, CHI Extended Abstracts.

[6]  Radoslaw Hofman,et al.  Behavioral economics in software quality engineering , 2011, Empirical Software Engineering.

[7]  Jen Hocko User-Centered Design in Procured Software Implementations , 2011 .

[8]  新郷 重夫,et al.  A study of the Toyota production system from an industrial engineering viewpoint , 1989 .

[9]  Andraž Cej,et al.  Agile software development with Scrum , 2010 .

[10]  Vasja Vehovar,et al.  Open-ended vs. close-ended questions in Web questionnaires , 2003 .

[11]  Tommi Mikkonen,et al.  Agile User Experience Development in a Large Software Organization: Good Expertise but Limited Impact , 2012, HCSE.

[12]  Antonella De Angeli,et al.  Towards a theory of user judgment of aesthetics and user interface quality , 2008, TCHI.

[13]  Adeola Yetunde Wale-Kolade,et al.  Integrating usability work into a large inter-organisational agile development project: Tactics developed by usability designers , 2015, J. Syst. Softw..

[14]  Fabian Fagerholm,et al.  Examining the Structure of Lean and Agile Values among Software Developers , 2014, XP.

[15]  Paul van Schaik,et al.  Attitudes towards user experience (UX) measurement , 2014, Int. J. Hum. Comput. Stud..

[16]  Theodore D. Hellmann,et al.  User Experience Design and Agile Development: From Theory to Practice , 2012 .

[17]  G. Noci,et al.  How to Sustain the Customer Experience:: An Overview of Experience Components that Co-create Value With the Customer , 2007 .

[18]  Torgeir Dingsøyr,et al.  A decade of agile methodologies: Towards explaining agile software development , 2012, J. Syst. Softw..

[19]  大野 耐一,et al.  Toyota production system : beyond large-scale production , 1988 .

[20]  Helen Sharp,et al.  Values and Assumptions Shaping Agile Development and User Experience Design in Practice , 2010, XP.

[21]  Linda K Owens Secondary data analysis. , 1995, Bulletin of the World Health Organization.

[22]  Paul van Schaik,et al.  Modelling user experience - An agenda for research and practice , 2010, Interact. Comput..

[23]  Jeff Sutherland,et al.  Manifesto for Agile Software Development , 2013 .

[24]  Henrik Kniberg,et al.  Kanban and Scrum - Making the Most of Both , 2010 .

[25]  Virpi Roto,et al.  User experience evaluation methods: current state and development needs , 2010, NordiCHI.

[26]  Catherine Courage,et al.  The Doctor is "In" -- Using the Office Hours Concept to Make Limited Resources Most Effective , 2008, Agile 2008 Conference.

[27]  Ken Schwaber,et al.  SCRUM Development Process , 1997 .

[28]  C. Meyer,et al.  Understanding customer experience. , 2007, Harvard business review.

[29]  CoattaTerry,et al.  UX design and agile , 2011, Commun. ACM.

[30]  R.I.A. Mercuri,et al.  Technology as Experience , 2005, IEEE Transactions on Professional Communication.

[31]  Tom Illmensee,et al.  5 Users Every Friday: A Case Study in Applied Research , 2009, 2009 Agile Conference.

[32]  S. Hudson,et al.  CHI '08 Extended Abstracts on Human Factors in Computing Systems , 2009, CHI 2009.

[33]  Ken Schwaber,et al.  Agile Project Management with Scrum , 1980 .

[34]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[35]  Philipp Diebold,et al.  Agile practices in practice: a mapping study , 2014, EASE '14.

[36]  Lynn Miller,et al.  Agile user experience SIG , 2009, CHI Extended Abstracts.

[37]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[38]  Orit Hazzan,et al.  The Agile Manifesto , 2014 .

[39]  Tina Øvad Agile User Experience , 2014 .

[40]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[41]  Mary Poppendieck,et al.  Implementing Lean Software Development: From Concept to Cash (The Addison-Wesley Signature Series) , 2006 .

[42]  Peter C. Wright,et al.  Experience-Centered Design: Designers, Users, and Communities in Dialogue , 2010, Experience-Centered Design.

[43]  Paul A. Cairns,et al.  A systematic literature review for agile development processes and user centred design integration , 2014, EASE '14.

[44]  J. L. Pierce,et al.  Psychological ownership and feelings of possession: three field studies predicting employee attitudes and organizational citizenship behavior , 2004 .

[45]  Kasper Hornbæk,et al.  Ingredients and Meals Rather Than Recipes: A Proposal for Research That Does Not Treat Usability Evaluation Methods as Indivisible Wholes , 2011, Int. J. Hum. Comput. Interact..

[46]  Niklas Modig,et al.  This Is Lean: Resolving the Efficiency Paradox , 2012 .

[47]  Marc Hassenzahl,et al.  The Interplay of Beauty, Goodness, and Usability in Interactive Products , 2004, Hum. Comput. Interact..

[48]  Kasper Hornbæk,et al.  Analysis in practical usability evaluation: a survey study , 2012, CHI.

[49]  Khalid Khan,et al.  Integrating usability engineering and agile software development: A literature review , 2010, 2010 International Conference On Computer Design and Applications.

[50]  Taiichi Ohno,et al.  Toyota Production System : Beyond Large-Scale Production , 1988 .

[51]  Mona Singh U-SCRUM: An Agile Methodology for Promoting Usability , 2008, Agile 2008 Conference.

[52]  Jean Vanderdonckt,et al.  Human-Centered Software Engineering - Software Engineering Models, Patterns and Architectures for HCI , 2009, Human-Computer Interaction Series.

[53]  Frank Maurer,et al.  Ten Lessons Learned from Integrating Interaction Design and Agile Development , 2013, 2013 Agile Conference.

[54]  Pekka Abrahamsson,et al.  On the Impact of Kanban on Software Project Work: An Empirical Case Study Investigation , 2011, 2011 16th IEEE International Conference on Engineering of Complex Computer Systems.

[55]  Kasper Hornbæk,et al.  Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience , 2011, CHI.

[56]  Jan Gulliksen,et al.  Informal feedback rather than performance measurements – user-centred evaluation in Scrum projects , 2014, Behav. Inf. Technol..

[57]  Gary M Olson,et al.  Human-computer interaction: psychological aspects of the human use of computing. , 2003, Annual review of psychology.