Context of Use: The Final Frontier in the Practice of User-Centered Design?

Abstract User-centered design (UCD) practitioners in industrial context are often faced with multilevel factors that hinder their effort to involve users in the context of use, and so meet one of the core UCD principles. Seen the heterogeneous and dynamic context of mobile system use, applying this principle becomes more challenging. Based on in-depth interviews with various mobile practitioners in Finland and the Netherlands, we explore the core factors that affect UCD practitioners in meeting this challenge. Our findings confirm the impact of the professional–client relationship as a key factor that inhibits the involvement of users. Novelty aspects, e.g. practitioners’ unfamiliarity with the users and the perceived innovativeness of the designed system, largely explain the involvement of users in situ. Interestingly, these conditions are not idiosyncratic to mobile computing. We discuss the contextual factors’ implications on UCD and emphasize alternative strategies that support practitioners in their effort to involve users.

[1]  D. Schoen,et al.  The Reflective Practitioner: How Professionals Think in Action , 1985 .

[2]  Susan Gasson,et al.  The reality of user-centered design , 1999 .

[3]  Jonathan Grudin,et al.  Organizational obstacles to interface design and development: two participant-observer studies , 1994, TCHI.

[4]  Mark D. Dunlop,et al.  Toward a Multidisciplinary Model of Context to Support Context-Aware Computing , 2005, Hum. Comput. Interact..

[5]  John D. Gould Chapter 35 – How to Design Usable Systems , 1988 .

[6]  Alan Cooper,et al.  The Inmates are Running the Asylum , 1999, Software-Ergonomie.

[7]  Sunny Consolvo,et al.  Using the Experience Sampling Method to Evaluate Ubicomp Applications , 2003, IEEE Pervasive Comput..

[8]  Netta Iivari,et al.  Enculturation of user involvement in software development organizations - an interpretive case study in the product development context , 2004, NordiCHI '04.

[9]  Colleen Page Mobile research strategies for a global market , 2005, CACM.

[10]  Nichole Simpson Cultivating an Effective Client Relationship to Promote a User-Centred Culture , 1998 .

[11]  Ron Wakkary,et al.  Understanding interaction design practices , 2011, CHI.

[12]  Tasnim Kaderbhai Overcoming Inertia within a Large Organization , 1998 .

[13]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1993 .

[14]  Joanna Bawa,et al.  The politics of usability - a practical guide to designing usable systems in industry , 1998, BCS practitioner series.

[15]  Donald A. Sch The reflective practitioner: how professionals think in action , 1983 .

[16]  Joanna Bawa,et al.  The Politics of Usability , 1998, Practitioner Series.

[17]  Adeola Yetunde Wale-Kolade,et al.  Integrating usability work into a large inter-organisational agile development project: Tactics developed by usability designers , 2015, J. Syst. Softw..

[18]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[19]  Kalle Lyytinen,et al.  Identifying Software Project Risks: An International Delphi Study , 2001, J. Manag. Inf. Syst..

[20]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[21]  John Zahorjan,et al.  The challenges of mobile computing , 1994, Computer.

[22]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[23]  Rikard Lindgren,et al.  Multi-contextuality in ubiquitous computing: Investigating the car case through action research , 2005, Inf. Organ..

[24]  Karel Vredenburg,et al.  A survey of user-centered design practice , 2002, CHI.

[25]  Netta Iivari,et al.  'Representing the User' in software development - a cultural analysis of usability work in the product development context , 2006, Interact. Comput..

[26]  Eli Blevis,et al.  Regarding Software as a Material of Design , 2006 .

[27]  K. Krippendorff The Semantic Turn: A New Foundation For Design , 2005 .

[28]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[29]  Desirée Sy,et al.  Adapting usability investigations for agile user-centered design , 2007 .

[30]  Karen Holtzblatt,et al.  Contextual design: using customer work models to drive systems design , 1998, CHI Conference Summary.

[31]  Gillian Symon,et al.  The Work of IT System Developers in Context: An Organizational Case Study , 1998, Hum. Comput. Interact..

[32]  Mark W. Newman,et al.  What Designers Talk About When They Talk About Context , 2014, Hum. Comput. Interact..

[33]  T. Muhr ATLAS/ti — A prototype for the support of text interpretation , 1991 .

[34]  Fraser Hamilton,et al.  Designing Usable e-Government Services for the Citizen - Success Within User Centred Design , 2011 .

[35]  Satu Jumisko-Pyykkö,et al.  Framing the Context of Use for Mobile HCI , 2010, Int. J. Mob. Hum. Comput. Interact..

[36]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[37]  Bernd Brügge,et al.  User involvement in software evolution practice: A case study , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[38]  Miles MacLeod,et al.  Usability measurement in context , 1994, Behav. Inf. Technol..

[39]  Antti Oulasvirta,et al.  Understanding Mobile Contexts , 2003, Mobile HCI.

[40]  M. Patton Qualitative research and evaluation methods , 1980 .

[41]  Harry Hochheiser,et al.  Research Methods for Human-Computer Interaction , 2008 .

[42]  Amy J. Ko,et al.  Designing for a billion users: a case study of facebook , 2012, CHI Extended Abstracts.

[43]  Donald A. Norman,et al.  User Centered System Design , 1986 .

[44]  Rachel Hinman The Mobile Frontier , 2012 .

[45]  Henri Barki,et al.  Rethinking the Concept of User Involvement , 1989, MIS Q..

[46]  John D. Gould,et al.  How to design usable systems , 1995 .

[47]  Fabio Paternò,et al.  End-User Development , 1998, Lecture Notes in Computer Science.

[48]  Miles MacLeod,et al.  MUSiC video analysis and context tools for usability measurement , 1993, INTERCHI.

[49]  Harry Bouwman,et al.  Addressing the Context of Use in Mobile Computing: a Survey on the State of the Practice , 2015, Interact. Comput..

[50]  Rikard Lindgren,et al.  User involvement in developing mobile and temporarily interconnected systems , 2010, Inf. Syst. J..

[51]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[52]  Mary Beth Rosson,et al.  Usability Engineering: Scenario-based Development of Human-Computer Interaction , 2001 .

[53]  Jonathan Grudin,et al.  Interactive systems: bridging the gaps between developers and users , 1991, Computer.

[54]  Mark Rouncefield,et al.  Fieldwork for Design: Theory and Practice (Computer Supported Cooperative Work) , 2007 .

[55]  Guanling Chen,et al.  A Survey of Context-Aware Mobile Computing Research , 2000 .

[56]  Tapio Soikkeli,et al.  Characterizing Smartphone Usage: Diversity and End User Context , 2013, Int. J. Handheld Comput. Res..

[57]  Alan Cooper,et al.  The Inmates Are Running the Asylum: Why High Tech Products Drive Us Crazy and How to Restore the Sanity (2nd Edition) , 1999 .

[58]  Libby Hemphill,et al.  Human-machine reconfigurations: Plans and situated actions, 2nd ed , 2007, J. Assoc. Inf. Sci. Technol..

[59]  Sari Kujala,et al.  User involvement: A review of the benefits and challenges , 2003, Behav. Inf. Technol..

[60]  Michael Frese,et al.  Don't underestimate the problems of user centredness in software development projectsthere are many! , 1996, Behav. Inf. Technol..

[61]  Chris W. Clegg,et al.  Problems integrating user participation into software development , 1997, Int. J. Hum. Comput. Stud..

[62]  Jonathan Grudin,et al.  Systematic Sources of Suboptimal Interface Design in Large Product Development Organizations , 1991, Hum. Comput. Interact..

[63]  R. Yin Case Study Research: Design and Methods , 1984 .

[64]  Jonna Häkkilä,et al.  Developing a mobile reporting system for road maintenance: user research perspective , 2007, Mobility '07.

[65]  Lisa Haney Contextual and Cultural Challenges for User Mobility Research , 2005 .

[66]  Morten Hertzum,et al.  On the Process of Software Design: Sources of Complexity and Reasons for Muddling through , 2008, EHCI/DS-VIS.

[67]  Cathy Thomas Consultants with Clout , 1998 .

[68]  Jan Gulliksen,et al.  Key principles for user-centred systems design , 2003, Behav. Inf. Technol..

[69]  Clayton Lewis,et al.  Designing for usability—key principles and what designers think , 1983, CHI '83.

[70]  B. Nardi Context and consciousness: activity theory and human-computer interaction , 1995 .

[71]  Tomer Sharon It's Our Research: Getting Stakeholder Buy-in for User Experience Research Projects , 2012 .

[72]  Paul Dourish,et al.  What we talk about when we talk about context , 2004, Personal and Ubiquitous Computing.

[73]  Vince Bruno,et al.  Making usability work in industry: an Australian practitioner perspective , 2007, OZCHI '07.

[74]  Jan Gulliksen,et al.  Usability professionals - current practices and future development , 2006, Interact. Comput..

[75]  Mark Rouncefield,et al.  Fieldwork for Design - Theory and Practice , 2007, Computer Supported Cooperative Work.

[76]  Gilbert Cockton,et al.  An investigation into the use of field methods in the design and evaluation of interactive systems , 2008, BCS HCI.

[77]  Timo Jokela,et al.  Getting UX Into the Contract , 2012 .

[78]  Peter Johnson,et al.  Helping and hindering user involvement — a tale of everyday design , 1997, CHI.

[79]  Erik Stolterman,et al.  The Nature of Design Practice and Implications for Interaction Design Research , 2008 .

[80]  Leela Damodaran,et al.  User involvement in the systems design process-a practical guide for users , 1996, Behav. Inf. Technol..

[81]  Martin C. Maguire,et al.  Context of Use within usability activities , 2001, Int. J. Hum. Comput. Stud..

[82]  Heike Winschiers,et al.  The Challenges of Participatory Design in a Intercultural Context: Designing for Usability in Namibia , 2006 .

[83]  Netta Iivari Usability Specialists - 'A Mommy Mob', 'Realistic Humanists' or 'Staid Researchers'? An Analysis of Usability Work in the Software Product Development , 2005, INTERACT.

[84]  Eyal Eshet Human-Centered Design in Mobile Application Development: Emerging Methods , 2012, Int. J. Mob. Hum. Comput. Interact..

[85]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[86]  Khaled El Emam,et al.  A field study of requirements engineering practices in information systems development , 1995, Proceedings of 1995 IEEE International Symposium on Requirements Engineering (RE'95).

[87]  K. Eisenhardt Agency Theory: An Assessment and Review , 1989 .

[88]  Lisa Haney,et al.  Applying User-Centered Design to Mobile Application Development , 2005 .

[89]  Frank Bentley,et al.  Building Mobile Experiences , 2012 .

[90]  Birgitta Bergvall-Kåreborn,et al.  Mobile Applications Development on Apple and Google Platforms , 2011, Commun. Assoc. Inf. Syst..

[91]  M. Arnold,et al.  On the phenomenology of technology: the "Janus-faces" of mobile phones , 2003, Inf. Organ..

[92]  Yvonne Rogers,et al.  Interaction Design: Beyond Human-Computer Interaction , 2002 .

[93]  Daniel G. Oliver,et al.  Constraints and Opportunities with Interview Transcription: Towards Reflection in Qualitative Research , 2005, Social forces; a scientific medium of social study and interpretation.

[94]  Dermot Browne Selling Usability Services , 1998 .

[95]  Marjo Kauppinen,et al.  Identifying and selecting users for user-centered design , 2004, NordiCHI '04.

[96]  Timo Jokela,et al.  People, Organizations, and Processes: An Inquiry into the Adoption of User-Centered Design in Industry , 2006, Int. J. Hum. Comput. Interact..

[97]  Margaret Burnett,et al.  End-User Development , 2013, Lecture Notes in Computer Science.

[98]  Brenda Laurel,et al.  Design Research: Methods and Perspectives , 2003 .

[99]  Deborah J. Mayhew,et al.  The usability engineering lifecycle , 1999, CHI Extended Abstracts.

[100]  Bill Curtis,et al.  A field study of the software design process for large systems , 1988, CACM.

[101]  Ian Sommerville,et al.  Socio-technical systems: From design methods to systems engineering , 2011, Interact. Comput..

[102]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[103]  Lucy Suchman,et al.  Human-Machine Reconfigurations: Plans and Situated Actions , 2006 .

[104]  T. S. Balaji,et al.  A carrier's perspective on creating a mobile multimedia service , 2005, CACM.

[105]  S. Kemmis Understanding Professional Practice: A Synoptic Framework , 2009 .

[106]  Stephanie Rosenbaum,et al.  A toolkit for strategic usability: results from workshops, panels, and surveys , 2000, CHI.

[107]  Jeanette L. Blomberg,et al.  Ethnographic Field Methods and Their Relation to Design , 2017 .

[108]  Marjo Kauppinen,et al.  The role of user involvement in requirements quality and project success , 2005, 13th IEEE International Conference on Requirements Engineering (RE'05).

[109]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[110]  Jonathan Earthy,et al.  A survey of usability capability maturity models: implications for practice and research , 2006, Behav. Inf. Technol..

[111]  Lucy A. Suchman,et al.  Practice-Based Design of Information Systems: Notes from the Hyperdeveloped World , 2002, Inf. Soc..

[112]  Morten Hertzum,et al.  Selecting users for participation in IT projects: Trading a representative sample for advocates and champions? , 2011, Interact. Comput..

[113]  Jonathan Trevor,et al.  Exploiting space and location as a design framework for interactive mobile systems , 2000, TCHI.

[114]  Juhani Iivari,et al.  Varieties of user‐centredness: an analysis of four systems development methods , 2011, Inf. Syst. J..