Taking the Long View: Structured Expert Evaluation for Extended Interaction

This paper proposes first steps in the development of practical techniques for the expert evaluation of long-term interactions driven by the need to perform expert evaluation of such systems in a consultancy framework. Some interactions are time-limited and goal-driven, for example withdrawing money at an ATM. However, these are typically embedded within longer-term interactions, such as with the banking system as a whole. We have numerous evaluation and design tools for the former, but long-term interaction is less well served. To fill this gap new evaluation prompts are presented, drawing on the style of cognitive walkthroughs to support extended interaction.

[1]  Nuno Jardim Nunes,et al.  Practitioner Tools and Workstyles for User-Interface Design , 2007, IEEE Software.

[2]  Louis Tijerina,et al.  Proposed Military Standard for Task Analysis , 1987 .

[3]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[4]  Richard C. Thomas.  Long term human-computer interaction - an exploratory perspective , 1998 .

[5]  Leena Kuure,et al.  Video diary as a means for data gathering with children - Encountering identities in the making , 2014, Int. J. Hum. Comput. Stud..

[6]  Marisa E. Campbell,et al.  Conference preview: HCI 2000: usability or else! , 2000, INTR.

[7]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[8]  Philip J. Barnard,et al.  THE HANDBOOK OF TASK ANALYSIS FOR HUMAN-COMPUTER INTERACTION , 2003 .

[9]  Alan J. Dix,et al.  Learning Analytics for the Academic: An Action Perspective , 2015, J. Univers. Comput. Sci..

[10]  Alan J. Dix,et al.  Interaction in the large , 1998, Interact. Comput..

[11]  Anna L. Cox,et al.  Theoretical analysis and theory creation , 2008 .

[12]  Alan J. Dix.  Human-Computer Interaction , 2018, Encyclopedia of Database Systems.

[13]  B. Penders,et al.  Research in the wild , 2007, Nature.

[14]  Kim Flintoff,et al.  Digital badges in education , 2013, Education and Information Technologies.

[15]  I. Scott MacKenzie,et al.  Motor Behaviour Models for Human-Computer Interaction , 2002 .

[16]  S. Easterbrook.  CSCW: Cooperation or Conflict? , 1993, Computer Supported Cooperative Work.

[17]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[18]  Virpi Roto,et al.  Identifying hedonic factors in long-term user experience , 2011, DPPI.

[19]  Christian Heath,et al.  Collaborative Activity and Technological Design: Task Coordination in London Underground Control Rooms , 1991, ECSCW.

[20]  Timothy W. Bickmore,et al.  Establishing and maintaining long-term human-computer relationships , 2005, TCHI.

[21]  Yves Guiard,et al.  Preface: Fitts' law 50 years later: Applications and contributions from human-computer interaction , 2004 .

[22]  Rick Spencer,et al.  The streamlined cognitive walkthrough method, working around social constraints encountered in a software development company , 2000, CHI.

[23]  Marilyn Hughes Blackmon,et al.  Cognitive walkthrough for the web , 2002, CHI.

[24]  Cathleen Wharton,et al.  The cognitive walkthrough method: a practitioner's guide , 1994 .

[25]  Ron Kohavi,et al.  The Surprising Power of Online Experiments , 2017 .

[26]  Richard C. Thomas,et al.  Long Term Human-Computer Interaction , 1998, Springer London.

[27]  Cathleen Wharton,et al.  Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces , 1990, CHI '90.

[28]  I. Scott MacKenzie,et al.  CHAPTER 3 – Motor Behavior Models for Human-Computer Interaction , 2003 .

[29]  Alison Kidd,et al.  The marks are on the knowledge worker , 1994, CHI '94.

[30]  Jonathan Grudin,et al.  Why CSCW applications fail: problems in the design and evaluationof organizational interfaces , 1988, CSCW '88.

[31]  Alan Cooper,et al.  The Inmates are Running the Asylum , 1999, Software-Ergonomie.

[32]  Alan J. Dix,et al.  The experience of photologging: global mechanisms and local interactions , 2010, Personal and Ubiquitous Computing.

[33]  Alan J. Dix,et al.  Artefacts as designed, artefacts as used: resources for uncovering activity dynamics , 2005, Cognition, Technology & Work.

[34]  Carine Lallemand,et al.  Dear diary: Using diaries to study User Experience , 2012 .

[35]  Allen Newell,et al.  The keystroke-level model for user performance time with interactive systems , 1980, CACM.

[36]  A. Shepherd,et al.  HTA as a framework for task analysis. , 1998, Ergonomics.

[37]  Ana Paiva,et al.  Social Robots for Long-Term Interaction: A Survey , 2013, International Journal of Social Robotics.

[38]  Alan Dix,et al.  Causing Trouble with Buttons , 1994 .

[39]  Fabio Paternò,et al.  ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models , 1997, INTERACT.

[40]  R.I.A. Mercuri,et al.  Technology as Experience , 2005, IEEE Transactions on Professional Communication.