Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI

When on the move, cognitive resources are reserved partly for passively monitoring and reacting to contexts and events, and partly for actively constructing them. The Re-source Competition Framework (RCF), building on the Multiple Resources Theory, explains how psychosocial tasks typical of mobile situations compete for cognitive resources and then suggests that this leads to the depletion of resources for task interaction and eventually results in the breakdown of fluent interaction. RCF predictions were tested in a semi-naturalistic field study measuring attention during the performance of assigned Web search tasks on mobile phone while moving through nine varied but typical urban situations. Notably, we discovered up to eight-fold differentials between micro-level measurements of atten-tional resource fragmentation, for example from spans of over 16 seconds in a laboratory condition dropping to bursts of just a few seconds in difficult mobile situations. By cali-brating perceptual sampling, reducing resources from tasks of secondary importance, and resisting the impulse to switch tasks before finalization, participants compensated for the resource depletion. The findings are compared to previous studies in office contexts. The work is valuable in many areas of HCI dealing with mobility.

[1]  A. Welford.  THE ‘PSYCHOLOGICAL REFRACTORY PERIOD’ AND THE TIMING OF HIGH‐SPEED PERFORMANCE—A REVIEW AND A THEORY , 1952 .

[2]  D. Meyer,et al.  Attention and Performance XIV , 1973 .

[3]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[4]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[5]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[6]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[7]  Arnold J. Wilkins,et al.  Remembering to do things: A theoretical framework and an illustrative experiment , 1982 .

[8]  Liam Bannon,et al.  Evaluation and analysis of users' activity organization , 1983, CHI '83.

[9]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[10]  Edward L. Deci,et al.  Intrinsic Motivation and Self-Determination in Human Behavior , 1975, Perspectives in Social Psychology.

[11]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[12]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[13]  C. Goodwin,et al.  Rethinking Context: Language as an Interactive Phenomenon , 1992 .

[14]  C. Goodwin,et al.  Rethinking Context: An Introduction , 1992 .

[15]  H. Pashler.  Dual-task interference and elementary mental mechanisms , 1993 .

[16]  David E. Meyer,et al.  Dual-Task Interference and Elementary Mental Mechanisms , 1993 .

[17]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[18]  Victoria Bellotti,et al.  Walking away from the desktop computer: distributed collaboration and mobility in a product design team , 1996, CSCW '96.

[19]  Steinar Kristoffersen,et al.  “Making place” to make IT work: empirical explorations of HCI for mobile CSCW , 1999, GROUP.

[20]  Chris Schmandt,et al.  Nomadic radio: speech and audio interaction for contextual messaging in nomadic environments , 2000, TCHI.

[21]  David R. Morse,et al.  Using while moving: HCI issues in fieldwork environments , 2000, TCHI.

[22]  Paul Dourish,et al.  Where the action is , 2001 .

[23]  Kenton O'Hara,et al.  Dealing with mobility: understanding access anytime, anywhere , 2001, TCHI.

[24]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[25]  Mark S. Young,et al.  Malleable Attentional Resources Theory: A New Explanation for the Effects of Mental Underload on Performance , 2002, Hum. Factors.

[26]  Roel Vertegaal,et al.  Attentive User Interfaces , 2003 .

[27]  Antti Oulasvirta,et al.  Understanding Mobile Contexts , 2003, Mobile HCI.

[28]  Stephen A. Brewster,et al.  A paradigm shift: alternative interaction techniques for use with mobile & wearable devices , 2003, CASCON.

[29]  Mary Czerwinski,et al.  A diary study of task switching and interruptions , 2004, CHI.

[30]  Virpi Roto,et al.  Examining mobile phone use in the wild with quasi-experimentation , 2004 .

[31]  Antti Oulasvirta,et al.  A cognitive meta-analysis of design approaches to interruptions in intelligent environments , 2004, CHI EA '04.

[32]  Antti Oulasvirta.  Human-Computer Interaction in Mobile Context : A Cognitive Resources Perspective , 2004 .

[33]  Yvonne Rogers,et al.  New theoretical approaches for human-computer interaction , 2005, Annu. Rev. Inf. Sci. Technol..

[34]  Antti Oulasvirta,et al.  Temporal tensions in human-computer interaction.CHI2004 Workshop on Temporal Aspects of Work , 2004 .

[35]  Víctor M. González,et al.  "Constant, constant, multi-tasking craziness": managing multiple working spheres , 2004, CHI.

[36]  Sharon L. Oviatt,et al.  When do we interact multimodally?: cognitive load and multimodal communication patterns , 2004, ICMI '04.

[37]  Antti Oulasvirta,et al.  Task demands and memory in web interaction: a levels of processing approach , 2004, Interact. Comput..

[38]  Jesper Kjeldskov,et al.  Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field , 2004, Mobile HCI.

[39]  Virpi Roto,et al.  Need for non-visual feedback with long response times in mobile HCI , 2005, WWW '05.