Predicting time-sharing in mobile interaction

The era of modern personal and ubiquitous computers is beset with the problem of fragmentation of the user’s time between multiple tasks. Several adaptations have been envisioned that would support the performance of the user in the dynamically changing contexts in which interactions with mobile devices take place. This paper assesses the feasibility of sensor-based prediction of time-sharing, operationalized in terms of the number of glances, the duration of the longest glance, and the total and average durations of the glances to the interaction task. The data used for constructing and validating the predictive models was acquired from a field study (N = 28), in which subjects performing mobile browsing tasks were observed for approximately 1 h in a variety of environments and situations. The predictive accuracy achieved in binary classification tasks was about 70% (about 20% above default), and the most informative sensors were related to the environment and interactions with the mobile device. Implications to the feasibility of different kinds of adaptations are discussed.

[1]  Sandra Carberry,et al.  Techniques for Plan Recognition , 2001, User Modeling and User-Adapted Interaction.

[2]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[3]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[4]  Alfred Kobsa,et al.  Generic User Modeling Systems , 2001, User modeling and user-adapted interaction.

[5]  S. Monsell.  Task switching , 2003, Trends in Cognitive Sciences.

[6]  Richard L. Lewis,et al.  Generating automated predictions of behavior strategically adapted to specific performance objectives , 2006, CHI.

[7]  E. M. Altmann,et al.  Task Interruption: Resumption Lag and the Role of Cues , 2004 .

[8]  C McFarlaneDaniel,et al.  The scope and importance of human interruption in human-computer interaction design , 2002 .

[9]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[10]  Roel Vertegaal,et al.  Attentive User Interfaces , 2003 .

[11]  Anthony Jameson,et al.  User Multitasking with Mobile Multimodal Systems , 2005 .

[12]  J. S. Urban Hjorth,et al.  Computer Intensive Statistical Methods: Validation, Model Selection, and Bootstrap , 1993 .

[13]  Brian P. Bailey,et al.  If not now, when?: the effects of interruption at different moments within task execution , 2004, CHI.

[14]  James Fogarty,et al.  Examining the robustness of sensor-based statistical models of human interruptibility , 2004, CHI.

[15]  Wayne D. Gray,et al.  Milliseconds Matter: an Introduction to Microstrategies and to Their Use in Describing and Predicting Interactive Behavior Milliseconds Matter: an Introduction to Microstrategies and to Their Use in Describing and Predicting Interactive Behavior , 2022 .

[16]  David Clark.  Natural Language, Relevancy Ranking, and Common Sense , 1999 .

[17]  R. Näätänen.  Attention and brain function , 1992 .

[18]  Heikki Summala,et al.  Driving experience and time-sharing during in-car tasks on roads of different width , 1998 .

[19]  Antti Oulasvirta,et al.  Understanding Mobile Contexts , 2003, Mobile HCI.

[20]  Murray Glanzer,et al.  Short-term storage in the processing of text , 1981 .

[21]  Bernt Schiele,et al.  Context-aware notification for wearable computing , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[22]  Laila Dybkjær,et al.  Spoken Multimodal Human-Computer Dialogue in Mobile Environments , 2005 .

[23]  Alfred Kobsa,et al.  Generic User Modeling Systems , 2001, User Modeling and User-Adapted Interaction.

[24]  John C. Tang,et al.  Rhythm modeling, visualizations and applications , 2003, UIST '03.

[25]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors: a Wizard of Oz feasibility study , 2003, CHI '03.

[26]  P W Burgess,et al.  Strategy application disorder: the role of the frontal lobes in human multitasking , 2000, Psychological research.

[27]  Dario D. Salvucci.  A Multitasking General Executive for Compound Continuous Tasks , 2005, Cogn. Sci..

[28]  Tapio Seppänen,et al.  Adapting applications in handheld devices using fuzzy context information , 2003, Interact. Comput..

[29]  Gerhard Fischer,et al.  User Modeling in Human–Computer Interaction , 2001, User Modeling and User-Adapted Interaction.

[30]  Eric Horvitz,et al.  Attention-Sensitive Alerting , 1999, UAI.

[31]  Ron Kohavi,et al.  Wrappers for feature selection , 1997 .

[32]  Víctor M. González,et al.  "Constant, constant, multi-tasking craziness": managing multiple working spheres , 2004, CHI.

[33]  James Fogarty,et al.  Presence versus availability: the design and evaluation of a context-aware communication client , 2004, Int. J. Hum. Comput. Stud..

[34]  Antti Oulasvirta,et al.  Six modes of proactive resource management: a user-centric typology for proactive behaviors , 2004, NordiCHI '04.

[35]  David E. Meyer,et al.  Dual-Task Interference and Elementary Mental Mechanisms , 1993 .

[36]  Mary Czerwinski,et al.  Notification, Disruption, and Memory: Effects of Messaging Interruptions on Memory and Performance , 2001, INTERACT.

[37]  James Fogarty,et al.  Examining task engagement in sensor-based statistical models of human interruptibility , 2005, CHI.

[38]  Wai-Tat Fu,et al.  Resolving the paradox of the active user: stable suboptimal performance in interactive tasks , 2004, Cogn. Sci..

[39]  Frank J. Lee,et al.  Deciding when to switch tasks in time-critical multitasking , 2005, Cognitive Systems Research.

[40]  Anthony Jameson,et al.  Making systems sensitive to the user's changing resource limitations , 1999, Knowl. Based Syst..

[41]  Kara A. Latorella,et al.  The Scope and Importance of Human Interruption in Human-Computer Interaction Design , 2002, Hum. Comput. Interact..

[42]  E. Horvitz,et al.  ON in Computing and P rinciples to Applications , 2003 .

[43]  HorvitzEric,et al.  Models of attention in computing and communication , 2003 .

[44]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[45]  Austin Henderson,et al.  A multiple, virtual-workspace interface to support user task switching , 1986, CHI '87.

[46]  Bernt Schiele,et al.  A model for human interruptability: experimental evaluation and automatic estimation from wearable sensors , 2004, Eighth International Symposium on Wearable Computers.

[47]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[48]  Richard L. Lewis,et al.  A constraint satisfaction approach to predicting skilled interactive cognition , 2004, CHI.

[49]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[50]  Mika Raento,et al.  Interpreting and Acting on Mobile Awareness Cues , 2007, Hum. Comput. Interact..

[51]  S. T. Buckland,et al.  Computer Intensive Statistical Methods: Validation, Model Selection, and Bootstrap , 1993 .

[52]  Joyce Ho,et al.  Using context-aware computing to reduce the perceived burden of interruptions from mobile devices , 2005, CHI.

[53]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[54]  Eric Horvitz,et al.  Learning and reasoning about interruption , 2003, ICMI '03.