A Conceptual Design of an Inattention Management Middleware with Adaptive Target Saliency

We present a conceptual design of an inattention management middleware with adaptive target saliency. The design objective is to provide mechanisms for managing operator inattention in multi-display multitasking applications. The conceptual design integrates ideas from situational awareness into its mechanisms to provide dynamic target saliency as a means to 1) guide operators through sub-tasks by drawing attention to high priority targets; and 2) guide operators on how to efficiently split their attention between tasks. We motivate the design by analysis of the results following a formative study with a prototype version of the conceptual design.

[1]  Jean-Paul Imbert,et al.  Attentional costs and failures in air traffic control notifications , 2014, Ergonomics.

[2]  Esa M. Rantanen,et al.  Effect of Air Traffic Controller Taskload and Temporal Awareness on Task Prioritization , 2005 .

[3]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[4]  Per Ola Kristensson,et al.  AwToolkit: attention-aware user interface widgets , 2014, AVI.

[5]  Joan M. Ryder,et al.  Cognitive Task Analysis of Expertise in Air Traffic Control , 1993 .

[6]  Per Ola Kristensson,et al.  Inattention-Management Middleware for Human-in-the-Loop Multi-Display Applications , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[7]  Per Ola Kristensson,et al.  Subtle gaze-dependent techniques for visualising display changes in multi-display environments , 2013, IUI '13.

[8]  Hugo Lopez-Tovar,et al.  Managing Smartphone Interruptions through Adaptive Modes and Modulation of Notifications , 2015, IUI.

[9]  Thierry Nabeth,et al.  Supporting Attention in Learning Environments: Attention Support Services, and Information Management , 2007, EC-TEL.

[10]  Mirco Musolesi,et al.  Designing content-driven intelligent notification mechanisms for mobile applications , 2015, UbiComp.

[11]  Jonathan Histon,et al.  Structural considerations and cognitive complexity in air traffic control , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[12]  Julie Thomas,et al.  Attention aware systems: Theories, applications, and research agenda , 2006, Comput. Hum. Behav..

[13]  Brian P. Bailey,et al.  On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state , 2006, Comput. Hum. Behav..

[14]  N A Stanton,et al.  Distributed situation awareness in dynamic systems: theoretical development and application of an ergonomics methodology , 2006, Ergonomics.

[15]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[16]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[17]  Mary Czerwinski,et al.  Notification, Disruption, and Memory: Effects of Messaging Interruptions on Memory and Performance , 2001, INTERACT.

[18]  Andrew Olney,et al.  Gaze tutor: A gaze-reactive intelligent tutoring system , 2012, Int. J. Hum. Comput. Stud..

[19]  Uta Hinrichs,et al.  SpiderEyes: designing attention- and proximity-aware collaborative interfaces for wall-sized displays , 2014, IUI.

[20]  I. Rock,et al.  Perception without attention: Results of a new method , 1992, Cognitive Psychology.

[21]  William Stallings,et al.  Operating Systems: Internals and Design Principles , 1991 .

[22]  Simon Farrell,et al.  Remembering to Execute Deferred Tasks in Simulated Air Traffic Control: The Impact of Interruptions , 2018, Journal of experimental psychology. Applied.

[23]  Sébastien Tremblay,et al.  Supporting dynamic change detection: using the right tool for the task , 2016, Cognitive research: principles and implications.

[24]  Albrecht Schmidt,et al.  Multi-Sensor Context-Awareness in Mobile Devices and Smart Artifacts , 2002, Mob. Networks Appl..

[25]  Brian P. Bailey,et al.  Effects of intelligent notification management on users and their tasks , 2008, CHI.