Attention Aware Systems

Attention-aware systems (AAS) are systems capable of adapting to, and supporting, human attentional processes especially in situations of multi-tasking, frequent interactions with other users, and highly dynamic environments. In this paper we discuss the rationale for AASs and their role within current HCI research, we review current research and applications of AASs, and we highlight the issues that will need to be addressed in the future for their design.

[1]  S. Monsell,et al.  Costs of a predictible switch between simple cognitive tasks. , 1995 .

[2]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[3]  Pattie Maes,et al.  Agents that reduce work and information overload , 1994, CACM.

[4]  Boris Brandherm,et al.  Empirically Grounded Decision-Theoretic Adaptation to Situation-Dependent Resource Limitations , 2002, Künstliche Intell..

[5]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[6]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[7]  J. Kruschke.  Toward a unified model of attention in associative learning , 2001 .

[8]  William A. Nugent,et al.  Human-computer interaction for alert warning and attention allocation systems of the multimodal watchstation , 2000, SPIE Optics + Photonics.

[9]  Mary Czerwinski,et al.  Notification, Disruption, and Memory: Effects of Messaging Interruptions on Memory and Performance , 2001, INTERACT.

[10]  Päivi Majaranta,et al.  Design issues of iDICT: a gaze-assisted translation aid , 2000, ETRA.

[11]  A. Treisman.  Contextual Cues in Selective Listening , 1960 .

[12]  David Bargeron,et al.  Notification for shared annotation of digital documents , 2002, CHI.

[13]  Mark Weiser.  The computer for the 21st century , 1991 .

[14]  Antti Oulasvirta,et al.  A cognitive meta-analysis of design approaches to interruptions in intelligent environments , 2004, CHI EA '04.

[15]  Morten Fjeld,et al.  Physical and Virtual Tools: Activity Theory Applied to the Design of Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[16]  Roel Vertegaal,et al.  Using mental load for managing interruptions in physiologically attentive user interfaces , 2004, CHI EA '04.

[17]  Jon Trinder,et al.  The Humane Interface: New Directions for Designing Interactive Systems , 2002, Interact. Learn. Environ..

[18]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[19]  Jacob P. Somervell,et al.  A model for notification systems evaluation—assessing user goals for multitasking activity , 2003, TCHI.

[20]  Julie Thomas,et al.  Attention aware systems: Theories, applications, and research agenda , 2006, Comput. Hum. Behav..

[21]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[22]  David M. Frohlich,et al.  Timespace in the workplace: dealing with interruptions , 1995, CHI 95 Conference Companion.

[23]  K. Rayner.  Eye Movements and Cognitive Processes in Reading, Visual Search, and Scene Perception , 1995 .

[24]  S. Grossberg.  The Link between Brain Learning, Attention, and Consciousness , 1999, Consciousness and Cognition.

[25]  I. Biederman,et al.  Mental set and mental shift revisited , 1976 .

[26]  Ben Shneiderman,et al.  Direct manipulation versus agents: paths to predictable, controllable, and comprehensible interfaces , 1997 .

[27]  Ernesto Arroyo,et al.  Self-adaptive multimodal-interruption interfaces , 2003, IUI '03.

[28]  Mary Zajicek,et al.  Designing for Attention(2) , 2007 .

[29]  Nilli Lavie,et al.  Selective attention and cognitive control: dissociating attentional functions through different types of load , 1998 .

[30]  Eric Horvitz,et al.  Models of attention in computing and communication , 2003, Commun. ACM.

[31]  Roel Vertegaal,et al.  The GAZE groupware system: mediating joint attention in multiparty communication and collaboration , 1999, CHI '99.

[32]  Joseph S. Valacich,et al.  The Effects of Interruptions, Task Complexity, and Information Presentation on Computer-Supported Decision-Making Performance , 2003, Decis. Sci..

[33]  Philip R. Cohen,et al.  Intentions in Communication , 1991, CL.

[34]  Michael R. Genesereth,et al.  Software agents , 1994, CACM.

[35]  P. Perona,et al.  Rapid natural scene categorization in the near absence of attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Summary: Let's Pay Attention to Attention , 2000, The Journal of general psychology.

[37]  Jeremy M. Wolfe,et al.  The Level of Attention: Mediating Between the Stimulus and Perception , 2003 .

[38]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[39]  F. Zijlstra,et al.  Temporal factors in mental work: Effects of interrupted activities , 1999 .

[40]  Y. Tsal,et al.  Perceptual load as a major determinant of the locus of selection in visual attention , 1994, Perception & psychophysics.

[41]  N. Moray.  Designing for attention. , 1993 .

[42]  J. Kruschke.  Attention in Learning , 2003 .

[43]  Ronald A. Rensink.  Seeing, sensing, and scrutinizing , 2000, Vision Research.

[44]  N. Mackintosh.  A Theory of Attention: Variations in the Associability of Stimuli with Reinforcement , 1975 .

[45]  D. Norman.  Memory and attention: An introduction to human information processing. , 1994 .

[46]  D. Kieras,et al.  Modern computational perspectives on executive mental processes and cognitive control: Where to from here? , 2000 .

[47]  David Maulsby,et al.  Inductive task modeling for user interface customization , 1997, IUI '97.

[48]  Eric B. Baum,et al.  What is thought? , 2003 .

[49]  J. Duncan.  The locus of interference in the perception of simultaneous stimuli. , 1980 .

[50]  D. Scott McCrickard,et al.  Attuning notification design to user goals and attention costs , 2003, Commun. ACM.

[51]  Mary Beth Rosson,et al.  Notification and awareness: synchronizing task-oriented collaborative activity , 2003, Int. J. Hum. Comput. Stud..

[52]  Victor A. F. Lamme,et al.  Separate neural definitions of visual consciousness and visual attention; a case for phenomenal awareness , 2004, Neural Networks.

[53]  Brian P. Bailey,et al.  The Effects of Interruptions on Task Performance, Annoyance, and Anxiety in the User Interface , 2001, INTERACT.

[54]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[55]  N. Negroponte.  Agents: from direct manipulation to delegation , 1997 .

[56]  Alexander Toet,et al.  Gaze directed displays as an enabling technology for attention aware systems , 2006, Comput. Hum. Behav..

[57]  H. Pashler.  The Psychology of Attention , 1997 .

[58]  D. Scott McCrickard,et al.  Unpacking critical parameters for interface design: evaluating notification systems with the IRC framework , 2004, DIS '04.

[59]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors: a Wizard of Oz feasibility study , 2003, CHI '03.

[60]  Philip R. Cohen,et al.  Intentions in Communication. , 1992 .

[61]  Sridhar Seshadri,et al.  Managerial Allocation of Time and Effort: The Effects of Interruptions , 2001, Manag. Sci..

[62]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[63]  Loren G. Terveen,et al.  Let's Stop Pushing the Envelope and Start Addressing It: A Reference Task Agenda for HCI , 2000, Hum. Comput. Interact..

[64]  S. Grossberg,et al.  Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors , 1976, Biological Cybernetics.

[65]  Gregory D. Abowd,et al.  The Human Experience , 2002, IEEE Pervasive Comput..

[66]  Daniel C. McFarlane,et al.  Comparison of Four Primary Methods for Coordinating the Interruption of People in Human-Computer Interaction , 2002, Hum. Comput. Interact..

[67]  Eric Horvitz,et al.  Sensing techniques for mobile interaction , 2000, UIST '00.

[68]  Kara A. Latorella,et al.  The Scope and Importance of Human Interruption in Human-Computer Interaction Design , 2002, Hum. Comput. Interact..

[69]  J. Stroop.  Studies of interference in serial verbal reactions. , 1992 .

[70]  Micheal Scott Hewett,et al.  Computational Perceptual Attention , 2001 .

[71]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[72]  Thomas W. Calvert,et al.  Moticons: : detection, distraction and task , 2003, Int. J. Hum. Comput. Stud..

[73]  Stacey F. Nagata,et al.  Multitasking and Interruptions during Mobile Web Tasks , 2003 .

[74]  J. Lewis,et al.  Semantic processing of unattended messages using dichotic listening. , 1970, Journal of experimental psychology.

[75]  A. Treisman.  Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[76]  D. G. MacKay.  Aspects of the Theory of Comprehension, Memory and Attention , 1973 .

[77]  Mary Czerwinski,et al.  Introduction: design and evaluation of notification user interfaces , 2003, Int. J. Hum. Comput. Stud..

[78]  Gregory D. Abowd,et al.  Software engineering issues for ubiquitous computing , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[79]  Rainer Stiefelhagen,et al.  Tracking focus of attention in meetings , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[80]  John T. Stasko,et al.  Establishing tradeoffs that leverage attention for utility: empirically evaluating information display in notification systems , 2003, Int. J. Hum. Comput. Stud..

[81]  Mary Czerwinski,et al.  Instant Messaging: Effects of Relevance and Timing , 2000 .

[82]  Anders Fagerjord.  Rhetorical convergence: studying web media , 2003 .

[83]  Sara Jones,et al.  Towards usability guidelines for multimedia systems , 1994, MULTIMEDIA '94.

[84]  Marlin M. Cluts.  The evolution of artifacts in cooperative work: constructing meaning through activity , 2003, GROUP.

[85]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[86]  S. Yantis.  Control of visual attention. , 1998 .

[87]  Victor Kaptelinin,et al.  Activity theory: basic concepts and applications , 1997, CHI Extended Abstracts.

[88]  Martin R. Gibbs,et al.  Mediating intimacy: designing technologies to support strong-tie relationships , 2005, CHI.

[89]  David Beymer,et al.  What ’ s in the EYES for Attentive Input , 2003 .

[90]  Philip R. Cohen,et al.  Plans for Discourse , 2003 .

[91]  A. Treisman.  Strategies and models of selective attention. , 1969, Psychological review.

[92]  Wendy A. Kellogg,et al.  "I'd be overwhelmed, but it's just one more thing to do": availability and interruption in research management , 2002, CHI.

[93]  Andrew Sears,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2002, CHI 2002.

[94]  Anthony Jameson,et al.  Making systems sensitive to the user's time and working memory constraints , 1998, IUI '99.

[95]  M. Ruffin.  On being digital. , 1995, Physician executive.

[96]  C. Koch,et al.  Visual Search and Dual Tasks Reveal Two Distinct Attentional Resources , 2004, Journal of Cognitive Neuroscience.

[97]  Eric Horvitz,et al.  Learning and reasoning about interruption , 2003, ICMI '03.

[98]  Päivi Majaranta,et al.  Proactive Response to Eye Movements , 2003, INTERACT.

[99]  Munindar P. Singh,et al.  Readings in agents , 1997 .

[100]  Brian P. Bailey,et al.  A framework for specifying and monitoring user tasks , 2006, Comput. Hum. Behav..

[101]  David E. Meyer,et al.  Executive control of cognitive processes in task switching. , 2001 .

[102]  William M. Newman,et al.  Better or just different? On the benefits of designing interactive systems in terms of critical parameters , 1997, DIS '97.

[103]  J Driver,et al.  A selective review of selective attention research from the past century. , 2001, British journal of psychology.