A Software Environment for an Adaptive Human-Aware Software Agent Supporting Attention-Demanding Tasks

This paper presents a software environment providing human-aware ambient support for a human performing a task that demands substantial amounts of attention. The agent obtains human attention-awareness in an adaptive manner by use of a dynamical model of human attention, gaze sensoring by an eye-tracker, and information about features of the objects in the environment which is parameterised for characteristics of the human specified above. The agent uses a built-in adaptation model to adapt on the fly, the values of these parameters to the personal characteristics of the human. The software agent has been implemented in a component-based manner within the Adobe® Flex® environment, thereby also integrating the Tobii® eye-tracker. It has been applied in a setup for a task where the human has to identify enemies and allies, and eliminate the enemies.

[1]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[2]  Tibor Bosse,et al.  Specification and Verification of Dynamics in Cognitive Agent Models , 2006, 2006 IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[3]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[4]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[5]  Tibor Bosse,et al.  Simulation and formal analysis of visual attention , 2009, Web Intell. Agent Syst..

[6]  Giovanni Galfano,et al.  Color, form and luminance capture attention in visual search , 2000, Vision Research.

[7]  Tibor Bosse,et al.  Adaptive Estimation of Emotion Generation for an Ambient Agent Model , 2008, AmI.

[8]  Tibor Bosse,et al.  An Adaptive Human-Aware Software Agent Supporting Attention-Demanding Tasks , 2009, PRIMA.

[9]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[10]  G. Saridis.  Parameter estimation: Principles and problems , 1983, Proceedings of the IEEE.

[11]  Peter D. Richardson,et al.  Numerical Methods in Engineering and Science , 1987 .

[12]  David B. Kaber,et al.  Situation awareness and attention allocation measures for quantifying telepresence experiences in teleoperation , 2004 .

[13]  Tibor Bosse,et al.  A RECURSIVE BDI AGENT MODEL FOR THEORY OF MIND AND ITS APPLICATIONS , 2011, Appl. Artif. Intell..

[14]  Tibor Bosse,et al.  A Two-Level BDI-Agent Model for Theory of Mind and its Use in Social Manipulation , 2007 .

[15]  M. Winterbottom,et al.  How Homo became Sapiens — On the Evolution of Thinking , 2006 .

[16]  Tibor Bosse,et al.  Specification and Verification of Dynamics in Agent Models , 2009, Int. J. Cooperative Inf. Syst..

[17]  Jan Treur,et al.  A software environment for a human-aware ambient agent supporting attention-demanding tasks , 2010, ICCS.

[18]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[19]  Jon C. Helton,et al.  Numerical methods in engineering and science , 1986 .

[20]  Tibor Bosse,et al.  Automated Visual Attention Manipulation , 2009, WAPCV.

[21]  T. Gelder,et al.  Mind as Motion: Explorations in the Dynamics of Cognition , 1995 .

[22]  P. Gärdenfors.  How Homo Became Sapiens: On the Evolution of Thinking , 2003 .

[23]  Alvin I. Goldman,et al.  Précis of Simulating Minds: The Philosophy, Psychology, and Neuroscience of Mindreading , 2006 .

[24]  Michel C. A. Klein,et al.  A Component-Based Ambient Agent Model for Assessment of Driving Behaviour , 2008, UIC.

[25]  Tibor Bosse,et al.  Attention Manipulation for Naval Tactical Picture Compilation , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.