Where to Look? Automating Attending Behaviors of Virtual Human Characters

This research proposes a computational framework for generating visual attending behavior in an embodied simulated human agent. Such behaviors directly control eye and head motions, and guide other actions such as locomotion and reach. The implementation of these concepts, referred to as the AVA, draws on empirical and qualitative observations known from psychology, human factors and computer vision. Deliberate behaviors, the analogs of scanpaths in visual psychology, compete with involuntary attention capture and lapses into idling or free viewing. Insights provided by implementing this framework are: a defined set of parameters that impact the observable effects of attention, a defined vocabulary of looking behaviors for certain motor and cognitive activity, a defined hierarchy of three levels of eye behavior (endogenous, exogenous and idling) and a proposed method of how these types interact.

[1]  C. L. M..  The Psychology of Attention , 1890, Nature.

[2]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[3]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[4]  D. Kahneman.  Attention and Effort , 1973 .

[5]  J. Jonides.  Voluntary versus automatic control over the mind's eye's movement , 1981 .

[6]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[7]  B. Fischer.  The role of attention in the preparation of visually guided eye movements in monkey and man , 1986, Psychological research.

[8]  S. Yantis,et al.  Abrupt visual onsets and selective attention: voluntary versus automatic allocation. , 1990, Journal of experimental psychology. Human perception and performance.

[9]  D. Meyer,et al.  Eye-hand coordination: oculomotor control in rapid aimed limb movements. , 1990, Journal of experimental psychology. Human perception and performance.

[10]  Lawrence W. Stark,et al.  Visual perception and sequences of eye movement fixations: a stochastic modeling approach , 1992, IEEE Trans. Syst. Man Cybern..

[11]  N. Moray.  Designing for attention. , 1993 .

[12]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[13]  S. Yantis.  Stimulus-driven attentional capture and attentional control settings. , 1993, Journal of experimental psychology. Human perception and performance.

[14]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[15]  Demetri Terzopoulos,et al.  Artificial Fishes: Autonomous Locomotion, Perception, Behavior, and Learning in a Simulated Physical World , 1994, Artificial Life.

[16]  D. Alan Allport,et al.  SHIFTING INTENTIONAL SET - EXPLORING THE DYNAMIC CONTROL OF TASKS , 1994 .

[17]  S. Yantis,et al.  Visual motion and attentional capture , 1994, Perception & psychophysics.

[18]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[19]  Rajesh P. N. Rao,et al.  Modeling Saccadic Targeting in Visual Search , 1995, NIPS.

[20]  Norman I. Badler,et al.  Decision networks for integrating the behaviors of virtual agents and avatars , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[21]  L. Stark,et al.  Experimental metaphysics: The scanpath as an epistemological mechanism , 1996 .

[22]  W. Lewis Johnson,et al.  Integrating pedagogical capabilities in a virtual environment agent , 1997, AGENTS '97.

[23]  E. Ldavas,et al.  Eye Movements and Orienting of Attention in Patients with Visual Neglect , 1997, Journal of Cognitive Neuroscience.

[24]  Brian Scassellati,et al.  Alternative Essences of Intelligence , 1998, AAAI/IAAI.

[25]  Brian Scassellati.  Mechanisms of Shared Attention for a Humanoid Robot , 1998 .

[26]  Norman I. Badler,et al.  Where to Look? Automating Attending Behaviors of Virtual Human Characters , 1999, Agents.