A template-based and pattern-driven approach to situation awareness and assessment in virtual humans

Situation awareness and assessment are fundamental components of rational virtual humans. They are central parts of models of virtual humans and critical elements of efficient reasoning and planning systems. In this paper, we describe our efforts of developing the capability of situation awareness in autonomous, synthetic virtual pilots in a military domain. After briefly describing the motivations of this research, we present an agent architecture that integrates perception, reasoning with situation awareness, and actions. We describe a representation of situations, methods for situation assessment, and applications of situation awareness in information collection, and creating focused attention. The quantitative measure from our experiment shows that by using focused attention based on the ability of situation awareness, the perceptional load of virtual pilots is significantly reduced, reducing pilots’ response time by more than 50 percent.

[1]  Alfred Mele,et al.  Autonomous agents , 1995 .

[2]  A. Newell,et al.  The Soar papers (vol. II): research on integrated intelligence , 1993 .

[3]  Randall W. Hill,et al.  Modeling Perceptual Attention in Virtual Humans , 1999 .

[4]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[5]  C. Eriksen,et al.  Allocation of attention in the visual field. , 1985, Journal of experimental psychology. Human perception and performance.

[6]  Norman I. Badler,et al.  Where to Look? Automating Attending Behaviors of Virtual Human Characters , 1999, Agents.

[7]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[8]  Richard W. Pew,et al.  Modeling human and organizational behavior : application to military simulations , 1998 .

[9]  Jannes Aasman,et al.  Modelling driver behaviour in soar , 1995 .

[10]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[11]  John E. Laird,et al.  The soar papers : research on integrated intelligence , 1993 .

[12]  Sheldon Baron,et al.  PROCRU: A model for analyzing flight crew procedures in approach to landing , 1980 .

[13]  B. Chandrasekaran,et al.  A Theory of Spatio-Temporal Aggregation for Vision , 1981, Artif. Intell..

[14]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[15]  John K. Tsotsos,et al.  Modeling Visual Attention via Selective Tuning , 1995, Artif. Intell..

[16]  Steven A. Shafer,et al.  Control of Perceptual Attention in Robot Driving , 1995, Artif. Intell..

[17]  John Rischard Rice,et al.  Mathematical Software , 1971 .