Evaluating situation awareness of autonomous systems

Autonomous systems proved to be very successful in specialized problem domains. But their perception, reasoning, planning and behavior capabilities are generally designed to fit special purposes. For instance, a robotic agent perceives its environment in a way that was defined in advance by a human designer. The agent does not exhibit a certain perception behavior because it actually thinks it would be reasonable to do so. But with an increasing level of autonomy as well as a larger temporal and spatial scope of agent operation higher-level situation analysis and assessment become essential. This paper examines criteria for evaluating situation-awareness of autonomous systems and proposes methods to satisfy them. An example application scenario is presented that provides initial results for evaluating situation-aware systems.

[1]  Anthony G. Cohn,et al.  A Spatial Logic based on Regions and Connection , 1992, KR.

[2]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[3]  Ubbo Visser,et al.  Ontology-based search for interactive digital maps , 2004, IEEE Intelligent Systems.

[4]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[5]  Suchi Saria,et al.  Reasoning at the Right Time Granularity , 2007, UAI.

[6]  Craig Schlenoff,et al.  RCS : An Intelligent Agent Architecture , 2004 .

[7]  E. Knudsen.  Fundamental components of attention. , 2007, Annual review of neuroscience.

[8]  Diego Calvanese,et al.  The Description Logic Handbook , 2007 .

[9]  Paul Davidsson,et al.  Multi Agent Based Simulation: Beyond Social Simulation , 2000, MABS.

[10]  Jan D. Gehrke,et al.  Traffic Prediction for Agent Route Planning , 2008, ICCS.

[11]  Ian Horrocks,et al.  OWL Web Ontology Language Reference-W3C Recommen-dation , 2004 .

[12]  BellifemineFabio,et al.  Developing multi-agent systems with a FIPA-compliant agent framework , 2001 .

[13]  Bernd Scholz-Reiter,et al.  Autonomous Logistic Processes - New Demands and First Approaches - , 2004 .

[14]  Richard M. Fujimoto,et al.  Parallel and Distribution Simulation Systems , 1999 .

[15]  Ahmed Y. Tawfik,et al.  Temporal Relevance in Dynamic Decision Networks with Sparse Evidence , 2005, Applied Intelligence.

[16]  Michael Wooldridge,et al.  Reasoning about rational agents , 2000, Intelligent robots and autonomous agents.

[17]  Keith L. Clark,et al.  Negation as Failure , 1987, Logic and Data Bases.

[18]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[19]  Stefan Kirn.  Multiagent Engineering, Theory and Applications in Enterprises , 2006, Multiagent Engineering.

[20]  Diego Calvanese,et al.  The Description Logic Handbook: Theory, Implementation, and Applications , 2003, Description Logic Handbook.

[21]  James S. Albus,et al.  4D/RCS: a reference model architecture for intelligent unmanned ground vehicles , 2002, SPIE Defense + Commercial Sensing.

[22]  Agostino Poggi,et al.  Developing multi‐agent systems with a FIPA‐compliant agent framework , 2001 .

[23]  Michael E. Bratman,et al.  Intention, Plans, and Practical Reason , 1991 .

[24]  Jan D. Gehrke,et al.  Designing a Simulation Middleware for FIPA Multiagent Systems , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[25]  H. Van Dyke Parunak,et al.  Agent-Based Modeling vs. Equation-Based Modeling: A Case Study and Users' Guide , 1998, MABS.

[26]  Nir Friedman,et al.  Continuous Time Markov Networks , 2006, UAI.

[27]  Ingo J. Timm,et al.  Knowledge Management to Support Situation-aware Risk Management in Autonomous, Self-managing Agents , 2005, SOAS.

[28]  Ronald A. Howard,et al.  Influence Diagrams , 2005, Decis. Anal..

[29]  Michael Wooldridge,et al.  Intelligent agents: theory and practice The Knowledge Engineering Review , 1995 .

[30]  B. P. Zeigler,et al.  High autonomy systems: concepts and models , 1990, Proceedings [1990]. AI, Simulation and Planning in High Autonomy Systems.

[31]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[32]  Daphne Koller,et al.  Learning Continuous Time Bayesian Networks , 2002, UAI.

[33]  Walter Lang,et al.  Applying autonomous sensor systems in logistics—Combining sensor networks, RFIDs and software agents , 2006 .

[34]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[35]  R.M. Fujimoto,et al.  Parallel and distributed simulation systems , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[36]  L. Stein,et al.  OWL Web Ontology Language - Reference , 2004 .

[37]  Ronald A. Howard,et al.  Information Value Theory , 1966, IEEE Trans. Syst. Sci. Cybern..

[38]  Anita Raja,et al.  Meta-level reasoning in deliberative agents , 2004 .