Modelling human behaviour with BDI agents

Modelling Human Behaviour with BDI Agents by Emma Jane Norling Chairperson of Supervisory Committee: Professor Liz Sonenberg Although the BDI framework was not designed for human modelling applications, it has been used with considerable success in this area. The work presented here examines some of these applications to identify the strengths and weaknesses of the use of BDI-based frameworks for this purpose, and demonstrates how these weaknesses can be addressed while preserving the strengths. The key strength that is identified is the framework’s folk-psychological roots, which facilitate the knowledge acquisition and representation process when building models. Unsurprisingly, because the framework was not designed for this purpose, several shortcomings are also identified. These fall into three different classes. Firstly, although the folk-psychological roots mean that the framework captures a human-like reasoning process, it is at a very abstract level. There are many generic aspects of human behaviour – things that are common to all people across all tasks – which are not captured in the framework. If a modeller wishes to take these things into account in a model, they must explicitly encode them, replicating this effort for every model. To reduce modellers’ workload and increase consistency, it is desirable to incorporate such features into the framework. Secondly, although the folk-psychological roots facilitate knowledge acquisition, there is no standardised approach to this process, and without experience it can be very difficult to gather the appropriate knowledge from the subjects to design and build models. And finally, these models must interface with external environments in which they ‘exist.’ There are often mismatches in the data representation level which hinder this process. This work makes contributions to dealing with each of these problems, drawing largely on the folk-psychological roots that underpin the framework. The major contribution is to present a systematic approach to extending the BDI framework to incorporate further generic aspects of human behaviour and to demonstrate this approach with two different extensions. A further contribution is to present a knowledge acquisition methodology which gives modellers a structured approach to this process. The problems at the agent-environment interface are not straightforward to solve, because sometimes the problem lies in the way that the environment accepts and receives data. Rather than offering the golden solution to this problem, the contribution provided here is to highlight the different types of mismatches that may occur, so that modellers may recognise them early and adapt their approach to accommodate them. This is to certify that (i) the thesis comprises only my original work, (ii) due acknowledgement has been made in the text to all other material used, (iii) the thesis is less than 100,000 words in length, exclusive of table, maps, bibliographies, appendices and footnotes.

[1]  Joseph Weizenbaum,et al.  ELIZA—a computer program for the study of natural language communication between man and machine , 1966, CACM.

[2]  Randall W. Hill,et al.  Toward the holodeck: integrating graphics, sound, character and story , 2001, AGENTS '01.

[3]  Jacques Ferber,et al.  Environments for Multiagent Systems State-of-the-Art and Research Challenges , 2004, E4MAS.

[4]  Tibor Bosse,et al.  A Two-Level BDI-Agent Model for Theory of Mind and its Use in Social Manipulation , 2007 .

[5]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[6]  Michael Wooldridge,et al.  The Belief-Desire-Intention Model of Agency , 1998, ATAL.

[7]  Frank E. Ritter,et al.  Using A Genetic Algorithm to Optimize the Fit of Cognitive Models , 2004, ICCM.

[8]  W. Scott Neal Reilly,et al.  An Architecture for Action, Emotion, and Social Behavior , 1992, MAAMAW.

[9]  A. S. Roa,et al.  AgentSpeak(L): BDI agents speak out in a logical computable language , 1996 .

[10]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[11]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[12]  Danny Weyns,et al.  On environments in multi-agent systems , 2004 .

[13]  M. F. Ramalhoto,et al.  Ordinal Methodology in the Analysis of Likert Scales , 2007 .

[14]  John Yen,et al.  RPD-enabled agents teaming with humans for multi-context decision making , 2006, AAMAS '06.

[15]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[16]  Gary Klein Sources of Power , 1998 .

[17]  J M Schraagen,et al.  A Method for Cognitive Task Analysis , 1992 .

[18]  I. Scott MacKenzie,et al.  Accuracy measures for evaluating computer pointing devices , 2001, CHI.

[19]  François Bousquet,et al.  A Methodology for Eliciting and Modelling Stakeholders' Representations with Agent Based Modelling , 2003, MABS.

[20]  John Yen,et al.  CAST: Collaborative Agents for Simulating Teamwork , 2001, IJCAI.

[21]  Fabien Michel,et al.  Environments for Multi-Agent Systems, First International Workshop, E4MAS 2004, New York, NY, USA, July 19, 2004, Revised Selected Papers , 2005, E4MAS.

[22]  D. Scott McCrickard,et al.  Are Cognitive Architectures Mature Enough to Evaluate Notification Systems , 2003 .

[23]  John A. Sokolowski Can a Composite Agent Be Used to Implement a Recognition-Primed Decision Model , 2002 .

[24]  John E. Laird,et al.  Coordinated Behavior of Computer Generated Forces in TacAir-Soar , 1994 .

[25]  C. Kirschbaum,et al.  The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. , 1993, Neuropsychobiology.

[26]  Mark O. Riedl,et al.  A perception/action substrate for cognitive modeling in HCI , 2001, Int. J. Hum. Comput. Stud..

[27]  Claire McAndrew,et al.  "Convince Me" An inter-disciplinary study of NDM and investment managers , 2007 .

[28]  Amy L. Lansky,et al.  Reactive Reasoning and Planning , 1987, AAAI.

[29]  John A. Sokolowski Enhanced Military Decision Modeling Using a MultiAgent System Approach , 2003 .

[30]  Michael E. Bratman,et al.  Intention, Plans, and Practical Reason , 1991 .

[31]  G. Klein,et al.  Decision Making in Action: Models and Methods , 1993 .

[32]  Fabien Michel,et al.  Environments for Multi-Agent Systems III , 2008 .

[33]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[34]  Stacy Marsella,et al.  EMA: A process model of appraisal dynamics , 2009, Cognitive Systems Research.

[35]  Hideyuki Nakashima,et al.  Usability of dial-a-ride systems , 2005, AAMAS '05.

[36]  Anna Hart,et al.  Knowledge acquisition for expert systems (2nd ed.) , 1992 .

[37]  A. Newell Unified Theories of Cognition , 1990 .

[38]  Marcus Watson,et al.  Knowledge Elicitation and Decision-Modelling for Command Agents , 2003, KES.

[39]  John Yen,et al.  Extending the recognition-primed decision model to support human-agent collaboration , 2005, AAMAS '05.

[40]  A. L. Kidd,et al.  Knowledge acquisition for expert systems: a practical handbook , 1987 .

[41]  Marcus J. Huber JAM: a BDI-theoretic mobile agent architecture , 1999, AGENTS '99.

[42]  Clinton Heinze,et al.  Thinking Quickly: Agents for Modeling Air Warfare , 1998, Australian Joint Conference on Artificial Intelligence.

[43]  Wenji Mao,et al.  A Utility-Based Approach to Intention Recognition , 2004, AAMAS 2004.

[44]  Michael Winikoff,et al.  Declarative and procedural goals in intelligent agent systems , 2002, KR 2002.

[45]  Norman I. Badler,et al.  Human behavior modeling within an integrative framework , 2007 .

[46]  Walter Warwick,et al.  Computational and Theoretical Perspectives on Recognition-Primed Decision Making , 2007 .

[47]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[48]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[49]  Kevin Trott Command, Control, Communications, Computer, Intelligence, Surveillance and Reconnaissance (C4ISR) Modeling and Simulation Using Joint Semi-Automated Forces (JSAF) , 2003 .

[50]  Fernand Gobet,et al.  Individual data analysis and Unified Theories of Cognition: A methodological proposal , 2000 .

[51]  John E. Laird,et al.  Creating Human-like Synthetic Characters with Multiple Skill Levels: A Case Study using the Soar Quakebot , 2001 .

[52]  Liz Sonenberg,et al.  Enhancing Multi-Agent Based Simulation with Human-Like Decision Making Strategies , 2000, MABS.

[53]  R. Connell,et al.  The Mapping of Courses of Action Derived from Cognitive Work Analysis to Agent Behaviours , 2003 .

[54]  John David Funge,et al.  AI for Games and Animation: A Cognitive Modeling Approach , 1999 .

[55]  Frank E. Ritter,et al.  Embodied models as simulated users: introduction to this special issue on using cognitive models to improve interface design , 2001, Int. J. Hum. Comput. Stud..

[56]  W. Scott Neal Reilly,et al.  System for authoring highly interactive, personality-rich interactive characters , 2004, SCA '04.

[57]  Brian R. Gaines,et al.  Eliciting Knowledge and Transferring It Effectively to a Knowledge-Based System , 1993, IEEE Trans. Knowl. Data Eng..

[58]  B Crandall,et al.  Critical decision method: A technique for eliciting concrete assessment indicators from the intuition of NICU nurses , 1993, ANS. Advances in nursing science.

[59]  Paul R. Cohen,et al.  Heuristic reasoning about uncertainty: an artificial intelligence approach , 1984 .

[60]  Norikazu Sugimoto,et al.  Cross-Element Validation in Multiagent-based Simulation: Switching Learning Mechanisms in Agents , 2003, J. Artif. Soc. Soc. Simul..

[61]  Hideyuki Nakashima,et al.  Evaluation of Usability of Dial-a-Ride Systems by Social Simulation , 2003, MABS.

[62]  Doron Kliger,et al.  Mood-induced variation in risk preferences , 2003 .

[63]  Brian Magerko,et al.  AI Characters and Directors for Interactive Computer Games , 2004, AAAI.

[64]  David E. Kieras,et al.  An Overview of the EPIC Architecture for Cognition and Performance With Application to Human-Computer Interaction , 1997, Hum. Comput. Interact..

[65]  M. Winikoff,et al.  Declarative & Procedural Goals in Intelligent Agent Systems , 2002, KR.

[66]  David E. Kieras,et al.  Automating interface evaluation , 1994, CHI '94.

[67]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[68]  R. Sun,et al.  The interaction of the explicit and the implicit in skill learning: a dual-process approach. , 2005, Psychological review.

[69]  Michael D. Byrne,et al.  ACT-R/PM and menu selection: applying a cognitive architecture to HCI , 2001, Int. J. Hum. Comput. Stud..

[70]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[71]  Kenneth R. Boff,et al.  Engineering data compendium : human perception and performance , 1988 .

[72]  A. Goldman The psychology of folk psychology , 1993, Behavioral and Brain Sciences.

[73]  S. Stich,et al.  What is folk psychology? , 1994, Cognition.

[74]  Roberta Calderwood,et al.  Critical decision method for eliciting knowledge , 1989, IEEE Trans. Syst. Man Cybern..

[75]  John Yen,et al.  A fuzzy logic-based computational recognition-primed decision model , 2007, Inf. Sci..

[76]  Gary Jones,et al.  Over-estimating cognition time: The benefits of modelling interaction , 2000 .

[77]  Frank E. Ritter,et al.  Supporting cognitive models as users , 2000, TCHI.

[78]  Dario D. Salvucci Predicting the effects of in-car interface use on driver performance: an integrated model approach , 2001, Int. J. Hum. Comput. Stud..

[79]  Thomas J. Dormody,et al.  Analyzing Data Measured by Individual Likert-Type Items. , 1994 .

[80]  Gil Tidhar,et al.  Flying Together: Modelling Air Mission Teams , 1998, Applied Intelligence.

[81]  Benjamin D. Nye,et al.  Profiling is Politically 'Correct': Agent-Based Modeling of Ethno-Political Conflict , 2007 .

[82]  Robert W. Zmud,et al.  A Synthesis of Research on Requirements Analysis and Knowledge Acquisition Techniques , 1992, MIS Q..

[83]  J. Yen,et al.  Extending Recognition-Primed Decision Model For Human-Agent Collaboration , 2005 .

[84]  R. Lazarus Emotion and Adaptation , 1991 .

[85]  Michael D. Byrne The ACT-R/PM Project , 2000 .

[86]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[87]  Michael Wooldridge,et al.  A Formal Specification of dMARS , 1997, ATAL.

[88]  Andrew Lucas,et al.  JACK Intelligent Agents – Summary of an Agent Infrastructure , 2001 .

[89]  Stefania Bandini,et al.  Environments for Multi-Agent Systems II , 2005, Lecture Notes in Computer Science.

[90]  Lucien Zalcman,et al.  The Royal Australian Air Force, Virtual Air Environment, Interim Training Capability , 2003 .

[91]  Valerie L. Shalin,et al.  Theoretical and pragmatic influences on task analysis methods , 2000 .

[92]  Clinton Heinze,et al.  Air Combat Tactics Implementation in the Smart Whole AiR Mission Model (SWARMM) , 2007 .

[93]  Karol G. Ross,et al.  The Recognition-Primed Decision Model , 2004 .

[94]  G. Klein,et al.  A recognition-primed decision (RPD) model of rapid decision making. , 1993 .

[95]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[96]  Michael Luck,et al.  Cooperative Plan Selection Through Trust , 1999, MAAMAW.

[97]  C. Heinze Modelling Intention Recognition for Intelligent Agent Systems , 2004 .

[98]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[99]  David E. Kieras,et al.  Using GOMS for user interface design and evaluation: which technique? , 1996, TCHI.

[100]  Ron Sun,et al.  Cognition and Multi-Agent Interaction: The CLARION Cognitive Architecture: Extending Cognitive Modeling to Social Simulation , 2005 .

[101]  Valerie L. Shalin,et al.  Cognitive task analysis , 2000 .

[102]  Douglas L. Hintzman,et al.  MINERVA 2: A simulation model of human memory , 1984 .

[103]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[104]  S. Brison The Intentional Stance , 1989 .

[105]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[106]  Alexis Drogoul,et al.  Using emergence in participatory simulations to design multi-agent systems , 2005, AAMAS '05.

[107]  John E. Laird,et al.  It knows what you're going to do: adding anticipation to a Quakebot , 2001, AGENTS '01.

[108]  D. Cicchetti Emotion and Adaptation , 1993 .

[109]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[110]  Joshua M. Epstein,et al.  Growing Artificial Societies: Social Science from the Bottom Up , 1996 .

[111]  John Yen,et al.  R-CAST: Integrating Team Intelligence for Human-Centered Teamwork , 2007, AAAI.

[112]  Alexis Drogoul,et al.  Power and negotiation: lessons from agent-based participatory simulations , 2006, AAMAS '06.

[113]  Richard W. Pew,et al.  Modeling human and organizational behavior : application to military simulations , 1998 .

[114]  Simon Goss,et al.  Interchanging Agents and Humans in Military Simulation , 2002, AI Mag..

[115]  Alain Mille,et al.  Creating Cognitive Models from Activity Analysis: A Knowledge Engineering Approach to Car Driver Modeling , 2007 .

[116]  Anna Hart,et al.  Knowledge acquisition for expert systems , 1988 .

[117]  R. Hutton,et al.  Applied cognitive task analysis (ACTA): a practitioner's toolkit for understanding cognitive task demands. , 1998, Ergonomics.

[118]  Wayne D. Gray,et al.  Milliseconds Matter: an Introduction to Microstrategies and to Their Use in Describing and Predicting Interactive Behavior Milliseconds Matter: an Introduction to Microstrategies and to Their Use in Describing and Predicting Interactive Behavior , 2022 .

[119]  S.J.J. Smith,et al.  Empirical Methods for Artificial Intelligence , 1995 .

[120]  Frank E. Ritter,et al.  Towards supporting psychologically plausible variability in agent-based human modelling , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[121]  Frank Lui Mapping Cognitive Work Analysis (CWA) To An Intelligent Agents Software Architecture: Command Agents , 2002 .

[122]  Gil Tidhar,et al.  The Challenge of Whole Air Mission Modelling , 1995 .

[123]  Joseph G. Johnson,et al.  Take The First: Option-generation and resulting choices , 2003 .

[124]  J. Davenport Editor , 1960 .

[125]  Michael Wooldridge,et al.  Reasoning about rational agents , 2000, Intelligent robots and autonomous agents.

[126]  Caroline E. Zsambok,et al.  Characteristics of Skilled Option Generation in Chess , 1995 .

[127]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[128]  A. Carlisle Scott,et al.  Practical guide to knowledge acquisition , 1991 .

[129]  Adrian R. Pearce,et al.  Plan Recognition in Military Simulation: Incorporating Machine Learning with Intelligent Agents , 1999 .

[130]  John David Funge,et al.  Making them behave: cognitive models for computer animation , 1998 .