Automatic Generation of Agent Behavior Models from Raw Observational Data

Agent-based modeling is used to simulate human behaviors in different fields. The process of building believable models of human behavior requires that domain experts and Artificial Intelligence experts work closely together to build custom models for each domain, which requires significant effort. The aim of this study is to automate at least some parts of this process. We present an algorithm called Open image in new window , which produces an agent behavioral model from raw observational data. It calculates transition probabilities between actions and identifies decision points at which the agent requires additional information in order to choose the appropriate action. Our experiments using synthetically-generated data and real-world data from a hospital setting show that the Open image in new window algorithm can automatically produce an agent decision process. The agent’s underlying behavior can then be modified by domain experts, thus reducing the complexity of producing believable agent behavior from field data.

[1]  José M. Vidal,et al.  Effective Healthcare Process Redesign through an Interdisciplinary Team Approach , 2013, MedInfo.

[2]  Babak Esfandiari,et al.  A Case-Based Reasoning Approach to Imitating RoboCup Players , 2008, FLAIRS.

[3]  Risto Miikkulainen,et al.  UT2: Human-like behavior via neuroevolution of combat behavior and replay of human traces , 2011, CIG.

[4]  Nathan Huynh,et al.  Application of Computer Simulation Modeling to Medication Administration Process Redesign , 2012 .

[5]  Graham Clarke,et al.  Affect-aware behaviour modelling and control inside an intelligent environment , 2010, Pervasive Mob. Comput..

[6]  Gordon Cheng,et al.  Learning tasks from observation and practice , 2004, Robotics Auton. Syst..

[7]  Mark Steedman,et al.  Extracting common sense knowledge from text for robot planning , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[9]  Diane J. Cook,et al.  MavHome: an agent-based smart home , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[10]  Karen Zita Haigh,et al.  Learning Models of Human Behaviour with Sequential Patterns , 2002 .

[11]  John N. Tsitsiklis,et al.  The Complexity of Markov Decision Processes , 1987, Math. Oper. Res..

[12]  Tucker R. Balch,et al.  Learning executable agent behaviors from observation , 2006, AAMAS '06.