Learning From Humans: Agent Modeling With Individual Human Behaviors

Multiagent-based simulation (MABS) is a very active interdisciplinary area bridging multiagent research and social science. The key technology to conduct truly useful MABS is agent modeling for reproducing realistic behaviors. In order to make agent models realistic, it seems natural to learn from human behavior in the real world. The challenge presented in this paper is to obtain an individual behavior model by using participatory modeling in the traffic domain. We show a methodology that can elicit prior knowledge for explaining human driving behavior in specific environments, and then construct a driving behavior model based on the set of prior knowledge. In the real world, human drivers often perform unintentional actions, and occasionally, they have no logical reason for their actions. In these cases, we cannot rely on prior knowledge to explain them. We are forced to construct a behavior model with an insufficient amount of knowledge to reproduce the driving behavior. To construct such individual driving behavior model, we take the approach of using knowledge from others to complement the lack of knowledge from the target. To clarify that the behavior model including prior knowledge from others offers individuality in driving behavior, we experimentally confirm that the driving behaviors reproduced by the hybrid model correlate reasonably well with human behavior.

[1]  Koichi Kurumatani,et al.  Smooth traffic flow with a cooperative car navigation system , 2005, AAMAS '05.

[2]  Brahim Chaib-draa,et al.  Multi-agent simulation of collaborative strategies in a supply chain , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[3]  Gordon I. McCalla,et al.  The Knowledge Frontier , 1987, Symbolic Computation.

[4]  François Bousquet,et al.  Modeling agents and interactions in agricultural economics , 2006, AAMAS '06.

[5]  Annie S. Wu,et al.  On the significance of synchroneity in emergent systems , 2009, AAMAS.

[6]  Leigh Tesfatsion,et al.  Introduction to the CE Special Issue on Agent-Based Computational Economics , 2001 .

[7]  Raymond J. Mooney Learning plan schemata from observation: explanation-based learning for plan recognition , 1990 .

[8]  Kai Nagel,et al.  Towards truly agent-based traffic and mobility simulations , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[9]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[10]  Toru Ishida,et al.  Modeling Human Behavior for Virtual Training Systems , 2005, AAAI.

[11]  Hideyuki Nakanishi,et al.  Augmented Experiment: Participatory Design with Multiagent Simulation , 2007, IJCAI.

[12]  Simon Hallé,et al.  A collaborative driving system based on multiagent modelling and simulations , 2005 .

[13]  Ana L. C. Bazzan,et al.  Opportunities for multiagent systems and multiagent reinforcement learning in traffic control , 2009, Autonomous Agents and Multi-Agent Systems.

[14]  Panos G Michalopoulos,et al.  Practical Procedure for Calibrating Microscopic Traffic Simulation Models , 2003 .

[15]  Michael Luck,et al.  Emergent service provisioning and demand estimation through self-organizing agent communities , 2009, AAMAS.

[16]  Sascha Ossowski,et al.  A market-inspired approach to reservation-based urban road traffic management , 2009, AAMAS.

[17]  Alexis Drogoul,et al.  Power and negotiation: lessons from agent-based participatory simulations , 2006, AAMAS '06.

[18]  Victor R. Lesser,et al.  On the role of multiply sectioned Bayesian networks to cooperative multiagent systems , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[19]  Randy Goebel,et al.  Theorist: A Logical Reasoning System for Defaults and Diagnosis , 1987 .

[20]  Sean Luke,et al.  A pheromone-based utility model for collaborative foraging , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[21]  Amy R. Pritchett,et al.  Predicting Interactions Between Agents in Agent-Based Modeling and Simulation of Sociotechnical Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  François Sempé,et al.  An artificial maieutic approach for eliciting experts' knowledge in multi-agent simulations , 2005, AAMAS '05.

[23]  Daniel Thalmann,et al.  Learnable behavioural model for autonomous virtual agents: low-level learning , 2006, AAMAS '06.

[24]  Kamalakar Karlapalem,et al.  Multi agent simulation of unorganized traffic , 2002, AAMAS '02.

[25]  Raymond J. Mooney,et al.  Learning Plan Schemata From Observation: Explanation-Based Learning for Plan Recognition , 1990, Cogn. Sci..

[26]  Edmund H. Durfee,et al.  Predicting the Expected Behavior of Agents that Learn About Agents: The CLRI Framework , 2004, Autonomous Agents and Multi-Agent Systems.