A Primer for Agent-Based Simulation and Modeling in Transportation Applications

Agent-based modeling and simulation (ABMS) methods have been applied across a spectrum of domains within transportation studies. Different paradigms for ABMS in transportation exist; in general ABMS has strong roots in the individual-based travelers' model in the activity-based travel demand domain. In the distributed system domain, ABMS is commonly seen as a method, known as multiagent systems, for a distributed autonomous system. Recently, transportation-related applications leveraging ABMS have continued to grow. This report attempts to clarify the concept of ABMS and summarize variant paradigms that have been studied in the transportation field. It will do this by distinguishing similarities of differences of the specified problems, model capabilities, strengths and weaknesses of ABMS scoped in different applications, and through a comprehensive review of ABMS approaches that have been seen in transportation studies. The report also seeks to connect the individual-based ABMS with the transportation problems viewed in the social science paradigm. This is achieved by trying to apply ABMS characterized by social science rules to study behavioral decisions of individual travelers. This exploratory study is demonstrated in an example of travelers' route choice decisions, which features a bottom-up, rather than a conventional top-down, approach to formulate the mechanism of an individual traveler's complex route choice behavioral process as a collaborative and reactive result of the traveler's mindset and the network environment integrated in an ABMS.

[1]  Ryuichi Kitamura,et al.  Generation of Synthetic Daily Activity-Travel Patterns , 1997 .

[2]  Jürgen Lind,et al.  Using a multi-agent approach to optimise the train coupling and sharing system , 2001, Eur. J. Oper. Res..

[3]  Mark Bradley,et al.  Development and Application of the SACSIM Activity-Based Model System , 2007 .

[4]  Dipti Srinivasan,et al.  Neural Networks for Real-Time Traffic Signal Control , 2006, IEEE Transactions on Intelligent Transportation Systems.

[5]  Seungho Lee,et al.  An integrated human decision making model for evacuation scenarios under a BDI framework , 2010, TOMC.

[6]  Brahim Chaib-draa,et al.  A simulation approach based on negotiation and cooperation between agents: a case study , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[7]  A. Tversky,et al.  Loss Aversion in Riskless Choice: A Reference-Dependent Model , 1991 .

[8]  Ana L. C. Bazzan,et al.  A Distributed Approach for Coordination of Traffic Signal Agents , 2004, Autonomous Agents and Multi-Agent Systems.

[9]  Sascha Ossowski,et al.  Applications of Agent Technology in Traffic and Transportation , 2005, Whitestein series in software agent technologies and autonomic computing.

[10]  H. Van Dyke Parunak,et al.  Industrial and practical applications of DAI , 1999 .

[11]  Eric J. Miller,et al.  Dynamic Modeling of Household Automobile Transactions , 2003 .

[12]  Muaz A. Niazi,et al.  Agent-based computing from multi-agent systems to agent-based models: a visual survey , 2011, Scientometrics.

[13]  Bo Chen,et al.  Integrating mobile agent technology with multi-agent systems for distributed traffic detection and management systems , 2009 .

[14]  Hani S. Mahmassani,et al.  On Boundedly Rational User Equilibrium in Transportation Systems , 1987, Transp. Sci..

[15]  Shoichiro Nakayama,et al.  Bayesian Learning, Day-to-day Adjustment Process, and Stability of Wardrop Equilibrium , 2009 .

[16]  R. D. Bonnell,et al.  Learning for distributed artificial intelligence systems , 1991, [1991 Proceedings] The Twenty-Third Southeastern Symposium on System Theory.

[17]  Tom M. Mitchell,et al.  Bayesian Network Learning with Parameter Constraints , 2006, J. Mach. Learn. Res..

[18]  Michael J. North,et al.  Product design patterns for agent-based modeling , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[19]  Rj Allan,et al.  Survey of Agent Based Modelling and Simulation Tools , 2009 .

[20]  Adele Diederich,et al.  Survey of decision field theory , 2002, Math. Soc. Sci..

[21]  José-Luis Pérez-de-la-Cruz,et al.  Agent coordination for bus fleet management , 2005, SAC '05.

[22]  Matthew J. Roorda,et al.  Prototype Model of Household Activity-Travel Scheduling , 2003 .

[23]  Eric J. Miller,et al.  ILUTE: An Operational Prototype of a Comprehensive Microsimulation Model of Urban Systems , 2005 .

[24]  G. Zlotkin,et al.  Cooperation and conflict resolution via negotiation among autonomous agents in noncooperative domains , 1991, IEEE Trans. Syst. Man Cybern..

[25]  K. Nagel,et al.  Generating complete all-day activity plans with genetic algorithms , 2005 .

[26]  M. D. Dunnette Handbook of Industrial and Organizational Psychology , 2005 .

[27]  Jürgen Lind,et al.  Transportation Scheduling and Simulation in a Railroad Scenario: A Multi-Agent Approach , 1999 .

[28]  Chris W. Clegg,et al.  Agent-based modelling and simulation: The potential contribution to organizational psychology , 2012 .

[29]  Wray L. Buntine Theory Refinement on Bayesian Networks , 1991, UAI.

[30]  Peter Hidas,et al.  Modelling vehicle interactions in microscopic simulation of merging and weaving , 2005 .

[31]  Liliana Perez,et al.  An agent-based approach for modeling dynamics of contagious disease spread , 2009, International journal of health geographics.

[32]  H. Herrmann,et al.  Agent-based model for friendship in social networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  D. Plaut,et al.  Learning in Dynamic Decision Tasks: Computational Model and Empirical Evidence , 1997 .

[34]  G Scemama CLAIRE - A CONTEXT-FREE AI BASED SUPERVISOR FOR TRAFFIC CONTROL , 1994 .

[35]  Janet S. Zeide The space station program , 1988 .

[36]  Chandra R. Bhat,et al.  Application of Socioeconomic Model System for Activity-Based Modeling: Experience from Southern California , 2012 .

[37]  W. Edwards The theory of decision making. , 1954, Psychological bulletin.

[38]  Blaga N. Iordanova Air traffic knowledge management policy , 2003, Eur. J. Oper. Res..

[39]  Levent Yilmaz,et al.  Agent Directed Simulation for Combat Modeling and Distributed Simulation , 2012 .

[40]  Victor J. Blue,et al.  A COOPERATIVE MULTI-AGENT TRANSPORTATION MANAGEMENT AND ROUTE GUIDANCE SYSTEM , 2002 .

[41]  Gerhard Weiss,et al.  Multiagent Systems , 1999 .

[42]  Torsten Hägerstraand WHAT ABOUT PEOPLE IN REGIONAL SCIENCE , 1970 .

[43]  Ana L. C. Bazzan,et al.  The impact of real-time information in a two-route scenario using agent-based simulation , 2002 .

[44]  Paul Davidsson,et al.  Agent Based Social Simulation: A Computer Science View , 2002, J. Artif. Soc. Soc. Simul..

[45]  Euel Elliott,et al.  Exploring cooperation and competition using agent-based modeling , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[46]  Uri Wilensky,et al.  NetLogo: A simple environment for modeling complexity , 2014 .

[47]  Luís Botelho A control structure for agent interaction , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[48]  Gideon Aschwanden,et al.  Agent based evaluation of dynamic city model, a combination of human decision processes and an emission model for transportation based on acceleration and instantaneous speed , 2012 .

[49]  Joshua M. Epstein,et al.  Growing Artificial Societies: Social Science from the Bottom Up , 1996 .

[50]  Ana L. C. Bazzan,et al.  Agents in Traffic Modelling - From Reactive to Social Behaviour , 1999, KI.

[51]  John W. Payne,et al.  Contingent decision behavior. , 1982 .

[52]  Tin-Kin Ho,et al.  Optimal Track Access Rights Allocation for Agent Negotiation in an Open Railway Market , 2008, IEEE Transactions on Intelligent Transportation Systems.

[53]  Jing Yin,et al.  Integrating Compensatory and Noncompensatory Decision-Making Strategies in Dynamic Task Environments , 2008 .

[54]  Alexander Serenko,et al.  AGENT TOOLKITS: A GENERAL OVERVIEW OF THE MARKET AND AN ASSESSMENT OF INSTRUCTOR SATISFACTION WITH UTILIZING TOOLKITS IN THE CLASSROOM , 2002 .

[55]  David Meignan,et al.  Simulation and evaluation of urban bus-networks using a multiagent approach , 2007, Simul. Model. Pract. Theory.

[56]  Gordon F. Newell,et al.  A simplified car-following theory: a lower order model , 2002 .

[57]  Yi-Chang Chiu,et al.  Integrated Land Use–Transport Model System with Dynamic Time-Dependent Activity–Travel Microsimulation , 2012 .

[58]  Nicholas R. Jennings,et al.  A Roadmap of Agent Research and Development , 2004, Autonomous Agents and Multi-Agent Systems.

[59]  M. Janssen,et al.  Multi-Agent Systems for the Simulation of Land-Use and Land-Cover Change: A Review , 2003 .

[60]  Peter Danielson Competition among cooperators: Altruism and reciprocity , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[61]  Dipti Srinivasan,et al.  Cooperative, hybrid agent architecture for real-time traffic signal control , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[62]  Bo Chen,et al.  A Review of the Applications of Agent Technology in Traffic and Transportation Systems , 2010, IEEE Transactions on Intelligent Transportation Systems.

[63]  Stephen G. Ritchie,et al.  A multi-agent architecture for cooperative inter-jurisdictional traffic congestion management , 2002 .

[64]  Vikram Manikonda,et al.  A multi-agent approach to cooperative traffic management and route guidance , 2005 .

[65]  Charles Desjardins,et al.  Urban Traffic Control Based on Learning Agents , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[66]  K. Nagel,et al.  TRANSIMS traffic flow characteristics , 1997, adap-org/9710003.

[67]  Hani S. Mahmassani,et al.  An evaluation tool for advanced traffic information and management systems in urban networks , 1994 .

[68]  G. Nigel Gilbert,et al.  Agent-Based Models , 2007 .

[69]  Dušan Teodorović,et al.  APPLICABILITY OF AN AGENT-BASED MODELING CONCEPT TO MODELING OF TRANSPORTATION PHENOMENA , 2002 .

[70]  Eric J. Miller,et al.  Empirical Investigation of Household Vehicle Type Choice Decisions , 2003 .

[71]  Ron Sun,et al.  From implicit skills to explicit knowledge: a bottom-up model of skill learning , 2001, Cogn. Sci..

[72]  Michael J. North,et al.  Agent-based modeling and simulation , 2009, Proceedings of the 2009 Winter Simulation Conference (WSC).

[73]  Azim Eskandarian,et al.  ENHANCING INTELLIGENT AGENT COLLABORATION FOR FLOW OPTIMIZATION OF RAILROAD TRAFFIC , 2002 .

[74]  M. Bradley,et al.  SACSIM: An applied activity-based model system with fine-level spatial and temporal resolution , 2010 .

[75]  B. De Schutter,et al.  Test Bed for Multiagent Control Systems in Road Traffic Management , 2005 .

[76]  Kai Nagel,et al.  Parallel Queue Model Approach to Traffic Microsimulations , 2003 .

[77]  C. Daganzo Unconstrained Extremal Formulation of Some Transportation Equilibrium Problems , 1982 .

[78]  Dipti Srinivasan,et al.  REAL-TIME COORDINATED SIGNAL CONTROL USING AGENTS WITH ONLINE REINFORCEMENT LEARNING , 2003 .

[79]  José-Luis Pérez-de-la-Cruz,et al.  Ontologies and agents for a bus fleet management system , 2008, Expert Syst. Appl..

[80]  Gregory R. Madey,et al.  Tools of the Trade: A Survey of Various Agent Based Modeling Platforms , 2009, J. Artif. Soc. Soc. Simul..

[81]  Michael J. North,et al.  Tutorial on Agent-Based Modeling and Simulation PART 2: How to Model with Agents , 2006, Proceedings of the 2006 Winter Simulation Conference.

[82]  Ferat Sahin,et al.  Structural learning of Bayesian networks from complete data using the scatter search documents , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[83]  Amit Konar,et al.  Reasoning and unsupervised learning in a fuzzy cognitive map , 2005, Inf. Sci..

[84]  Gia Sirbiladze,et al.  Restored fuzzy measures in expert decision-making , 2005, Inf. Sci..

[85]  Karthik C. Konduri,et al.  Simulator of activities, greenhouse emissions, networks, and travel (SimAGENT) in Southern California: Design, implementation, preliminary findings, and integration plans , 2011, 2011 IEEE Forum on Integrated and Sustainable Transportation Systems.

[86]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[87]  Fei-Yue Wang,et al.  Agent-Based Control for Networked Traffic Management Systems , 2005, IEEE Intell. Syst..

[88]  Steven L. Lytinen,et al.  Agent-based Simulation Platforms: Review and Development Recommendations , 2006, Simul..

[89]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[90]  Carlos F. Daganzo,et al.  Lane-changing in traffic streams , 2006 .

[91]  Madhur Anand,et al.  Symmetric competition causes population oscillations in an individual-based model of forest dynamics , 2008 .

[92]  Kathleen Segerson,et al.  RATIONAL ROOTS OF "IRRATIONAL" BEHAVIOR: NEW THEORIES OF ECONOMIC DECISION-MAKING , 1989 .

[93]  Young-Jun Son,et al.  Modeling Human Interactions with Learning under the Extended Belief-Desire-Intention Framework , 2012 .

[94]  Richard M. Crowder,et al.  The Development of an Agent-Based Modeling Framework for Simulating Engineering Team Work , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[95]  M. Macy,et al.  Learning dynamics in social dilemmas , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[96]  H. J. Einhorn The use of nonlinear, noncompensatory models in decision making. , 1970, Psychological bulletin.

[97]  R. Sun,et al.  The interaction of the explicit and the implicit in skill learning: a dual-process approach. , 2005, Psychological review.

[98]  Kincho H. Law,et al.  A Multi-Agent Based Simulation Framework for the Study of Human and Social Behavior in Egress Analysis , 2005 .

[99]  Ronald van Katwijk,et al.  COORDINATION OF TRAFFIC MANAGEMENT INSTRUMENTS USING AGENT TECHNOLOGY , 2002 .

[100]  Moshe Ben-Akiva,et al.  Discrete Choice Analysis: Theory and Application to Travel Demand , 1985 .

[101]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[102]  Anand S. Rao,et al.  Decision Procedures for BDI Logics , 1998, J. Log. Comput..

[103]  Yosef Sheffi,et al.  Urban Transportation Networks: Equilibrium Analysis With Mathematical Programming Methods , 1985 .

[104]  Athanasios K. Ziliaskopoulos,et al.  Foundations of Dynamic Traffic Assignment: The Past, the Present and the Future , 2001 .

[105]  Iisakki Kosonen,et al.  Multi-agent fuzzy signal control based on real-time simulation , 2003 .

[106]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[107]  Scott Heckbert,et al.  MayaSim: An Agent-Based Model of the Ancient Maya Social-Ecological System , 2012, J. Artif. Soc. Soc. Simul..

[108]  Flavien Balbo,et al.  Dynamic modeling of a disturbance in a multi-agent system for traffic regulation , 2005, Decis. Support Syst..

[109]  Frederick Mosteller,et al.  An Experimental Measurement of Utility , 1951, Journal of Political Economy.

[110]  Brian L. Heath The History, Philosophy, and Practice of Agent-Based Modeling and the Development of the Conceptual Model for Simulation Diagram , 2010 .

[111]  Eric Bonabeau,et al.  Agent-based modeling: Methods and techniques for simulating human systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[112]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[113]  Michael Luck,et al.  A Direct Reputation Model for VO Formation , 2005, CEEMAS.

[114]  Sascha Ossowski,et al.  MULTIAGENT ARCHITECTURES FOR INTELLIGENT TRAFFIC MANAGEMENT SYSTEMS , 2002 .

[115]  Danko A. Roozemond Using intelligent agents for pro-active, real-time urban intersection control , 2001, Eur. J. Oper. Res..

[116]  John R. Anderson,et al.  From recurrent choice to skill learning: a reinforcement-learning model. , 2006, Journal of experimental psychology. General.

[117]  Danny Weyns,et al.  Anticipatory Vehicle Routing using Delegate Multi-Agent Systems , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[118]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[119]  Peter Hidas,et al.  MODELLING LANE CHANGING AND MERGING IN MICROSCOPIC TRAFFIC SIMULATION , 2002 .

[120]  A. Newell Unified Theories of Cognition , 1990 .

[121]  Michael J. North,et al.  Agent-based modeling and simulation: ABMS examples , 2008, 2008 Winter Simulation Conference.

[122]  Seungho Lee,et al.  Decision field theory extensions for behavior modeling in dynamic environment using Bayesian belief network , 2008, Inf. Sci..

[123]  Wai Lam,et al.  Using Causal Information and Local Measures to Learn Bayesian Networks , 1993, UAI.

[124]  Kai Nagel,et al.  Towards truly agent-based traffic and mobility simulations , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[125]  Nicholas R. Jennings,et al.  On agent-based software engineering , 2000, Artif. Intell..

[126]  Geoff S. Nitschke,et al.  Cooperating air traffic control agents , 2001, Appl. Artif. Intell..

[127]  Sascha Ossowski,et al.  Decision support for traffic management based on organisational and communicative multiagent abstractions , 2005 .

[128]  Kay W. Axhausen,et al.  planomat: a comprehensive scheduler for a large-scale multi-agent transportation simulation , 2006 .

[129]  Birgit Burmeister,et al.  Agent-oriented traffic simulation , 1997 .

[130]  Vicente R. Tomás López,et al.  Agent-Based Management of Non Urban Road Meteorological Incidents , 2005, CEEMAS.

[131]  Robert F. Stengel,et al.  Principled negotiation between intelligent agents: a model for air traffic management , 1998, Artif. Intell. Eng..

[132]  Alexander Skabardonis,et al.  Oversaturated Freeway Flow Algorithm for Use in Next Generation Simulation , 2008 .

[133]  Alexis Drogoul,et al.  Agent-based interaction analysis of consumer behavior , 2002, AAMAS '02.

[134]  Dwight W Read,et al.  A multitrajectory, competition model of emergent complexity in human social organization , 2002, Proceedings of the National Academy of Sciences of the United States of America.