Model-driven agent-based simulation development: A modeling language and empirical evaluation in the adaptive traffic signal control domain

Abstract Model-driven development (MDD) is an approach for supporting the development of software systems, in which high-level modeling artifacts drive the production of time and effort-consuming low-level artifacts, such as the source code. Previous studies of the MDD effectiveness showed that it significantly increases development productivity, because the development effort is focused on the business domain rather than technical issues. However, MDD was exploited in the context of agent-based development in a limited way, and most of the existing proposals demonstrated the effectiveness of using MDD in this context by argumentation or examples, lacking disciplined empirical analyses. In this paper, we explore the use of MDD for agent-based modeling and simulation in the adaptive traffic signal control (ATSC) domain, in which autonomous agents are in charge of managing traffic light indicators to optimize traffic flow. We propose an MDD approach, composed of a modeling language and model-to-code transformations for producing runnable simulations automatically. In order to analyze the productivity gains of our MDD approach, we compared the amount of design and implementation artifacts produced using our approach and traditional simulation platforms. Results indicate that our approach reduces the workload to develop agent-based simulations in the ATSC domain.

[1]  Ana L. C. Bazzan,et al.  Multiagent Learning on Traffic Lights Control , 2009, Multi-Agent Systems for Traffic and Transportation Engineering.

[2]  Semih Bilgen,et al.  A framework for qualitative assessment of domain-specific languages , 2015, Software & Systems Modeling.

[3]  Silvia Mara Abrahão,et al.  Validating a size measure for effort estimation in model-driven Web development , 2010, Inf. Sci..

[4]  Marco Wiering,et al.  Multi-Agent Reinforcement Learning for Traffic Light control , 2000 .

[5]  U. Netlogo Wilensky,et al.  Center for Connected Learning and Computer-Based Modeling , 1999 .

[6]  Jim Duggan,et al.  An Experimental Review of Reinforcement Learning Algorithms for Adaptive Traffic Signal Control , 2016, Autonomic Road Transport Support Systems.

[7]  Jorge J. Gómez-Sanz,et al.  Model Driven Development of Multi-Agent Systems , 2006, ECMDA-FA.

[8]  Ware Myers,et al.  Measures for Excellence: Reliable Software on Time, Within Budget , 1991 .

[9]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[10]  Rosaldo J. F. Rossetti,et al.  JADE, TraSMAPI and SUMO: A tool-chain for simulating traffic light control , 2016, ArXiv.

[11]  Alfredo Garro,et al.  A Process Based on the Model-Driven Architecture to Enable the Definition of Platform-Independent Simulation Models , 2011, SIMULTECH.

[12]  Jorge J. Gómez-Sanz,et al.  Model driven development and simulations with the INGENIAS agent framework , 2010, Simul. Model. Pract. Theory.

[13]  Paul Davidsson,et al.  AMASON: Abstract Meta-model for Agent-Based SimulatiON , 2013, MATES.

[14]  Alexander Verbraeck,et al.  Model Continuity in Discrete Event Simulation , 2015, ACM Trans. Model. Comput. Simul..

[15]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[16]  Christian Hahn,et al.  The Platform Independent Modeling Language for Multiagent Systems , 2005, ATOP@AAMAS.

[17]  Oguz Dikenelli,et al.  Model Driven Development of Semantic Web Enabled Multi-Agent Systems , 2009, Int. J. Cooperative Inf. Syst..

[18]  Valeria Seidita,et al.  Common and domain-specific metamodel elements for problem description in simulation problems , 2014, 2014 Federated Conference on Computer Science and Information Systems.

[19]  Giuseppe Iazeolla,et al.  Simulation model building of traffic intersections , 2009, Simul. Model. Pract. Theory.

[20]  Elizabeth Sklar,et al.  An Empirical Investigation of Adaptive Traffic Control Parameters , 2016, ATT@IJCAI.

[21]  Olivier Dalle Reuse-centric simulation software architectures , 2014, Modeling and Simulation-Based Systems Engineering Handbook.

[22]  Mark Strembeck,et al.  An approach for the systematic development of domain‐specific languages , 2009, Softw. Pract. Exp..

[23]  Bruce Edmonds,et al.  Errors and Artefacts in Agent-Based Modelling , 2009, J. Artif. Soc. Soc. Simul..

[24]  Bernhard Bauer,et al.  UML 2.0 and agents: how to build agent-based systems with the new UML standard , 2005, Eng. Appl. Artif. Intell..

[25]  J. Gareth Polhill,et al.  The ODD protocol: A review and first update , 2010, Ecological Modelling.

[26]  Alberto Fernández-Isabel,et al.  Analysis of Intelligent Transportation Systems Using Model-Driven Simulations , 2015, Sensors.

[27]  Juan Pavón,et al.  Application of Model Driven Techniques for Agent-Based Simulation , 2010, PAAMS.

[28]  Ana L. C. Bazzan,et al.  Opportunities for multiagent systems and multiagent reinforcement learning in traffic control , 2009, Autonomous Agents and Multi-Agent Systems.

[29]  Carlos Gershenson,et al.  Adaptive self-organization vs static optimization: A qualitative comparison in traffic light coordination , 2012, Kybernetes.

[30]  Baher Abdulhai,et al.  Design of Reinforcement Learning Parameters for Seamless Application of Adaptive Traffic Signal Control , 2014, J. Intell. Transp. Syst..

[31]  Daniele Gianni,et al.  A model-driven method for building distributed simulation systems from business process models , 2012, Proceedings Title: Proceedings of the 2012 Winter Simulation Conference (WSC).

[32]  M Mernik,et al.  When and how to develop domain-specific languages , 2005, CSUR.

[33]  Douglas C. Schmidt,et al.  Guest Editor's Introduction: Model-Driven Engineering , 2006, Computer.

[34]  Denis Gracanin,et al.  Model-Driven Architecture for Agent-Based Systems , 2004, FAABS.

[35]  Douglas C. Schmidt,et al.  Model-Driven Engineering , 2006 .

[36]  Jorge J. Gómez-Sanz,et al.  Agent Oriented Software Engineering with INGENIAS , 2003, CEEMAS.

[37]  Michael J. North,et al.  Agent-based modeling and simulation: introductory tutorial , 2013, WSC '13.

[38]  Stuart Kent,et al.  Model Driven Engineering , 2002, IFM.

[39]  Geylani Kardas,et al.  Model-driven development of multiagent systems: a survey and evaluation , 2013, The Knowledge Engineering Review.

[40]  Philippe Mathieu,et al.  Interaction-Oriented Agent Simulations: From Theory to Implementation , 2008, ECAI.

[41]  Bedir Tekinerdogan,et al.  A systematic approach to evaluating domain-specific modeling language environments for multi-agent systems , 2015, Software Quality Journal.

[42]  Carlos Gershenson,et al.  Self-organizing Traffic Lights , 2004, Complex Syst..

[43]  Carlos Gershenson,et al.  Self-organizing traffic lights at multiple-street intersections , 2011, Complex..

[44]  Ana L. C. Bazzan,et al.  ABStractme: Modularized Environment Modeling in Agent-based Simulations , 2017, AAMAS.

[45]  Monireh Abdoos,et al.  Traffic light control in non-stationary environments based on multi agent Q-learning , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[46]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[47]  Franco Zambonelli,et al.  A Study of Some Multi-agent Meta-models , 2004, AOSE.

[48]  Jorge J. Gómez-Sanz,et al.  Visual Modeling for Complex Agent-Based Simulation Systems , 2005, MABS.

[49]  Pieter W. G. Bots,et al.  MAIA: a Framework for Developing Agent-Based Social Simulations , 2013, J. Artif. Soc. Soc. Simul..

[50]  Marie-Pierre Gleizes,et al.  Simulation-based design and evaluation of multi-agent systems , 2010, Simul. Model. Pract. Theory.

[51]  Marie-Pierre Gleizes,et al.  Model Driven Engineering for Designing Adaptive Multi-Agents Systems , 2008, ESAW.

[52]  Xiaoliang Ma,et al.  Adaptive Group-Based Signal Control Using Reinforcement Learning with Eligibility Traces , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[53]  Juan Pavón,et al.  Agent-Based Simulation Replication: A Model Driven Architecture Approach , 2005, MICAI.

[54]  Lynne Hamill,et al.  Agent-Based Modelling: The Next 15 Years , 2010, J. Artif. Soc. Soc. Simul..

[55]  Pieter W. G. Bots,et al.  Model-driven agent-based simulation: Procedural semantics of a MAIA model , 2014, Simul. Model. Pract. Theory.

[56]  Rosaldo J. F. Rossetti,et al.  Using BDI agents to improve driver modelling in a commuter scenario , 2002 .

[57]  Christian Hahn A domain specific modeling language for multiagent systems , 2008, AAMAS.

[58]  Alfredo Garro,et al.  easyABMS: A domain-expert oriented methodology for agent-based modeling and simulation , 2010, Simul. Model. Pract. Theory.

[59]  Nuno Oliveira,et al.  Comparing general-purpose and domain-specific languages: An empirical study , 2010, Comput. Sci. Inf. Syst..

[60]  Juha-Pekka Tolvanen,et al.  Model-Driven Development challenges and solutions: Experiences with domain-specific modelling in industry , 2016, 2016 4th International Conference on Model-Driven Engineering and Software Development (MODELSWARD).

[61]  Carlos Gershenson,et al.  Self-organizing traffic lights: A realistic simulation , 2013 .

[62]  Markus Völter,et al.  Model-Driven Software Development: Technology, Engineering, Management , 2006 .

[63]  Christian Hahn,et al.  The DSML4MAS development environment , 2009, AAMAS.

[64]  Michael P. Wellman Putting the agent in agent-based modeling , 2016, Autonomous Agents and Multi-Agent Systems.

[65]  Anna Perini,et al.  Automating Model Transformations in Agent-Oriented Modelling , 2005, AOSE.

[66]  Ana L. C. Bazzan,et al.  A review on agent-based technology for traffic and transportation , 2013, The Knowledge Engineering Review.

[67]  Jörg P. Müller,et al.  Agent UML: A Formalism for Specifying Multiagent Software Systems , 2001, Int. J. Softw. Eng. Knowl. Eng..

[68]  Mark Rouncefield,et al.  Model-driven engineering practices in industry , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[69]  Paolo Bocciarelli,et al.  Modeling-to-simulation: transformation approaches to boost automation in modeling & simulation , 2016, SummerSim.

[70]  Erika Asnina,et al.  Model-Driven Domain Analysis and Software Development - Architectures and Functions , 2010 .

[71]  Liang Xiao,et al.  Adaptive Agent Model: Software Adaptivity using an Agent-oriented Model-Driven Architecture , 2009, Inf. Softw. Technol..

[72]  Lidia Fuentes,et al.  Bridging the Gap Between Agent-Oriented Design and Implementation Using MDA , 2004, AOSE.

[73]  Diomidis Spinellis,et al.  Guest Editors' Introduction: What Kinds of Nails Need a Domain-Specific Hammer? , 2009, IEEE Software.

[74]  Julien Vayssière,et al.  A Model Driven Approach to Agent-Based Service-Oriented Architectures , 2006, MATES.

[75]  Colin Atkinson,et al.  Model-Driven Development: A Metamodeling Foundation , 2003, IEEE Softw..

[76]  Laurent Réveillère,et al.  A generative programming approach to developing DSL compilers , 2005, GPCE'05.

[77]  H. Van Dyke Parunak,et al.  Agent-Based Modeling vs. Equation-Based Modeling: A Case Study and Users' Guide , 1998, MABS.

[78]  R. G. Ingalls,et al.  Agent-Based Modeling and Simulation , 2017, Encyclopedia of Machine Learning and Data Mining.

[79]  Bo Chen,et al.  A Review of the Applications of Agent Technology in Traffic and Transportation Systems , 2010, IEEE Transactions on Intelligent Transportation Systems.

[80]  Klaus Fischer,et al.  A platform-independent metamodel for multiagent systems , 2008, Autonomous Agents and Multi-Agent Systems.

[81]  Manish Agrawal,et al.  Software Effort, Quality, and Cycle Time: A Study of CMM Level 5 Projects , 2007, IEEE Transactions on Software Engineering.

[82]  John Mylopoulos,et al.  From Stakeholder Intentions to Software Agent Implementations , 2006, CAiSE.

[83]  Michael Winikoff,et al.  Evaluating a Model Driven Development Toolkit for Domain Experts to Modify Agent Based Systems , 2006, AOSE.

[84]  Eelco Visser,et al.  DSL Engineering - Designing, Implementing and Using Domain-Specific Languages , 2013 .

[85]  Michael G. Hinchey,et al.  Formal approaches to agent-based systems : third International Workshop, FAABS 2004, Greenbelt, MD, USA, April 26-27, 2004 : revised selected papers , 2005 .

[86]  Rosaldo J. F. Rossetti,et al.  TraSMAPI: An API oriented towards Multi-Agent Systems real-time interaction with multiple Traffic Simulators , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[87]  Ana L. C. Bazzan,et al.  Supporting the Development of Agent-Based Simulations: A DSL for Environment Modeling , 2017, 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC).

[88]  Juan de Lara,et al.  O D i M: A Model-Driven Approach To Agent-Based Simulation , 2009, ECMS.

[89]  Barry W. Boehm,et al.  Cost models for future software life cycle processes: COCOMO 2.0 , 1995, Ann. Softw. Eng..