Self-organizing multi-agent systems for the control of complex systems

Because of the law of requisite variety, designing a controller for complex systems implies designing a complex system. In software engineering, usual top-down approaches become inadequate to design such systems. The Adaptive Multi-Agent Systems (AMAS) approach relies on the cooperative self-organization of autonomous micro-level agents to tackle macro-level complexity. This bottom-up approach provides adaptive, scalable, and robust systems. This paper presents a complex system controller that has been designed following this approach, and shows results obtained with the automatic tuning of a real internal combustion engine.

[1]  Marie-Pierre Gleizes,et al.  A Pattern based Modelling for Self-organizing Multi-agent Systems with Event-B , 2014, ICAART.

[2]  Marie-Pierre Gleizes,et al.  The Self-Adaptive Context Learning Pattern: Overview and Proposal , 2015, CONTEXT.

[3]  Marie-Pierre Gleizes,et al.  Principles and experimentations of self-organizing embedded agents allowing learning from demonstration in ambient robotics , 2016, Future Gener. Comput. Syst..

[4]  Marina Bosch.  The Rational Unified Process An Introduction , 2016 .

[5]  Viktor Mikhaĭlovich Glushkov,et al.  An Introduction to Cybernetics , 1957, The Mathematical Gazette.

[6]  Marie-Pierre Gleizes,et al.  Adelfe 2.0 , 2014, Handbook on Agent-Oriented Design Processes.

[7]  Denis M. Filatov,et al.  Advances in Intelligent Systems and Computing 402 , 2016 .

[8]  Yongcan Cao,et al.  Distributed Coordination of Multi-agent Networks: Emergent Problems, Models, and Issues , 2010 .

[9]  Josh C. Bongard,et al.  Evolutionary robotics , 2013, CACM.

[10]  B. Arms,et al.  Cooperation , 1926, Becoming Rooted.

[11]  Francis Heylighen,et al.  Complexity and Self-organization , 2008 .

[12]  Kristinn R. Thórisson,et al.  A New Constructivist AI: From Manual Methods to Self-Constructive Systems , 2012 .

[13]  Jason H. Moore,et al.  Learning classifier systems: a complete introduction, review, and roadmap , 2009 .

[14]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[15]  Marie-Pierre Gleizes,et al.  Self-Adaptive Model Generation for Ambient Systems , 2016, ANT/SEIT.

[16]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[17]  Michael Wooldridge,et al.  An Introduction to MultiAgent Systems, Second Edition , 2009 .

[18]  Andrei N. Kolmogorov,et al.  On Tables of Random Numbers (Reprinted from "Sankhya: The Indian Journal of Statistics", Series A, Vol. 25 Part 4, 1963) , 1998, Theor. Comput. Sci..

[19]  Pierre Glize,et al.  Mimicking Complexity - Automatic Generation of Models for the Development of Self-adaptive Systems , 2013, SIMULTECH.

[20]  Victor Noël,et al.  Component-based software architectures and multi-agent systems : mutual and complementary contributions for supporting software development , 2012 .

[21]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[22]  Phil Husbands,et al.  Evolutionary robotics , 2014, Evolutionary Intelligence.

[23]  Simon G. Fabri,et al.  Kalman Filter-based Estimators for Dual Adaptive Neural Control - A Comparative Analysis of Execution Time and Performance Issues , 2013, ICINCO.

[24]  Terrence W. Deacon,et al.  Complexity and Dynamical Depth , 2014, Inf..

[25]  Tamer Basar,et al.  Dual Control Theory , 2001 .

[26]  Dipti Srinivasan,et al.  Neural Networks for Continuous Online Learning and Control , 2006, IEEE Transactions on Neural Networks.

[27]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[28]  A. Mackay.  On complexity , 2001 .

[29]  Ramiro S. Barbosa,et al.  Tuning of Fuzzy Fractional PDb + I Controllers by Genetic Algorithm , 2013, ICINCO.

[30]  A. Shiryayev.  On Tables of Random Numbers , 1993 .

[31]  Giovanna Di Marzo Serugendo,et al.  Self-organising Systems , 2011, Self-organising Software.

[32]  P. Krutchen,et al.  The Rational Unified Process: An Introduction , 2000 .

[33]  A. A. Feldbaum,et al.  DUAL CONTROL THEORY, IV , 1961 .

[34]  Larry Bull,et al.  Towards distributed adaptive control for road traffic junction signals using learning classifier systems , 2004 .

[35]  Marie-Pierre Gleizes,et al.  Continuous Approximation of a Discrete Situated and Reactive Multi-agent System: Contribution to Agent Parameterization , 2014, PRIMA.

[36]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[37]  Mohamed A. Khamis,et al.  Adaptive multi-objective reinforcement learning with hybrid exploration for traffic signal control based on cooperative multi-agent framework , 2014, Eng. Appl. Artif. Intell..

[38]  B. John Oommen,et al.  Topology-oriented self-organizing maps: a survey , 2014, Pattern Analysis and Applications.

[39]  Pierre Glize,et al.  Principles and Properties of a MAS Learning Algorithm: A Comparison with Standard Learning Algorithms Applied to Implicit Feedback Assessment , 2011, 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[40]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.