Mathematical Modeling of Large Multi-Agent Systems

Abstract : The biologically-inspired swarm paradigm is being used to design self-organizing systems of locally interacting agents. A major difficulty in designing swarms with desired characteristics is understanding the causal relation between individual agent and collective behaviors. Mathematical analysis of swarm dynamics can address this difficulty to gain insight into system design. This project developed a formal framework for mathematical modeling and analysis of multi-agent swarms. Though the behavior of an individual agent can be considered to be stochastic and unpredictable, collective behavior of a swarm can have a simple probabilistic description. We showed that a class of mathematical models that describe the dynamics of collective behavior of multi-agent systems can be written down from the details of the individual agent controller. We have successfully applied this formalism to study collective behavior of distributed robot systems for which a body of experimental and simulations data exists.

[1]  Luca Maria Gambardella,et al.  Collaboration Through the Exploitation of Local Interactions in Autonomous Collective Robotics: The Stick Pulling Experiment , 2001, Auton. Robots.

[2]  Ken Sugawara,et al.  Cooperative acceleration of task performance: foraging behavior of interacting multi-robots system , 1997 .

[3]  A. Martinoli,et al.  A macroscopic model of an aggregation experiment using embodied agents in groups of time-varying sizes , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[4]  Kristina Lerman,et al.  Adaptive Boolean networks and minority games with time-dependent capacities. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[5]  Radek Erban,et al.  From Individual to Collective Behavior in Bacterial Chemotaxis , 2004, SIAM J. Appl. Math..

[6]  Vladimir Vovk,et al.  Universal portfolio selection , 1998, COLT' 98.

[7]  D. Sherrington.  Stochastic Processes in Physics and Chemistry , 1983 .

[8]  Maja J. Matarić,et al.  A principled design methodology for minimalist multi-robot system controllers , 2005 .

[9]  Leonard Kleinrock,et al.  Distributed control methods , 1993, [1993] Proceedings The 2nd International Symposium on High Performance Distributed Computing.

[10]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[11]  A. Ijspeert,et al.  A Macroscopic Analytical Model of Collaboration in Distributed Robotic Systems , 2002, Artificial Life.

[12]  Physics Department,et al.  Adaptive Competition, Market Efficiency, Phase Transitions and Spin-Glasses , 1997 .

[13]  Alcherio Martinoli,et al.  Modeling Swarm Robotic Systems: a Case Study in Collaborative Distributed Manipulation , 2004, Int. J. Robotics Res..

[14]  Yicheng Zhang,et al.  On the minority game: Analytical and numerical studies , 1998, cond-mat/9805084.

[15]  Kristina Lerman,et al.  Comparative analysis of top-down and bottom-up methodologies for multi-agent system design , 2005, AAMAS '05.

[16]  E. Purcell.  Life at Low Reynolds Number , 2008 .

[17]  Richard Wolski,et al.  Forecasting network performance to support dynamic scheduling using the network weather service , 1997, Proceedings. The Sixth IEEE International Symposium on High Performance Distributed Computing (Cat. No.97TB100183).

[18]  Maja J. Matarić,et al.  Robust Behavior-Based Control for Distributed Multi-Robot Collection Tasks , 2000 .

[19]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[20]  Kristina Lerman,et al.  Agent memory and adaptation in multi-agent systems , 2003, AAMAS '03.

[21]  Hans G. Othmer,et al.  The Diffusion Limit of Transport Equations II: Chemotaxis Equations , 2002, SIAM J. Appl. Math..

[22]  Tucker R. Balch,et al.  Communication of behavorial state in multi-agent retrieval tasks , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[23]  Kristina Lerman,et al.  Resource allocation in the grid using reinforcement learning , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[24]  Tad Hogg,et al.  Modeling and mathematical analysis of swarms of microscopic robots , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[25]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[26]  Kristina Lerman,et al.  Mathematical Model of Foraging in a Group of Robots: Effect of Interference , 2002, Auton. Robots.

[27]  W. Arthur.  Inductive Reasoning and Bounded Rationality , 1994 .

[28]  Gaurav S. Sukhatme,et al.  Most valuable player: a robot device server for distributed control , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[29]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[30]  Kristina Lerman,et al.  A Review of Probabilistic Macroscopic Models for Swarm Robotic Systems , 2004, Swarm Robotics.

[31]  Luca Maria Gambardella,et al.  A Probabilistic Model for Understanding and Comparing Collective Aggregation Mechansims , 1999, ECAL.

[32]  Kristina Lerman,et al.  Analysis of Dynamic Task Allocation in Multi-Robot Systems , 2006, Int. J. Robotics Res..

[33]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[34]  Pattie Maes,et al.  A Study of Territoriality: The Role of Critical Mass in Adaptive Task Division , 1996 .

[35]  B. Barish,et al.  LIGO and the Detection of Gravitational Waves , 1999 .

[36]  Salvatore J. Stolfo,et al.  Sharing Learned Models among Remote Database Partitions by Local Meta-Learning , 1996, KDD.

[37]  Kristina Lerman,et al.  Macroscopic analysis of adaptive task allocation in robots , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[38]  Olivier Michel,et al.  Webots: Symbiosis Between Virtual and Real Mobile Robots , 1998, Virtual Worlds.

[39]  Sandip Sen,et al.  Learning to Coordinate without Sharing Information , 1994, AAAI.

[40]  Kristina Lerman,et al.  Two Paradigms for the Design of Artificial Collectives , 2004 .

[41]  Gaurav S. Sukhatme,et al.  Emergent bucket brigading: a simple mechanisms for improving performance in multi-robot constrained-space foraging tasks , 2001, AGENTS '01.

[42]  Kristina Lerman,et al.  Resource allocation games with changing resource capacities , 2003, AAMAS '03.

[43]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.

[44]  Gaurav S. Sukhatme,et al.  Blazing a Trail: Insect-inspired Resource Transportation by a Robot Team , 2000, DARS.