Coalition formation and teamwork in embodied agents

Embodied agents are agents acting in the physical world, such as persons, robots, unmanned air or ground vehicles and so on. These types of agents are subject to spatio-temporal constraints, which do not exist for agents acting in a virtual environment. The movement of embodied agents is limited by obstacles and maximum velocity, while their communication is limited by the transmission range of their wireless devices. This dissertation presents contributions to the techniques of coalition formation and teamwork coordination for embodied agents. We considered embodied agents in three different settings, each of them representative of a class of practical applications. First, we study coalition formation in the one dimensional world of vehicles driving on a highway. We assume that vehicles can communicate over short distances and carry agents which can advise the driver on convoy formation decisions. We introduce techniques which allow vehicles to influence the speed of the convoys, and show that this yields convoys which have a higher utility for the participating vehicles. Second, we address the problem of coalition formation in the two dimensional world. The application we consider is a disaster response scenario. The agents are forming coalitions through a multi-issue negotiation with spatio-temporal components where the coalitions maintain a set of commitments towards participating agents. Finally, we discuss a scenario where embodied agents form coalitions to optimally address dynamic, non-deterministic, spatio-temporal tasks. The application we consider is firefighters acting in a disaster struck city.

[1]  Noa Agmon,et al.  Multi-robot area patrol under frequency constraints , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[2]  N. R. Jennings,et al.  Multi-Issue Negotiation with Deadlines , 2006, J. Artif. Intell. Res..

[3]  Michael Wooldridge,et al.  Temporal qualitative coalitional games , 2006, AAMAS '06.

[4]  Michael Wooldridge,et al.  On the logic of coalitional games , 2006, AAMAS '06.

[5]  Robert Leonard Theory of Games and Economic Behavior , 2006 .

[6]  Damla Turgut,et al.  YAES: a modular simulator for mobile networks , 2005, MSWiM '05.

[7]  Michael Wooldridge,et al.  On the logic of cooperation and propositional control , 2005, Artif. Intell..

[8]  Anthony A. Maciejewski,et al.  Processor allocation for tasks that is robust against errors in computation time estimates , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[9]  Victor R. Lesser,et al.  A survey of multi-agent organizational paradigms , 2004, The Knowledge Engineering Review.

[10]  Steven Willmott,et al.  Modelling coalition formation over time for iterative coalition games , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[11]  David Cornforth,et al.  Agent heterogeneity and coalition formation: investigating market-based cooperative problem solving , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[12]  Craig Boutilier,et al.  Bayesian reinforcement learning for coalition formation under uncertainty , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[13]  Anthony A. Maciejewski,et al.  The robustness of resource allocation in parallel and distributed computing systems , 2004, Third International Symposium on Parallel and Distributed Computing/Third International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks.

[14]  Maarten Sierhuis,et al.  Adjustable Autonomy and Human-Agent Teamwork in Practice: An Interim Report on Space Applications , 2003 .

[15]  Michael Luck,et al.  Coalition formation through motivation and trust , 2003, AAMAS '03.

[16]  Victor R. Lesser,et al.  Cooperative negotiation for soft real-time distributed resource allocation , 2003, AAMAS '03.

[17]  Sarit Kraus,et al.  Coalition formation with uncertain heterogeneous information , 2003, AAMAS '03.

[18]  David E. Culler,et al.  The nesC language: A holistic approach to networked embedded systems , 2003, PLDI.

[19]  Nicola Bellomo,et al.  ON THE MATHEMATICAL THEORY OF VEHICULAR TRAFFIC FLOW I: FLUID DYNAMIC AND KINETIC MODELLING , 2002 .

[20]  Ladislau Bölöni,et al.  Robust scheduling of metaprograms , 2002 .

[21]  Harry Chen,et al.  Beyond Distributed AI, Agent Teamwork in Ubiquitous Computing , 2002 .

[22]  Matthias Klusch,et al.  Dynamic Coalition Formation among Rational Agents , 2002, IEEE Intell. Syst..

[23]  Edmund H. Durfee,et al.  Coalition Agents Experiment: Multi-Agent Co-operation in an International Coalition Setting , 2002 .

[24]  Harry Chen,et al.  Information Agents for Mobile and Embedded Devices , 2001, CIA.

[25]  Leen-Kiat Soh,et al.  Reflective Negotiating Agents for Real-Time Multisensor Target Tracking , 2001, IJCAI.

[26]  V. Goranko Coalition games and alternating temporal logics , 2001 .

[27]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[28]  Hiroaki Kitano,et al.  RoboCup Rescue: a grand challenge for multi-agent systems , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[29]  Jeffrey M. Bradshaw,et al.  R2D2 in a softball: the portable satellite assistant , 2000, IUI '00.

[30]  Victor R. Lesser,et al.  Coalitions Among Computationally Bounded Agents , 1997, Artif. Intell..

[31]  Sarit Kraus,et al.  Negotiation and Cooperation in Multi-Agent Environments , 1997, Artif. Intell..

[32]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[33]  Rachid Alami,et al.  Operating a large fleet of mobile robots using the plan-merging paradigm , 1997, Proceedings of International Conference on Robotics and Automation.

[34]  Nicholas R. Jennings,et al.  Coordination in software agent systems , 1996 .

[35]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[36]  R. Noland Pedestrian Travel Times and Motor Vehicle Traffic Signals , 1996 .

[37]  Ronald Lumia,et al.  Vision-based robotic convoy driving , 1995, Machine Vision and Applications.

[38]  Sarit Kraus,et al.  Task Allocation Via Coalition Formation Among Autonomous Agents , 1995, IJCAI.

[39]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[40]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[41]  Sarit Kraus,et al.  Multiagent Negotiation under Time Constraints , 1995, Artif. Intell..

[42]  Hongyan Wang,et al.  Social potential fields: A distributed behavioral control for autonomous robots , 1995, Robotics Auton. Syst..

[43]  Jeffrey S. Rosenschein,et al.  Rules of Encounter - Designing Conventions for Automated Negotiation among Computers , 1994 .

[44]  Nicholas R. Jennings,et al.  Towards a Theory of Cooperative Problem Solving , 1994, MAAMAW.

[45]  M. Chwe Farsighted Coalitional Stability , 1994 .

[46]  Sarit Kraus,et al.  Coalition Formation Among Autonomous Agents: Strategies and Complexity , 1993, MAAMAW.

[47]  Hector J. Levesque,et al.  On Acting Together , 1990, AAAI.

[48]  Mark S. Fox,et al.  Constraint-Directed Negotiation of Resource Reallocations , 1990, Distributed Artificial Intelligence.

[49]  Katia Sycara,et al.  Multiagent Compromise via Negotiation , 1989, Distributed Artificial Intelligence.

[50]  Edmund H. Durfee,et al.  Trends in Cooperative Distributed Problem Solving , 1989, IEEE Trans. Knowl. Data Eng..

[51]  Eric R. Zieyel Operations research : applications and algorithms , 1988 .

[52]  Michael Georgeff A theory of action for multi-agent planning , 1988 .

[53]  Thomas L. Casavant,et al.  A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems , 1988, IEEE Trans. Software Eng..

[54]  Edmund H. Durfee,et al.  Coherent Cooperation Among Communicating Problem Solvers , 1987, IEEE Transactions on Computers.

[55]  Edmund H. Durfee,et al.  Using Partial Global Plans to Coordinate Distributed Problem Solvers , 1987, IJCAI.

[56]  Barbara Hayes-Roth,et al.  A Blackboard Architecture for Control , 1985, Artif. Intell..

[57]  Michael P. Georgeff,et al.  Communication and interaction in multi-agent planning , 1983, AAAI 1983.

[58]  Robert M. May,et al.  The evolution of cooperation , 1981, Science.

[59]  Reid G. Smith,et al.  The Contract Net Protocol: High-Level Communication and Control in a Distributed Problem Solver , 1980, IEEE Transactions on Computers.

[60]  Vasek Chvátal,et al.  A Greedy Heuristic for the Set-Covering Problem , 1979, Math. Oper. Res..

[61]  N. Smelser Theory Of Collective Behavior , 1963 .

[62]  Alfred McClung Lee,et al.  New outline of the principles of sociology , 1947 .

[63]  Sanem Sariel,et al.  REAL TIME AUCTION BASED ALLOCATION OF TASKS FOR MULTI-ROBOT EXPLORATION PROBLEM IN DYNAMIC ENVIRONMENTS , 2005 .

[64]  Ladislau Bölöni,et al.  An object-oriented approach for semantic understanding of messages in a distributed object system , 2005 .

[65]  Alexander Kleiner,et al.  Approaching Urban Disaster Reality: The ResQ Firesimulator , 2004, RoboCup.

[66]  David E. Culler,et al.  The mote revolution: low power wireless sensor network devices , 2004 .

[67]  Manuela Veloso,et al.  Opportunities for Learning in Multi-Agent Meeting Scheduling , 2004, AAAI Technical Report.

[68]  Jeffrey M. Bradshaw,et al.  The coalition agents experiment: network-enabled coalition operations , 2003 .

[69]  Robert L. Goldstone,et al.  Collective Behavior , 2002 .

[70]  Hyun Mun Kim,et al.  California Partners for Advanced Transit and Highways ( PATH ) UC Berkeley , 2000 .

[71]  Anatol Rapoport,et al.  Theories of Coalition Formation , 1998 .

[72]  Sarit Kraus,et al.  Formation of overlapping coalitions for precedence-ordered task-execution among autonomous agents * , 1996 .

[73]  Douglas H. Norrie,et al.  A Multi-Agent Intelligent Design System Integrating Manufacturing and Shop-Floor Control , 1995, ICMAS.

[74]  Jörg P. Müller,et al.  A Model for Cooperative Transportation Scheduling , 1995, ICMAS.

[75]  Ken Binmore,et al.  Noncooperative models of bargaining , 1992 .

[76]  Edward G. Coffman,et al.  Computer and job-shop scheduling theory , 1976 .

[77]  A. Rapoport N-Person Game Theory , 1970 .

[78]  R. Turner Collective behavior / by Ralph H. Turner and Lewis M. Killian , 1957 .

[79]  P. Faratin,et al.  Automated Negotiation: Prospects, Methods and Challenges , 2001 .