Multi-Robot Searching using Game-Theory Based Approach

This paper proposes a game-theory based approach in a multi–target searching using a multi-robot system in a dynamic environment. It is assumed that a rough priori probability map of the targets' distribution within the environment is given. To consider the interaction between the robots, a dynamic-programming equation is proposed to estimate the utility function for each robot. Based on this utility function, a cooperative nonzero-sum game is generated, where both pure Nash Equilibrium and mixed-strategy Equilibrium solutions are presented to achieve an optimal overall robot behaviors. A special consideration has been taken to improve the real-time performance of the game-theory based approach. Several mechanisms, such as event-driven discretization, one-step dynamic programming, and decision buffer, have been proposed to reduce the computational complexity. The main advantage of the algorithm lies in its real-time capabilities whilst being efficient and robust to dynamic environments.

[1]  S. Shankar Sastry,et al.  Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation , 2002, IEEE Trans. Robotics Autom..

[2]  Ming-Yang Kao,et al.  Searching in an unknown environment: an optimal randomized algorithm for the cow-path problem , 1996, SODA '93.

[3]  T. J. Stewart Search for a moving target when searcher motion is restricted , 1979, Comput. Oper. Res..

[4]  Ricardo A. Baeza-Yates,et al.  Searching in the Plane , 1993, Inf. Comput..

[5]  James N. Eagle,et al.  An Optimal Branch-and-Bound Procedure for the Constrained Path, Moving Target Search Problem , 1990, Oper. Res..

[6]  Steven M. LaValle,et al.  Path selection and coordination for multiple robots via Nash equilibria , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[7]  Gamini Dissanayake,et al.  Optimal search for multiple targets in a built environment , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  James N. Eagle The Optimal Search for a Moving Target When the Search Path Is Constrained , 1984, Oper. Res..

[9]  Robin R. Murphy Biomimetic search for urban search and rescue , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[10]  Nikos A. Vlassis,et al.  Multi-robot decision making using coordination graphs , 2003 .

[11]  Krzysztof Skrzypczyk Game theory based target following by a team of robots , 2004, Proceedings of the Fourth International Workshop on Robot Motion and Control (IEEE Cat. No.04EX891).

[12]  Hugh F. Durrant-Whyte,et al.  Coordinated decentralized search for a lost target in a Bayesian world , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[13]  J.P. How,et al.  Search for dynamic targets with uncertain probability maps , 2006, 2006 American Control Conference.

[14]  Marios M. Polycarpou,et al.  Cooperative real-time search and task allocation in UAV teams , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[15]  Alejandro López-Ortiz,et al.  Online Parallel Heuristics and Robot Searching under the Competitive Framework , 2002, SWAT.

[16]  S. Sastry,et al.  Probabilistic pursuit-evasion games: a one-step Nash approach , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[17]  J.P. How,et al.  Robust UAV Search for Environments with Imprecise Probability Maps , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[18]  Wolfram Burgard,et al.  Monte Carlo Localization: Efficient Position Estimation for Mobile Robots , 1999, AAAI/IAAI.

[19]  John C. Harsanyi,et al.  Общая теория выбора равновесия в играх / A General Theory of Equilibrium Selection in Games , 1989 .