Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation

We consider the problem of having a team of unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs) pursue a second team of evaders while concurrently building a map in an unknown environment. We cast the problem in a probabilistic game theoretical framework, and consider two computationally feasible greedy pursuit policies: local-mar and global-max. To implement this scenario on real UAVs and UGVs, we propose a distributed hierarchical hybrid system architecture which emphasizes the autonomy of each agent, yet allows for coordinated team efforts. We describe the implementation of the architecture on a fleet of UAVs and UGVs, detailing components such as high-level pursuit policy computation, map building and interagent communication, and low-level navigation, sensing, and control. We present both simulation and experimental results of real pursuit-evasion games involving our fleet of UAVs and UGVs, and evaluate the pursuit policies relating expected capture times to the speed and intelligence of the evaders and the sensing capabilities of the pursuers.

[1]  Hiroaki Kitano,et al.  RoboCup: robot world cup , 1998, IEEE Robotics Autom. Mag..

[2]  Xiaotie Deng,et al.  How to learn an unknown environment. I: the rectilinear case , 1998, JACM.

[3]  S. Sastry,et al.  Decidable and semi-decidable controller synthesis for classes of discrete time hybrid systems , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[4]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[5]  S. Shankar Sastry,et al.  Pursuit-evasion games with unmanned ground and aerial vehicles , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[6]  Wolfram Burgard,et al.  A Probabilistic Approach to Concurrent Mapping and Localization for Mobile Robots , 1998, Auton. Robots.

[7]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[8]  J.P. Hespanha,et al.  Multiple-agent probabilistic pursuit-evasion games , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[9]  Rufus Isaacs,et al.  Differential Games , 1965 .

[10]  Tae-Yong Kuc,et al.  Perception, reasoning and learning of multiple agent systems for robot soccer , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[11]  S. Shankar Sastry,et al.  HIERARCHICAL CONTROL SYSTEM SYNTHESIS FOR ROTORCRAFT-BASED UNMANNED AERIAL VEHICLES , 2000 .

[12]  J.P. Desai,et al.  Control of changes in formation for a team of mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[13]  Masafumi Yamashita,et al.  Searching for a Mobile Intruder in a Polygonal Region , 1992, SIAM J. Comput..

[14]  Bruno Sinopoli,et al.  Hybrid Control of an Autonomous Helicopter , 1998 .

[15]  S. Sastry,et al.  VISION-BASED DETECTION OF AUTONOMOUS VEHICLES FOR PURSUIT-EVASION GAMES , 2002 .

[16]  A. V. Timofeev,et al.  Hybrid algorithms of multi-agent control of mobile robots , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[17]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[18]  S. Shankar Sastry,et al.  A vision system for landing an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[19]  John Lygeros,et al.  A next generation architecture for air traffic management systems , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[20]  Hiroaki Kitano,et al.  RoboCup: A Challenge Problem for AI and Robotics , 1997, RoboCup.

[21]  Stergios I. Roumeliotis,et al.  Collective localization: a distributed Kalman filter approach to localization of groups of mobile robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[22]  北野 宏明,et al.  RoboCup-97 : robot soccer World Cup I , 1998 .

[23]  John Lygeros,et al.  Verified hybrid controllers for automated vehicles , 1998, IEEE Trans. Autom. Control..

[24]  René Vidal,et al.  A hierarchical approach to probabilistic pursuit-evasion games with unmanned ground and aerial vehicles , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[25]  S. Sastry,et al.  Probabilistic pursuit-evasion games: a one-step Nash approach , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[26]  Minoru Asada,et al.  Cooperative Behavior Acquisition for Mobile Robots in Dynamically Changing Real Worlds Via Vision-Based Reinforcement Learning and Development , 1999, Artif. Intell..

[27]  Tucker R. Balch,et al.  Distributed sensor fusion for object position estimation by multi-robot systems , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[28]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[29]  Leonidas J. Guibas,et al.  Finding an unpredictable target in a workspace with obstacles , 1997, Proceedings of International Conference on Robotics and Automation.