Motion strategies for exploration and map building under uncertainty with multiple heterogeneous robots

In this paper, we present a multi-robot exploration strategy for map building. We consider an indoor structured environment and a team of robots with different sensing and motion capabilities. We combine geometric and probabilistic reasoning to propose a solution to our problem. We formalize the proposed solution using stochastic dynamic programming (SDP) in states with imperfect information. Our modeling can be considered as a partially observable Markov decision process (POMDP), which is optimized using SDP. We apply the dynamic programming technique in a reduced search space that allows us to incrementally explore the environment. We propose realistic sensor models and provide a method to compute the probability of the next observation given the current state of the team of robots based on a Bayesian approach. We also propose a probabilistic motion model, which allows us to take into account errors (noise) on the velocities applied to each robot. This modeling also allows us to simulate imperfect robot motions, and to estimate the probability of reaching the next state given the current state. We have implemented all our algorithms and simulations results are presented. Graphical Abstract

[1]  Karl Johan Åström,et al.  Optimal control of Markov processes with incomplete state information , 1965 .

[2]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[3]  Wolfram Burgard,et al.  Coordinated multi-robot exploration using a segmentation of the environment , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Vincenzo Caglioti,et al.  An information-based exploration strategy for environment mapping with mobile robots , 2010, Robotics Auton. Syst..

[5]  John J. Leonard,et al.  Adaptive Mobile Robot Navigation and Mapping , 1999, Int. J. Robotics Res..

[6]  Héctor H. González-Baños,et al.  Navigation Strategies for Exploring Indoor Environments , 2002, Int. J. Robotics Res..

[7]  Nidhi Kalra,et al.  Market-Based Multirobot Coordination: A Survey and Analysis , 2006, Proceedings of the IEEE.

[8]  David Hsu,et al.  SARSOP: Efficient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces , 2008, Robotics: Science and Systems.

[9]  Sebastian Thrun,et al.  Monte Carlo POMDPs , 1999, NIPS.

[10]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[11]  Arturo Gil,et al.  A comparison of path planning strategies for autonomous exploration and mapping of unknown environments , 2012, Auton. Robots.

[12]  Seth Hutchinson,et al.  Exploiting domain knowledge in planning for uncertain robot systems modeled as POMDPs , 2010, 2010 IEEE International Conference on Robotics and Automation.

[13]  Alejandro Sarmiento,et al.  An Efficient Motion Strategy to Compute Expected-Time Locally Optimal Continuous Search Paths in Known Environments , 2009, Adv. Robotics.

[14]  Dinesh Manocha,et al.  Independent navigation of multiple mobile robots with hybrid reciprocal velocity obstacles , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  William W. Cohen Adaptive mapping and navigation by teams of simple robots , 1996, Robotics Auton. Syst..

[16]  Brian Yamauchi,et al.  Frontier-based exploration using multiple robots , 1998, AGENTS '98.

[17]  Wolfram Burgard,et al.  Coordinated multi-robot exploration , 2005, IEEE Transactions on Robotics.

[18]  Reid G. Simmons,et al.  Point-Based POMDP Algorithms: Improved Analysis and Implementation , 2005, UAI.

[19]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[20]  Nicholas Roy,et al.  Global A-Optimal Robot Exploration in SLAM , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[21]  Kikuo Fujimura,et al.  Map making by cooperating mobile robots , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[22]  Steven M. LaValle,et al.  Optimal Gap Navigation for a Disc Robot , 2012, WAFR.

[23]  Marilena Vendittelli,et al.  The SRT method: randomized strategies for exploration , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[24]  Rafael Murrieta-Cid,et al.  Planning exploration strategies for simultaneous localization and mapping , 2006, Robotics Auton. Syst..

[25]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[26]  Jean-Paul Laumond,et al.  Position referencing and consistent world modeling for mobile robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[27]  Alexei Makarenko,et al.  An experiment in integrated exploration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[29]  Viii Supervisor Sonar-Based Real-World Mapping and Navigation , 2001 .

[30]  Francesco Amigoni,et al.  Experimental evaluation of some exploration strategies for mobile robots , 2008, 2008 IEEE International Conference on Robotics and Automation.

[32]  Nicola Basilico,et al.  Exploration strategies based on multi-criteria decision making for searching environments in rescue operations , 2011, Auton. Robots.

[33]  Gregory Dudek,et al.  Effective exploration strategies for the construction of visual maps , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[34]  Wolfram Burgard,et al.  Probabilistic mapping of an environment by a mobile robot , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[35]  Laurent Jeanpierre,et al.  Distributed value functions for multi-robot exploration , 2012, 2012 IEEE International Conference on Robotics and Automation.

[36]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[37]  Wolfram Burgard,et al.  Coordination for Multi-Robot Exploration and Mapping , 2000, AAAI/IAAI.

[38]  Rafael Murrieta-Cid,et al.  Exploration and map-building under uncertainty with multiple heterogeneous robots , 2011, 2011 IEEE International Conference on Robotics and Automation.

[39]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..