Efficient Object Search With Belief Road Map Using Mobile Robot

This letter describes a pipeline for autonomous object search using a mobile robot. The robot is required to efficiently find an object in an unknown environment. In this letter, we formulate the object-search problem as a Partially Observable Markov Decision Process (POMDP). The semantic information of the room types and the object is utilized for training the belief distribution in the POMDP. We use Gaussian Mixed Model (GMM) to model the distribution of belief states. This letter introduces a novel scheme for the belief propagation when the robot is searching for an object. Both the belief distribution trained by the prior knowledge and the searching experience of the robot are taken into consideration when a new room turns up. The objective function in our formulation concerns both the path cost to the target and the information gain in the target area. We propose a novel graph structure called belief road map (BRM) that is built along with the searching process. The robot can efficiently query a path on the generated BRM instead of on the whole occupancy grid map. To reduce the belief states in the POMDP, the node in BRM that has the most information is selected to represent a room. The simulation and the real experimental studies demonstrate the efficiency and efficacy of our proposed searching approach.

[1]  James J. Little,et al.  Informed visual search: Combining attention and object recognition , 2008, 2008 IEEE International Conference on Robotics and Automation.

[2]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[3]  Henrik I. Christensen,et al.  Robot planning with a semantic map , 2013, 2013 IEEE International Conference on Robotics and Automation.

[4]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[5]  A. Cassandra A Survey of POMDP Applications , 2003 .

[6]  Max Q.-H. Meng,et al.  Variant step size RRT: An efficient path planner for UAV in complex environments , 2016, 2016 IEEE International Conference on Real-time Computing and Robotics (RCAR).

[7]  David Hsu,et al.  SARSOP: Efficient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces , 2008, Robotics: Science and Systems.

[8]  Patric Jensfelt,et al.  Plan-based Object Search and Exploration using Semantic Spatial Knowledge in the Real World , 2011, ECMR.

[9]  Alessandro Saffiotti,et al.  Robot task planning using semantic maps , 2008, Robotics Auton. Syst..

[10]  Giuseppe Oriolo,et al.  Frontier-Based Probabilistic Strategies for Sensor-Based Exploration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[11]  Reid G. Simmons,et al.  Point-Based POMDP Algorithms: Improved Analysis and Implementation , 2005, UAI.

[12]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[13]  Cipriano Galindo,et al.  Multi-hierarchical semantic maps for mobile robotics , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Patric Jensfelt,et al.  Active Visual Object Search in Unknown Environments Using Uncertain Semantics , 2013, IEEE Transactions on Robotics.

[15]  Nick Hawes,et al.  Using Qualitative Spatial Relations for indirect object search , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Patric Jensfelt,et al.  Large-scale semantic mapping and reasoning with heterogeneous modalities , 2012, 2012 IEEE International Conference on Robotics and Automation.

[17]  Risto Ritala,et al.  Planning for robotic exploration based on forward simulation , 2015, Robotics Auton. Syst..

[18]  Antonios Gasteratos,et al.  Semantic mapping for mobile robotics tasks: A survey , 2015, Robotics Auton. Syst..

[19]  Max Q.-H. Meng,et al.  Autonomous mobile robot navigation in uneven and unstructured indoor environments , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Joel Veness,et al.  Monte-Carlo Planning in Large POMDPs , 2010, NIPS.

[21]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[22]  Gordon Wyeth,et al.  Place categorization and semantic mapping on a mobile robot , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Steven M. LaValle,et al.  Rapidly-Exploring Random Trees: Progress and Prospects , 2000 .