An Integrated Approach to Goal Selection in Mobile Robot Exploration

This paper deals with the problem of autonomous navigation of a mobile robot in an unknown 2D environment to fully explore the environment as efficiently as possible. We assume a terrestrial mobile robot equipped with a ranging sensor with a limited range and 360° field of view. The key part of the exploration process is formulated as the d-Watchman Route Problem which consists of two coupled tasks—candidate goals generation and finding an optimal path through a subset of goals—which are solved in each exploration step. The latter has been defined as a constrained variant of the Generalized Traveling Salesman Problem and solved using an evolutionary algorithm. An evolutionary algorithm that uses an indirect representation and the nearest neighbor based constructive procedure was proposed to solve this problem. Individuals evolved in this evolutionary algorithm do not directly code the solutions to the problem. Instead, they represent sequences of instructions to construct a feasible solution. The problems with efficiently generating feasible solutions typically arising when applying traditional evolutionary algorithms to constrained optimization problems are eliminated this way. The proposed exploration framework was evaluated in a simulated environment on three maps and the time needed to explore the whole environment was compared to state-of-the-art exploration methods. Experimental results show that our method outperforms the compared ones in environments with a low density of obstacles by up to 12.5%, while it is slightly worse in office-like environments by 4.5% at maximum. The framework has also been deployed on a real robot to demonstrate the applicability of the proposed solution with real hardware.

[1]  Lawrence V. Snyder,et al.  A random-key genetic algorithm for the generalized traveling salesman problem , 2006, Eur. J. Oper. Res..

[2]  Zoran Saric,et al.  An Efficient Transformation of the Generalized Traveling Salesman Problem into the Traveling Salesman Problem on Digraphs , 1997, Inf. Sci..

[3]  Koen V. Hindriks,et al.  Ontological reasoning for human-robot teaming in search and rescue missions , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  Libor Preucil,et al.  SyRoTek—Distance Teaching of Mobile Robotics , 2013, IEEE Transactions on Education.

[5]  David Ben-Arieh,et al.  Transformations of generalized ATSP into ATSP , 2003, Oper. Res. Lett..

[6]  Jamal Arkat,et al.  Complete Coverage Path Planning for a Multi-UAV Response System in Post-Earthquake Assessment , 2016, Robotics.

[7]  Gregory Dudek,et al.  Modeling curiosity in a mobile robot for long-term autonomous exploration and monitoring , 2015, Autonomous Robots.

[8]  Lian-Ming Mou A novel ant colony system with double pheromones for the generalized TSP , 2011, 2011 Seventh International Conference on Natural Computation.

[9]  Fredrik Heintz,et al.  Efficient Autonomous Exploration Planning of Large-Scale 3-D Environments , 2019, IEEE Robotics and Automation Letters.

[10]  G. Syswerda,et al.  Schedule Optimization Using Genetic Algorithms , 1991 .

[11]  Nicola Basilico,et al.  Exploration Strategies based on Multi-Criteria Decision Making for an Autonomous Mobile Robot , 2009, ECMR.

[12]  Songhwai Oh,et al.  Real-time navigation in crowded dynamic environments using Gaussian process motion control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Wei-Yun Yau,et al.  An improved Frontier-Based Approach for Autonomous Exploration , 2018, 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[14]  Songhwai Oh,et al.  Structured Kernel Subspace Learning for Autonomous Robot Navigation † , 2018, Sensors.

[15]  Simeon C. Ntafos,et al.  Optimum watchman routes , 1986, SCG '86.

[16]  Christian Bettstetter,et al.  Assessing the value of coordination in mobile robot exploration using a discrete-time Markov process , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Joseph S. B. Mitchell,et al.  Approximating Watchman Routes , 2013, SODA.

[18]  Jan Faigl,et al.  Self-organizing map for determination of goal candidates in mobile robot exploration , 2014, ESANN.

[19]  Daniel Karapetyan,et al.  An Efficient Hybrid Ant Colony System for the Generalized Traveling Salesman Problem , 2012, Algorithmic Oper. Res..

[20]  B. Naderi,et al.  A novel imperialist competitive algorithm for generalized traveling salesman problems , 2015, Appl. Soft Comput..

[21]  Dikai Liu,et al.  Experimental Evaluation of Nearest Neighbor Exploration Approach in Field Environments , 2017, IEEE Transactions on Automation Science and Engineering.

[22]  Gregory Gutin,et al.  Efficient local search algorithms for known and new neighborhoods for the generalized traveling salesman problem , 2010, Eur. J. Oper. Res..

[23]  Jirí Kubalík,et al.  A novel evolutionary algorithm with indirect representation and extended nearest neighbor constructive procedure for solving routing problems , 2014, 2014 14th International Conference on Intelligent Systems Design and Applications.

[24]  Belaïd Ahiod,et al.  Using Cluster Barycenters for the Generalized Traveling Salesman Problem , 2016, ISDA.

[25]  Bo Ding,et al.  Design of an Indoor Exploration and Multi-Objective Navigation System , 2018, 2018 37th Chinese Control Conference (CCC).

[26]  Vincenzo Caglioti,et al.  An information-based exploration strategy for environment mapping with mobile robots , 2010, Robotics Auton. Syst..

[27]  Jianda Han,et al.  Search and Rescue Rotary‐Wing UAV and Its Application to the Lushan Ms 7.0 Earthquake , 2016, J. Field Robotics.

[28]  Alexei Makarenko,et al.  An experiment in integrated exploration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Rafael Murrieta-Cid,et al.  Planning exploration strategies for simultaneous localization and mapping , 2006, Robotics Auton. Syst..

[30]  Yuanyuan Zhao,et al.  Autonomous Underwater Vehicle Navigation , 2010, IEEE Journal of Oceanic Engineering.

[31]  Huseyin Guden,et al.  New formulations for the generalized traveling salesman problem , 2012 .

[32]  Sven Koenig,et al.  Greedy mapping of terrain , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[33]  Sven Koenig,et al.  Improved analysis of greedy mapping , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[34]  Brian Yamauchi,et al.  A frontier-based approach for autonomous exploration , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[35]  P. R. Reddy,et al.  Evaluation of Stopping Criterion in Contour Tracing Algorithms , 2012 .

[36]  Libor Preucil,et al.  A Technical Solution of a Robotic e-Learning System in the SyRoTek Project , 2011, CSEDU.

[37]  Roland Siegwart,et al.  Receding horizon path planning for 3D exploration and surface inspection , 2018, Auton. Robots.

[38]  Petrica C. Pop,et al.  The generalized traveling salesman problem solved with ant algorithms , 2013, Complex Adapt. Syst. Model..

[39]  Max Q.-H. Meng,et al.  Deep Reinforcement Learning Supervised Autonomous Exploration in Office Environments , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[40]  Nicola Basilico,et al.  Exploration strategies based on multi-criteria decision making for searching environments in rescue operations , 2011, Auton. Robots.

[41]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[42]  Alberto Quattrini Li,et al.  Evaluating the impact of perception and decision timing on autonomous robotic exploration , 2013, 2013 European Conference on Mobile Robots.

[43]  Wolfram Burgard,et al.  Speeding-Up Robot Exploration by Exploiting Background Information , 2016, IEEE Robotics and Automation Letters.

[44]  Robin R. Murphy,et al.  Disaster Robotics , 2014, Springer Handbook of Robotics, 2nd Ed..

[45]  G. Laporte,et al.  Generalized Travelling Salesman Problem Through n Sets Of Nodes: An Integer Programming Approach , 1983 .

[46]  Gregory Gutin,et al.  A memetic algorithm for the generalized traveling salesman problem , 2008, Natural Computing.

[47]  Y. Charlie Hu,et al.  Energy-efficient mobile robot exploration , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[48]  Alan C. Schultz,et al.  Mobile robot exploration and map-building with continuous localization , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[49]  Wolfram Burgard,et al.  Coordinated multi-robot exploration , 2005, IEEE Transactions on Robotics.

[50]  Alexei A. Efros,et al.  Large-Scale Study of Curiosity-Driven Learning , 2018, ICLR.

[51]  Christos Papachristos,et al.  Uncertainty-aware receding horizon exploration and mapping using aerial robots , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[52]  Michael Bosse,et al.  Autonomous feature-based exploration , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[53]  Shayok Mukhopadhyay,et al.  Autonomous robotic exploration based on multiple rapidly-exploring randomized trees , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[54]  William R. Hamel,et al.  Robotics in Hazardous Applications , 2008, Springer Handbook of Robotics, 2nd Ed..

[55]  Manuel Armada,et al.  Inspection platform for applications in humanitarian demining , 2015 .

[56]  Jan Faigl,et al.  On benchmarking of frontier-based multi-robot exploration strategies , 2015, 2015 European Conference on Mobile Robots (ECMR).

[57]  Jan Faigl,et al.  On determination of goal candidates in frontier-based multi-robot exploration , 2013, 2013 European Conference on Mobile Robots.

[58]  Cyrill Stachniss,et al.  Robust exploration and homing for autonomous robots , 2017, Robotics Auton. Syst..

[59]  Yukinori Kobayashi,et al.  On a bio-inspired hybrid pheromone signalling for efficient map exploration of multiple mobile service robots , 2016, Artificial Life and Robotics.

[60]  Libor Preucil,et al.  Goal assignment using distance cost in multi-robot exploration , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[61]  Francesco Bullo,et al.  Smooth Nearness-Diagram Navigation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[62]  Fernando Carreira,et al.  A complete frontier-based exploration method for Pose-SLAM , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[63]  Libor Preucil,et al.  On distance utility in the exploration task , 2011, 2011 IEEE International Conference on Robotics and Automation.

[64]  Ronald L. Rivest,et al.  Introduction to Algorithms, third edition , 2009 .

[65]  Donald B. Johnson,et al.  Efficient Algorithms for Shortest Paths in Sparse Networks , 1977, J. ACM.

[66]  Davide Scaramuzza,et al.  Active Autonomous Aerial Exploration for Ground Robot Path Planning , 2017, IEEE Robotics and Automation Letters.

[67]  Matteo Fischetti,et al.  A Branch-and-Cut Algorithm for the Symmetric Generalized Traveling Salesman Problem , 1997, Oper. Res..

[68]  Héctor H. González-Baños,et al.  Navigation Strategies for Exploring Indoor Environments , 2002, Int. J. Robotics Res..

[69]  Tao Chen,et al.  Learning Exploration Policies for Navigation , 2019, ICLR.

[70]  Wolfram Burgard,et al.  Information Gain-based Exploration Using Rao-Blackwellized Particle Filters , 2005, Robotics: Science and Systems.