Fully Distributed Informative Planning for Environmental Learning with Multi-Robot Systems

This paper proposes a cooperative environmental learning algorithm working in a fully distributed manner. A multi-robot system is more effective for exploration tasks than a single robot, but it involves the following challenges: i) online distributed learning of environmental map using multiple robots; ii) generation of safe and efficient exploration path based on the learned map; and iii) maintenance of the scalability with respect to the number of robots. To this end, we divide the entire process into two stages of environmental learning and path planning. Distributed algorithms are applied in each stage and combined through communication between adjacent robots. The environmental learning algorithm uses a distributed Gaussian process, and the path planning algorithm uses a distributed Monte Carlo tree search. As a result, we build a scalable system without the constraint on the number of robots. Simulation results demonstrate the performance and scalability of the proposed system. Moreover, a real-world-dataset-based simulation validates the utility of our algorithm in a more realistic scenario.

[1]  Nicholas Roy,et al.  Information-Guided Robotic Maximum Seek-and-Sample in Partially Observable Continuous Environments , 2019, IEEE Robotics and Automation Letters.

[2]  Manuele Bicego,et al.  Orienteering-based informative path planning for environmental monitoring , 2019, Eng. Appl. Artif. Intell..

[3]  David H. Wolpert,et al.  Probability Collectives in Optimization , 2013 .

[4]  Dongbing Gu,et al.  Distributed EM Algorithm for Gaussian Mixtures in Sensor Networks , 2008, IEEE Transactions on Neural Networks.

[5]  R. Murray,et al.  Consensus protocols for networks of dynamic agents , 2003, Proceedings of the 2003 American Control Conference, 2003..

[6]  Eric Moulines,et al.  On Upper-Confidence Bound Policies for Switching Bandit Problems , 2011, ALT.

[7]  Bernard C. Levy,et al.  Karhunen Loeve Expansion of Gaussian Processes , 2008 .

[8]  Wen-Hua Chen,et al.  Boustrophedon coverage path planning for UAV aerial surveys in wind , 2017, 2017 International Conference on Unmanned Aircraft Systems (ICUAS).

[9]  Damiano Varagnolo,et al.  Distributed Multi-Agent Gaussian Regression via Finite-Dimensional Approximations , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Xianting Li,et al.  An experimental and numerical study on a multi-robot source localization method independent of airflow information in dynamic indoor environments , 2020 .

[11]  Bin Du,et al.  Parallelized Active Information Gathering Using Multisensor Network for Environment Monitoring , 2021, IEEE Transactions on Control Systems Technology.

[12]  Shengyong Chen,et al.  Intelligent Collaborative Localization Among Air-Ground Robots for Industrial Environment Perception , 2019, IEEE Transactions on Industrial Electronics.

[13]  Lantao Liu,et al.  Pareto Monte Carlo Tree Search for Multi-Objective Informative Planning , 2019, Robotics: Science and Systems.

[14]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[15]  Gaurav S. Sukhatme,et al.  An information-driven and disturbance-aware planning method for long-term ocean monitoring , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Andreas Krause,et al.  Nonmyopic Informative Path Planning in Spatio-Temporal Models , 2007, AAAI.

[17]  Jongeun Choi,et al.  Distributed learning and cooperative control for multi-agent systems , 2009, Autom..

[18]  K. Sycara,et al.  Adaptive Informative Sampling with Environment Partitioning for Heterogeneous Multi-Robot Systems , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Brady G. Moon,et al.  Wind and the City: Utilizing UAV-Based In-Situ Measurements for Estimating Urban Wind Fields , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  S. Kakade,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2012, IEEE Transactions on Information Theory.

[21]  Gaurav S. Sukhatme,et al.  Informative planning and online learning with sparse Gaussian processes , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Roberto Schirru,et al.  Reconstruction of radiation dose rate profiles by autonomous robot with active learning and Gaussian process regression , 2018 .

[23]  Dohyun Jang,et al.  Multi-Robot Active Sensing and Environmental Model Learning With Distributed Gaussian Process , 2020, IEEE Robotics and Automation Letters.

[24]  Salah Sukkarieh,et al.  A Gaussian process-based RRT planner for the exploration of an unknown and cluttered environment with a UAV , 2013, Adv. Robotics.

[25]  Christopher K. I. Williams,et al.  Gaussian regression and optimal finite dimensional linear models , 1997 .

[26]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[27]  Srihari Nelakuditi,et al.  Multi-robot online sensing strategies for the construction of communication maps , 2019, Auton. Robots.

[28]  Changjoo Nam,et al.  Distributed Environmental Modeling and Adaptive Sampling for Multi-Robot Sensor Coverage , 2019, AAMAS.

[29]  Christoph Manss,et al.  Decentralized multi-agent exploration with online-learning of Gaussian processes , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Bernard C. Levy,et al.  Principles of Signal Detection and Parameter Estimation , 2008 .

[31]  Fang Deng,et al.  Energy-Based Sound Source Localization with Low Power Consumption in Wireless Sensor Networks , 2017, IEEE Transactions on Industrial Electronics.

[32]  Timothy Patten,et al.  Dec-MCTS: Decentralized planning for multi-robot active perception , 2019, Int. J. Robotics Res..

[33]  Ernesto Nunes,et al.  Monte Carlo Tree Search for Multi-Robot Task Allocation , 2016, AAAI.

[34]  Randy A. Freeman,et al.  Distributed Environmental Monitoring With Finite Element Robots , 2020, IEEE Transactions on Robotics.