Multirobot Cooperative Patrolling Strategy for Moving Objects

In multirobot patrolling problems, various dynamic situations require a higher level of cooperation among robots. The dynamic problems caused by moving objects are rarely studied yet. This work proposes a distributed event-driven cooperative strategy for multirobot systems to patrol moving objects autonomously. First, forward and backward utility functions are defined as criteria for robots to conduct two-way evaluation when they choose their targets to patrol. Then, three event types and a cooperative action considering energy consumption and visiting frequency comprehensively are proposed to improve coordination among robots during their execution processes. In simulation experiments, the proposed strategy shows significant advantages on decreasing the average and maximum unvisited time of moving objects compared with the state-of-the-art. A marine pollution monitoring case is simulated to demonstrate the practicability of this strategy.

[1]  H. Fan,et al.  Dynamic Scheduling and Path Planning of Automated Guided Vehicles in Automatic Container Terminal , 2022, IEEE/CAA Journal of Automatica Sinica.

[2]  Bahare Kiumarsi-Khomartash,et al.  Barrier-Certified Learning-Enabled Safe Control Design for Systems Operating in Uncertain Environments , 2022, IEEE/CAA Journal of Automatica Sinica.

[3]  Ziye Zhou,et al.  A Survey of Underwater Multi-Robot Systems , 2022, IEEE/CAA Journal of Automatica Sinica.

[4]  Ruy Fabila Monroy,et al.  Stochastic strategies for patrolling a terrain with a synchronized multi-robot system , 2021, Eur. J. Oper. Res..

[5]  Mengchu Zhou,et al.  Weak Estimator-Based Stochastic Searching on the Line in Dynamic Dual Environments , 2021, IEEE Transactions on Cybernetics.

[6]  Mengchu Zhou,et al.  Evolutionary Algorithm-Based Attack Strategy With Swarm Robots in Denied Environments , 2023, IEEE Transactions on Evolutionary Computation.

[7]  Yan Peng,et al.  Adaptive Sliding Mode Fault-Tolerant Fuzzy Tracking Control With Application to Unmanned Marine Vehicles , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[8]  Seunghwan Lee A Multi-Robot Balanced Coverage Path Planning Strategy for Patrol Missions , 2021, 2021 21st International Conference on Control, Automation and Systems (ICCAS).

[9]  Haris E. Psillakis,et al.  Adaptive NN Cooperative Control of Unknown Nonlinear Multiagent Systems With Communication Delays , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Ge Guo,et al.  Quantized Sliding Mode Control of Unmanned Marine Vehicles: Various Thruster Faults Tolerated With a Unified Model , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Toshiharu Sugawara,et al.  Effective Area Partitioning in a Multi-Agent Patrolling Domain for Better Efficiency , 2021, ICAART.

[12]  Radu Calinescu,et al.  Reinforcement Learning with Quantitative Verification for Assured Multi-Agent Policies , 2021, ICAART.

[13]  Huayan Pu,et al.  Hybrid Partition-Based Patrolling Scheme for Maritime Area Patrol with Multiple Cooperative Unmanned Surface Vehicles , 2020, Journal of Marine Science and Engineering.

[14]  Jonghoek Kim,et al.  Target Following and Close Monitoring Using an Unmanned Surface Vehicle , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Stefano Carpin,et al.  Multirobot Patrolling Against Adaptive Opponents with Limited Information , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Leonardo Bobadilla,et al.  Stochastic Multi-Robot Patrolling with Limited Visibility , 2020, J. Intell. Robotic Syst..

[17]  Bernhard Rinner,et al.  Multi-Robot Patrolling with Sensing Idleness and Data Delay Objectives , 2019, J. Intell. Robotic Syst..

[18]  Xin Zhou,et al.  Bayesian Reinforcement Learning for Multi-Robot Decentralized Patrolling in Uncertain Environments , 2019, IEEE Transactions on Vehicular Technology.

[19]  Sarit Kraus,et al.  Multi-robot adversarial patrolling: Handling sequential attacks , 2019, Artif. Intell..

[20]  MengChu Zhou,et al.  A survey of multi-robot regular and adversarial patrolling , 2019, IEEE/CAA Journal of Automatica Sinica.

[21]  Seong-Lyun Kim,et al.  A Multi-Robot Cooperative Patrolling Algorithm with Sharing Multiple Cycles , 2019, 2019 European Conference on Networks and Communications (EuCNC).

[22]  Amal El Fallah Seghrouchni,et al.  LSTM Path-Maker: a new LSTM-based strategy for the multi-agent patrolling , 2019, HICSS.

[23]  Zhihua Qu,et al.  A Rainbow Coverage Path Planning for a Patrolling Mobile Robot With Circular Sensing Range , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[24]  Yongsheng Ding,et al.  An Adaptive Online Co-Search Method With Distributed Samples for Dynamic Target Tracking , 2018, IEEE Transactions on Control Systems Technology.

[25]  Daniele Nardi,et al.  Distributed on-line dynamic task assignment for multi-robot patrolling , 2017, Auton. Robots.

[26]  Maria Potop-Butucaru,et al.  Multi-agent patrolling in dynamic environments , 2017, 2017 IEEE International Conference on Agents (ICA).

[27]  Tao Cheng,et al.  Developing an online cooperative police patrol routing strategy , 2017, Comput. Environ. Urban Syst..

[28]  Tauhidul Alam,et al.  Decentralized and Nondeterministic Multi-Robot Area Patrolling in Adversarial Environments , 2016 .

[29]  Sarvapali D. Ramchurn,et al.  Decentralized Patrolling Under Constraints in Dynamic Environments , 2016, IEEE Transactions on Cybernetics.

[30]  David Portugal,et al.  Cooperative multi-robot patrol with Bayesian learning , 2016, Auton. Robots.

[31]  Daniela Rus,et al.  Dynamic Patrolling Policy for Optimizing Urban Mobility Networks , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[32]  Erik Hernandez,et al.  Selective Smooth Fictitious Play: An approach based on game theory for patrolling infrastructures with a multi-robot system , 2014, Expert Syst. Appl..

[33]  Henrik I. Christensen,et al.  Dynamic, cooperative multi-robot patrolling with a team of UAVs , 2013, Defense, Security, and Sensing.

[34]  Shigeo Doi,et al.  Proposal and evaluation of a pheromone-based algorithm for the patrolling problem in dynamic environments , 2013, 2013 IEEE Symposium on Swarm Intelligence (SIS).

[35]  Nicholas R. Jennings,et al.  Near-optimal continuous patrolling with teams of mobile information gathering agents , 2013, Artif. Intell..

[36]  Francesco Bullo,et al.  Cooperative Patrolling via Weighted Tours: Performance Analysis and Distributed Algorithms , 2012, IEEE Transactions on Robotics.

[37]  Xu Chen,et al.  Fast Patrol Route Planning in Dynamic Environments , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[38]  Antonio Franchi,et al.  On Cooperative Patrolling: Optimal Trajectories, Complexity Analysis, and Approximation Algorithms , 2011, IEEE Transactions on Robotics.

[39]  Marco Bibuli,et al.  Path‐following algorithms and experiments for an unmanned surface vehicle , 2009, J. Field Robotics.

[40]  C. B. Barrass,et al.  Ship Design and Performance for Masters and Mates , 2004 .

[41]  Alexis Drogoul,et al.  Multi-agent Patrolling: An Empirical Analysis of Alternative Architectures , 2002, MABS.

[42]  Kay Chen Tan,et al.  Evolutionary artificial potential fields and their application in real time robot path planning , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[43]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.