Efficient decision-making for multiagent target searching and occupancy in an unknown environment

Abstract Target searching in an unknown environment is a traditional research issue in the multiagent area. In some real cases, the agents do not only discover the targets; instead, they have subsequent tasks that must be completed before a deadline. In this paper, these cases are abstracted as the agents searching for target locations in an unknown environment and then occupying these target locations within a limited time. The agents can obtain rewards by occupying the target locations, and the goal of this problem is to maximize net income, defined as total reward minus the moving cost of the agents. This problem can be transformed into the traditional problems, and then be solved by previous related algorithms. However, this approach is not optimal. In this paper, we present a method that combines previous algorithms and a decision-making algorithm. The experiments demonstrate that the method containing our decision-making algorithm can lead to higher net income than simply using previous algorithms.

[1]  Xiang Jia,et al.  UAV formation collaborative search and dynamic task allocation method under uncertain environment , 2014, CCC 2014.

[2]  R. Sreerama Kumar,et al.  Intelligent decision making in multi-agent robot soccer system through compounded artificial neural networks , 2007, Robotics Auton. Syst..

[3]  Alcherio Martinoli,et al.  Inspiring and Modeling Multi-Robot Search with Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[4]  Ali Marjovi,et al.  Multi-robot exploration and fire searching , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Beno Benhabib,et al.  A Multirobot Path-Planning Strategy for Autonomous Wilderness Search and Rescue , 2015, IEEE Transactions on Cybernetics.

[6]  Kamal Kant Bharadwaj,et al.  Multi-robot exploration and terrain coverage in an unknown environment , 2012, Robotics Auton. Syst..

[7]  Geoffrey A. Hollinger,et al.  Efficient Multi-robot Search for a Moving Target , 2009, Int. J. Robotics Res..

[8]  Wanyuan Wang,et al.  Task Allocation for Undependable Multiagent Systems in Social Networks , 2013, IEEE Transactions on Parallel and Distributed Systems.

[9]  Bir Bhanu,et al.  Distributed multi-robot search in the real-world using modified particle swarm optimization , 2014, GECCO.

[10]  Minjie Zhang,et al.  A Hybrid Multi-Agent Framework for Load Management in Power Grid Systems , 2009, PRIMA Workshops.

[11]  Yuan Yan Tang,et al.  Multi-agent oriented constraint satisfaction , 2002, Artif. Intell..

[12]  Keng Peng Tee,et al.  Multi-Robot Item Delivery and Foraging: Two Sides of a Coin , 2015, Robotics.

[13]  Toru Ishida,et al.  Interorganizational Workflow Execution Based on Process Agents and ECA Rules , 2007, IEICE Trans. Inf. Syst..

[14]  Xin Xu,et al.  A combined hierarchical reinforcement learning based approach for multi-robot cooperative target searching in complex unknown environments , 2013, 2013 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL).

[15]  Steven Okamoto,et al.  Distributed constraint optimization for teams of mobile sensing agents , 2014, Autonomous Agents and Multi-Agent Systems.

[16]  Nicholas R. Jennings,et al.  Agent-based decentralised coordination for sensor networks using the max-sum algorithm , 2014, Autonomous Agents and Multi-Agent Systems.

[17]  Kristina Lerman,et al.  Analysis of Dynamic Task Allocation in Multi-Robot Systems , 2006, Int. J. Robotics Res..

[18]  Yichuan Jiang,et al.  A Survey of Task Allocation and Load Balancing in Distributed Systems , 2016, IEEE Transactions on Parallel and Distributed Systems.

[19]  Kurt Konolige,et al.  A practical, decision-theoretic approach to multi-robot mapping and exploration , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[20]  Yifeng Zeng,et al.  Exploiting Model Equivalences for Solving Interactive Dynamic Influence Diagrams , 2014, J. Artif. Intell. Res..

[21]  Gokhan Kirlik,et al.  A Dynamic Path Planning Approach for Multirobot Sensor-Based Coverage Considering Energy Constraints , 2009, IEEE Transactions on Cybernetics.

[22]  Michail G. Lagoudakis,et al.  Multi-robot routing under limited communication range , 2008, 2008 IEEE International Conference on Robotics and Automation.

[23]  Duc A. Tran,et al.  Distributed Client-Server Assignment for Online Social Network Applications , 2014, IEEE Transactions on Emerging Topics in Computing.

[24]  Evangelos Markakis,et al.  Agent Coordination with Regret Clearing , 2008, AAAI.

[25]  Magnus Egerstedt,et al.  Spatio-temporal multi-robot routing , 2015, Autom..

[26]  Prithviraj Dasgupta.  Multi-robot task allocation for performing cooperative foraging tasks in an initially unknown environment , 2011 .

[27]  Jing Hu,et al.  Decision Making of Networked Multiagent Systems for Interaction Structures , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Koen V. Hindriks,et al.  Auction-Based Dynamic Task Allocation for Foraging with a Cooperative Robot Team , 2014, EUMAS.

[29]  Victor R. Lesser,et al.  Communication decisions in multi-agent cooperation: model and experiments , 2001, AGENTS '01.

[30]  Magnus Egerstedt,et al.  Heterogeneous multi-robot routing , 2014, 2014 American Control Conference.

[31]  Sven Koenig,et al.  Multi-robot routing with linear decreasing rewards over time , 2009, 2009 IEEE International Conference on Robotics and Automation.

[32]  Dong-Hyun Lee,et al.  Resource-based task allocation for multi-robot systems , 2018, Robotics Auton. Syst..

[33]  Sven Koenig,et al.  Multi-robot routing with rewards and disjoint time windows , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.