A Survey and Analysis of Cooperative Multi-Agent Robot Systems: Challenges and Directions

Research in the area of cooperative multi-agent robot systems has received wide attention among researchers in recent years. The main concern is to find the effective coordination among autonomous agents to perform the task in order to achieve a high quality of overall performance. Therefore, this paper reviewed various selected literatures primarily from recent conference proceedings and journals related to cooperation and coordination of multi-agent robot systems (MARS). The problems, issues, and directions of MARS research have been investigated in the literature reviews. Three main elements of MARS which are the type of agents, control architectures, and communications were discussed thoroughly in the beginning of this paper. A series of problems together with the issues were analyzed and reviewed, which included centralized and decentralized control, consensus, containment, formation, task allocation, intelligences, optimization and communications of multi-agent robots. Since the research in the field of multi-agent robot research is expanding, some issues and future challenges in MARS are recalled, discussed and clarified with future directions. Finally, the paper is concluded with some recommendations with respect to multi-agent systems.

[1]  Zhong-Ping Jiang,et al.  Distributed nonlinear control of mobile autonomous multi-agents , 2014, Autom..

[2]  Marcello Farina,et al.  Application of distributed predictive control to motion and coordination problems for unicycle autonomous robots , 2015, Robotics Auton. Syst..

[3]  Giuseppe Oriolo,et al.  Multi-task Cooperative Control in a Heterogeneous Ground-Air Robot Team , 2015 .

[4]  Aiping Wang,et al.  Event-based consensus control for single-integrator networks with communication time delays , 2016, Neurocomputing.

[5]  Yongcan Cao,et al.  Overview of Recent Research in Distributed Multi-agent Coordination , 2011 .

[6]  M. Tan,et al.  Containment control of double-integrator multi-agent systems with aperiodic sampling: A small-gain theorem based method , 2014, Proceedings of the 33rd Chinese Control Conference.

[7]  Mohammad Ali Badamchizadeh,et al.  Containment control of heterogeneous linear multi-agent systems , 2015, Autom..

[8]  Javier de Lope,et al.  Self-organizing techniques to improve the decentralized multi-task distribution in multi-robot systems , 2015, Neurocomputing.

[9]  Frank L. Lewis,et al.  Distributed robust consensus control of multi-agent systems with heterogeneous matching uncertainties , 2013, Autom..

[10]  R. Sreerama Kumar,et al.  Intelligent task planning and action selection of a mobile robot in a multi-agent system through a fuzzy neural network approach , 2007, Eng. Appl. Artif. Intell..

[11]  Duc Truong Pham,et al.  Fuzzy and neuro-fuzzy based co-operative mobile robots , 2006 .

[12]  Weiming Shen,et al.  Swarm behavior control of mobile multi-robots with wireless sensor networks , 2011, J. Netw. Comput. Appl..

[13]  Olivier Simonin,et al.  A cooperative multi-robot architecture for moving a paralyzed robot , 2009 .

[14]  Hajime Asama,et al.  Design Of An Autonomous And Distributed Robot System: Actress , 1989, Proceedings. IEEE/RSJ International Workshop on Intelligent Robots and Systems '. (IROS '89) 'The Autonomous Mobile Robots and Its Applications.

[15]  Huosheng Hu,et al.  Coordination in multi-agent RoboCup teams , 2001, Robotics Auton. Syst..

[16]  Shun-ichi Azuma,et al.  Broadcast control of group of Markov chains , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[17]  Eiichi Yoshida,et al.  A design method of local communication area in multiple mobile robot system , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[18]  Norlida Buniyamin,et al.  Mobile robot obstacle avoidance in various type of static environments using fuzzy logic approach , 2014, 2014 2nd International Conference on Electrical, Electronics and System Engineering (ICEESE).

[19]  Petros G. Voulgaris,et al.  Supervised coverage control of multi-agent systems , 2014, Autom..

[20]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1997, Auton. Robots.

[21]  Camillo J. Taylor,et al.  A vision-based formation control framework , 2002, IEEE Trans. Robotics Autom..

[22]  Weisheng Yan,et al.  Consensus Problems for Muli-Agent System with Broadcasting-Type Topology , 2012, 2012 Second International Conference on Instrumentation, Measurement, Computer, Communication and Control.

[23]  Eugénio C. Oliveira,et al.  Multi-agent systems: which research for which applications , 1999, Robotics Auton. Syst..

[24]  Jitao Sun,et al.  Distributed optimal control for multi-agent systems with obstacle avoidance , 2016, Neurocomputing.

[25]  Debasish Ghose,et al.  Positional consensus in multi-agent systems using a broadcast control mechanism , 2009, 2009 American Control Conference.

[26]  Pierre-Yves Glorennec.  Coordination between autonomous robots , 1997, Int. J. Approx. Reason..

[27]  N. Buniyamin,et al.  The Development of a Remote Control Partner Lawnmower Robot , 2006, 2006 4th Student Conference on Research and Development.

[28]  Karl Henrik Johansson,et al.  Event-based broadcasting for multi-agent average consensus , 2013, Autom..

[29]  Norlida Buniyamin,et al.  Genetic Algorithm Versus Ant Colony Optimization Algorithm - Comparison of Performances in Robot Path Planning Application , 2010, ICINCO.

[30]  Micael S. Couceiro,et al.  Bridging the reality gap between the Webots simulator and e-puck robots , 2014, Robotics Auton. Syst..

[31]  Jing Wang.  On sign-board based inter-robot communication in distributed robotic systems , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[32]  Shun-ichi Azuma,et al.  Multi-agent consensus under communication-broadcast mixed environment , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[33]  Luca Maria Gambardella,et al.  RoboNetSim: An integrated framework for multi-robot and network simulation , 2013, Robotics Auton. Syst..

[34]  Miguel Hernando,et al.  A behaviour-based control architecture for heterogeneous modular, multi-configurable, chained micro-robots , 2012, Robotics Auton. Syst..

[35]  Hyo-Sung Ahn,et al.  A survey of multi-agent formation control , 2015, Autom..

[36]  Norlida Buniyamin,et al.  Ant colony system for robot path planning in global static environment , 2010 .

[37]  Fumio Hara,et al.  Cooperative route-searching behavior of multi-robot system using hello-call communication , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[38]  Hu Jiangping,et al.  Collective coordination of multi-agent systems guided by multiple leaders , 2009 .

[39]  Dani Goldberg.  Heterogeneous and Homogeneous Robot Group Behavior , 1996, AAAI/IAAI, Vol. 2.

[40]  Frank Allgöwer,et al.  An internal model principle is necessary and sufficient for linear output synchronization , 2011, Autom..

[41]  Nohaidda Binti Sariff,et al.  Mobile Robot Obstacles Avoidance by Using Braitenberg Approach , 2014 .

[42]  Ju H. Park,et al.  Leader-following consensus problem of heterogeneous multi-agent systems with nonlinear dynamics using fuzzy disturbance observer , 2014, Complex..

[43]  Fuchun Sun,et al.  Observer-based cluster consensus control of high-order multi-agent systems , 2015, Neurocomputing.

[44]  Muhammad Akmal Jeffril,et al.  The integration of fuzzy logic and artificial neural network methods for mobile robot obstacle avoidance in a static environment , 2013, 2013 IEEE 3rd International Conference on System Engineering and Technology.

[45]  Edgar N. Sánchez,et al.  Decentralized control for stabilization of nonlinear multi-agent systems using neural inverse optimal control , 2015, Neurocomputing.

[46]  Norlida Buniyamin,et al.  Comparative study of Genetic Algorithm and Ant Colony Optimization algorithm performances for robot path planning in global static environments of different complexities , 2009, 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation - (CIRA).

[47]  Joaquim Salvi,et al.  A multi-agent architecture with cooperative fuzzy control for a mobile robot , 2007, Robotics Auton. Syst..

[48]  Nicolas Jouandeau,et al.  A Survey and Analysis of Multi-Robot Coordination , 2013 .

[49]  Ljubo Vlacic,et al.  Cooperative behaviour of intelligent agents: Theory and practice , 2000 .

[50]  Nohaidda Binti Sariff,et al.  Simultaneous perturbation stochastic algorithm parameters effect towards multi agent robot broadcast controller , 2017, 2017 IEEE 7th International Conference on Underwater System Technology: Theory and Applications (USYS).

[51]  Gautam Kumar,et al.  Broadcast stochastic receding horizon control of multi-agent systems , 2013, Autom..

[52]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[53]  Kar-Han Tan,et al.  High Precision Formation Control of Mobile Robots Using Virtual Structures , 1997, Auton. Robots.

[54]  Loukas Petrou,et al.  Multi-objective optimization for dynamic task allocation in a multi-robot system , 2013, Eng. Appl. Artif. Intell..

[55]  Nohaidda Binti Sariff,et al.  Automatic Mobile Robot Obstacles Avoidance in a Static Environment by Using a Hybrid Technique Based on Fuzzy Logic and Artificial Neural network , 2014 .

[56]  Ken Sugawara,et al.  Cooperative acceleration of task performance: foraging behavior of interacting multi-robots system , 1997 .

[57]  Jie Huang,et al.  Cooperative Output Regulation of Linear Multi-Agent Systems , 2012, IEEE Transactions on Automatic Control.

[58]  Jorge Cortés,et al.  Zeno-free, distributed event-triggered communication and control for multi-agent average consensus , 2014, 2014 American Control Conference.

[59]  Domenico Prattichizzo,et al.  A Geometric Characterization of Leader-Follower Formation Control , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[60]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[61]  Youcheng Lou,et al.  Multi-leader set coordination of multi-agent systems with random switching topologies , 2010, 49th IEEE Conference on Decision and Control (CDC).

[62]  Shun-ichi Azuma,et al.  Broadcast control of multi-agent systems , 2011, IEEE Conference on Decision and Control and European Control Conference.

[63]  Norlida Buniyamin,et al.  Robot global path planning overview and a variation of ant colony system algorithm , 2011 .

[64]  Yongcan Cao,et al.  Distributed Coordination of Multi-agent Networks: Emergent Problems, Models, and Issues , 2010 .

[65]  Ricardo Vilalta,et al.  A unified framework for reinforcement learning, co-learning and meta-learning how to coordinate in collaborative multi-agent systems , 2010, ICCS.

[66]  Norlida Buniyamin,et al.  Evaluation of Robot Path Planning Algorithms in Global Static Environments : Genetic Algorithm Vs Ant Colony Optimization Algorithm , .

[67]  Asokan Thondiyath,et al.  Heuristic based Task Allocation Algorithm for Multiple Robots Using Agents , 2013 .

[68]  Aria Alasty,et al.  Adaptive critic-based neuro-fuzzy controller in multi-agents: Distributed behavioral control and path tracking , 2012, Neurocomputing.

[69]  Junwei Lu,et al.  Distributed reference model based containment control of second-order multi-agent systems , 2015, Neurocomputing.

[70]  António Paulo Moreira,et al.  Multi-robot nonlinear model predictive formation control: Moving target and target absence , 2013, Robotics Auton. Syst..

[71]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant, cooperative control of heterogeneous mobile robots , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[72]  Long Wang,et al.  Containment control of heterogeneous multi-agent systems , 2014, Int. J. Control.

[73]  Zengqiang Chen,et al.  Distributed containment control for bounded unknown second-order nonlinear multi-agent systems with dynamic leaders , 2015, Neurocomputing.

[74]  Ahmed Rahmani,et al.  Adaptive distributed formation control for multiple nonholonomic wheeled mobile robots , 2016, Neurocomputing.

[75]  Bing Li,et al.  Containment control for networked unknown Lagrangian systems with multiple dynamic leaders under a directed graph , 2013, 2013 American Control Conference.

[76]  Peng Shi,et al.  Distributed Finite-Time Containment Control for Double-Integrator Multiagent Systems , 2014, IEEE Transactions on Cybernetics.

[77]  Eiichi Yoshida,et al.  Effect of grouping in local communication system of multiple mobile robots , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[78]  Junmin Li,et al.  Iterative learning control approach for a kind of heterogeneous multi-agent systems with distributed initial state learning , 2015, Appl. Math. Comput..

[79]  Qing Zhang,et al.  Containment control of multi-agent systems with fixed time-delays in fixed directed networks , 2016, Neurocomputing.

[80]  Zhong-Ping Jiang,et al.  Event-based consensus of multi-agent systems with general linear models , 2014, Autom..

[81]  Domenico Prattichizzo,et al.  Leader-follower formation control as a disturbance decoupling problem , 2007, 2007 European Control Conference (ECC).

[82]  Zhong-Ping Jiang,et al.  Distributed output regulation of leader–follower multi‐agent systems , 2013 .

[83]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[84]  Susan Hackwood,et al.  Self-organization of sensors for swarm intelligence , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[85]  Eiichi Yoshida,et al.  A design method of local communication range in multiple mobile robot system , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[86]  YangQuan Chen,et al.  Formation control: a review and a new consideration , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[87]  José L. Poza,et al.  Agent-based distributed architecture for mobile robot control , 2008, Eng. Appl. Artif. Intell..

[88]  Elsa Arcaute,et al.  Local interactions over global broadcasts for improved task allocation in self-organized multi-robot systems , 2014, Robotics Auton. Syst..

[89]  Debasish Ghose,et al.  Broadcast Control Mechanism for Positional Consensus in Multiagent Systems , 2015, IEEE Transactions on Control Systems Technology.

[90]  Buniyamin,et al.  A Simple Local Path Planning Algorithm for Autonomous Mobile Robots , 2010 .

[91]  Yupu Yang,et al.  Leader-following consensus problem with a varying-velocity leader and time-varying delays , 2009 .

[92]  Hubert Roth,et al.  Integrated Motion Planning and Control for Multi Objectives Optimization and Multi Robots Navigation , 2015 .

[93]  Tucker R. Balch,et al.  Behavior-based formation control for multirobot teams , 1998, IEEE Trans. Robotics Autom..

[94]  N. Buniyamin,et al.  An Overview of Autonomous Mobile Robot Path Planning Algorithms , 2006, 2006 4th Student Conference on Research and Development.

[95]  Hubert Roth,et al.  Path Planning and Motion Coordination for Multi-Robots System Using Probabilistic Neuro-Fuzzy , 2015 .

[96]  Qian Ma,et al.  Output consensus for heterogeneous multi-agent systems with linear dynamics , 2015, Appl. Math. Comput..

[97]  Lynne E. Parker,et al.  Heterogeneous multi-robot cooperation , 1994 .