An overview of collaborative robotic manipulation in multi-robot systems

Abstract Robotic manipulation aims at combining the versatility and flexibility of mobile robot platforms with manipulation capabilities of robot manipulators. This survey paper comprehensively reviews the state-of-the-art development of collaborative robotic manipulation from the perspective of modelling, control and optimization. Then, the recent results in this field can be categorized into coordination of multiple fixed manipulators, mobile robots and mobile manipulators, respectively. A classification and comparison of various issues and promising approaches is given. Finally, a short discussion section is given to summarize existing research and to point out several future research directions.

[1]  Kevin M. Passino,et al.  Stability analysis of swarms , 2003, IEEE Trans. Autom. Control..

[2]  Andrea Gasparri,et al.  Distributed Control of Multirobot Systems With Global Connectivity Maintenance , 2013, IEEE Trans. Robotics.

[3]  Yongcan Cao,et al.  Finite-Time Connectivity-Preserving Consensus of Networked Nonlinear Agents With Unknown Lipschitz Terms , 2016, IEEE Transactions on Automatic Control.

[4]  Antonio Franchi,et al.  Decentralized motion control for cooperative manipulation with a team of networked mobile manipulators , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Henk Nijmeijer,et al.  Mutual synchronization of robots via estimated state feedback: a cooperative approach , 2004, IEEE Transactions on Control Systems Technology.

[6]  Yongduan Song,et al.  Fully distributed flocking with a moving leader for Lagrange networks with parametric uncertainties , 2015, Autom..

[7]  Ross A. Knepper,et al.  IkeaBot: An autonomous multi-robot coordinated furniture assembly system , 2013, 2013 IEEE International Conference on Robotics and Automation.

[8]  Hanlei Wang,et al.  Passivity based synchronization for networked robotic systems with uncertain kinematics and dynamics , 2013, Autom..

[9]  Chun-Yi Su,et al.  Neural-Adaptive Control of Single-Master–Multiple-Slaves Teleoperation for Coordinated Multiple Mobile Manipulators With Time-Varying Communication Delays and Input Uncertainties , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Jie Huang,et al.  Leader-following consensus of multiple uncertain Euler–Lagrange systems under switching network topology , 2014, Int. J. Gen. Syst..

[11]  Xiao Fan Wang,et al.  Flocking of Multi-Agents With a Virtual Leader , 2009, IEEE Trans. Autom. Control..

[12]  George J. Pappas,et al.  Potential Fields for Maintaining Connectivity of Mobile Networks , 2007, IEEE Transactions on Robotics.

[13]  Vijay Kumar,et al.  Robust Control for Mobility and Wireless Communication in Cyber–Physical Systems With Application to Robot Teams , 2012, Proceedings of the IEEE.

[14]  Gang Feng,et al.  A Model-Free Cross-Coupled Control for Position Synchronization of Multi-Axis Motions: Theory and Experiments , 2007, IEEE Transactions on Control Systems Technology.

[15]  Guangfu Ma,et al.  Distributed Coordinated Tracking With a Dynamic Leader for Multiple Euler-Lagrange Systems , 2011, IEEE Transactions on Automatic Control.

[16]  Emmanuel Nuno,et al.  Consensus in Networks of Nonidentical Euler–Lagrange Systems Using P+d Controllers , 2013, IEEE Transactions on Robotics.

[17]  Guoqiang Hu,et al.  Adaptive Task-Space Cooperative Tracking Control of Networked Robotic Manipulators Without Task-Space Velocity Measurements , 2016, IEEE Transactions on Cybernetics.

[18]  Lorenzo Sabattini,et al.  Decentralized connectivity maintenance for cooperative control of mobile robotic systems , 2013, Int. J. Robotics Res..

[19]  Saptarshi Bandyopadhyay,et al.  Phase synchronization control of complex networks of Lagrangian systems on adaptive digraphs , 2013, Autom..

[20]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[21]  Shuzhi Sam Ge,et al.  Robust Adaptive Control of Cooperating Mobile Manipulators With Relative Motion , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Lu Liu,et al.  Leader-Following Consensus of Multiple Uncertain Euler–Lagrange Systems Subject to Communication Delays and Switching Networks , 2018, IEEE Transactions on Automatic Control.

[23]  Frank L. Lewis,et al.  Distributed Adaptive Tracking Control for Synchronization of Unknown Networked Lagrangian Systems , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Yuanqing Xia,et al.  Adaptive Fuzzy Control of Multilateral Asymmetric Teleoperation for Coordinated Multiple Mobile Manipulators , 2016, IEEE Transactions on Fuzzy Systems.

[25]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[26]  Xiao Fan Wang,et al.  Rendezvous of multiple mobile agents with preserved network connectivity , 2010, Syst. Control. Lett..

[27]  Guangfu Ma,et al.  Distributed containment control for Lagrangian networks with parametric uncertainties under a directed graph , 2012, Autom..

[28]  Romeo Ortega,et al.  Achieving Consensus of Euler–Lagrange Agents With Interconnecting Delays and Without Velocity Measurements via Passivity-Based Control , 2018, IEEE Transactions on Control Systems Technology.

[29]  Hyo-Sung Ahn,et al.  A survey of multi-agent formation control , 2015, Autom..

[30]  Alessandro Marino,et al.  Distributed Adaptive Control of Networked Cooperative Mobile Manipulators , 2018, IEEE Transactions on Control Systems Technology.

[31]  Jie Huang,et al.  Leader‐following consensus with connectivity preservation of uncertain Euler–Lagrange multi‐agent systems , 2017 .

[32]  Yi Dong,et al.  A leader-following rendezvous problem of double integrator multi-agent systems , 2013, Autom..

[33]  Hanlei Wang,et al.  Task-Space Synchronization of Networked Robotic Systems With Uncertain Kinematics and Dynamics , 2013, IEEE Transactions on Automatic Control.

[34]  Rong Su,et al.  A Polynomial-Time Algorithm for Computing Finite-Makespan Controllable Sublanguages , 2015, IEEE Transactions on Automatic Control.

[35]  Sandra Hirche,et al.  Human-Guided Multirobot Cooperative Manipulation , 2019, IEEE Transactions on Control Systems Technology.

[36]  Amir G. Aghdam,et al.  A Class of Bounded Distributed Control Strategies for Connectivity Preservation in Multi-Agent Systems , 2010, IEEE Transactions on Automatic Control.

[37]  Long Wang,et al.  Connectivity preservation for multi-agent rendezvous with link failure , 2012, Autom..

[38]  Yi Dong,et al.  Leader-Following Connectivity Preservation Rendezvous of Multiple Double Integrator Systems Based on Position Measurement Only , 2014, IEEE Transactions on Automatic Control.

[39]  Yongcan Cao,et al.  Distributed Coordination of Multi-agent Networks: Emergent Problems, Models, and Issues , 2010 .

[40]  Ziyang Meng,et al.  Leader-follower swarm tracking for networked Lagrange systems , 2012, Syst. Control. Lett..

[41]  Wei Ren,et al.  Distributed leaderless consensus algorithms for networked Euler–Lagrange systems , 2009, Int. J. Control.

[42]  Thomas Sugar,et al.  Control of cooperating mobile manipulators , 2002, IEEE Trans. Robotics Autom..

[43]  Magnus Egerstedt,et al.  Graph-theoretic connectivity control of mobile robot networks , 2011, Proceedings of the IEEE.

[44]  Wenwu Yu,et al.  An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination , 2012, IEEE Transactions on Industrial Informatics.

[45]  Veysel Gazi,et al.  Swarm aggregations using artificial potentials and sliding-mode control , 2005, IEEE Transactions on Robotics.

[46]  Fumitoshi Matsuno,et al.  Task-Space Synchronization of Networked Mechanical Systems With Uncertain Parameters and Communication Delays , 2017, IEEE Transactions on Cybernetics.

[47]  Zhijun Li,et al.  Adaptive robust coordinated control of multiple mobile manipulators interacting with rigid environments , 2010, Autom..

[48]  Antonio Franchi,et al.  Distributed Estimation of State and Parameters in Multiagent Cooperative Load Manipulation , 2016, IEEE Transactions on Control of Network Systems.

[49]  Guoqiang Hu,et al.  Time-Varying Formation Tracking for Linear Multiagent Systems With Multiple Leaders , 2017, IEEE Transactions on Automatic Control.

[50]  Giuseppe Casalino,et al.  Manipulation and Transportation With Cooperative Underwater Vehicle Manipulator Systems , 2017, IEEE Journal of Oceanic Engineering.

[51]  Siddhartha S. Srinivasa,et al.  Decentralized estimation and control of graph connectivity in mobile sensor networks , 2008, 2008 American Control Conference.

[52]  Hanlei Wang,et al.  Consensus of Networked Mechanical Systems With Communication Delays: A Unified Framework , 2014, IEEE Transactions on Automatic Control.

[53]  John T. Wen,et al.  Cooperative Load Transport: A Formation-Control Perspective , 2010, IEEE Transactions on Robotics.

[54]  Lu Ren,et al.  Synchronous Tracking Control of Parallel Manipulators Using Cross-coupling Approach , 2006, Int. J. Robotics Res..

[55]  Ole Madsen,et al.  Autonomous industrial mobile manipulation (AIMM): past, present and future , 2012, Ind. Robot.

[56]  Jie Huang,et al.  The Leader-Following Consensus for Multiple Uncertain Euler-Lagrange Systems With an Adaptive Distributed Observer , 2016, IEEE Transactions on Automatic Control.

[57]  George J. Pappas,et al.  Hybrid Control for Connectivity Preserving Flocking , 2009, IEEE Transactions on Automatic Control.

[58]  Bruce Randall Donald,et al.  Moving furniture with teams of autonomous robots , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[59]  Bin Liu,et al.  Model Predictive Flocking Control of the Cucker-Smale Multi-Agent Model With Input Constraints , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[60]  Dimos V. Dimarogonas,et al.  Robust Cooperative Manipulation Without Force/Torque Measurements: Control Design and Experiments , 2017, IEEE Transactions on Control Systems Technology.

[61]  Guoqiang Hu,et al.  Time-varying formation control for general linear multi-agent systems with switching directed topologies , 2016, Autom..

[62]  Romeo Ortega,et al.  Synchronization of Networks of Nonidentical Euler-Lagrange Systems With Uncertain Parameters and Communication Delays , 2011, IEEE Transactions on Automatic Control.

[63]  Guoqiang Hu,et al.  Connectivity-preserving flocking for networked Lagrange systems with time-varying actuator faults , 2019, Autom..

[64]  Kimon P. Valavanis Intelligent Robotic Systems: Theory, Design and Applications , 1995, ICCCN.

[65]  Mark W. Spong,et al.  On synchronization of networked passive systems with time delays and application to bilateral teleoperation , 2005 .

[66]  Richard M. Murray,et al.  Recent Research in Cooperative Control of Multivehicle Systems , 2007 .

[67]  Yong Li,et al.  Admittance-Based Adaptive Cooperative Control for Multiple Manipulators With Output Constraints , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[68]  Guoqiang Hu,et al.  Robust Connectivity Preserving Rendezvous of Multirobot Systems Under Unknown Dynamics and Disturbances , 2017, IEEE Transactions on Control of Network Systems.

[69]  Guoqiang Hu,et al.  Cloud robotics: architecture, challenges and applications , 2012, IEEE Network.

[70]  Soon-Jo Chung,et al.  Cooperative Robot Control and Concurrent Synchronization of Lagrangian Systems , 2007, IEEE Transactions on Robotics.

[71]  Maobin Lu Rendezvous with connectivity preservation of mobile agents subject to uniform time-delays , 2018, Autom..

[72]  Guoqiang Hu,et al.  Robust finite-time connectivity preserving coordination of second-order multi-agent systems , 2018, Autom..

[73]  Oussama Khatib,et al.  Coordination and decentralized cooperation of multiple mobile manipulators , 1996, J. Field Robotics.

[74]  Jiu-Gang Dong Finite-time connectivity preservation rendezvous with disturbance rejection , 2016, Autom..

[75]  H. Jin Kim,et al.  Constraint-Based Cooperative Control of Multiple Aerial Manipulators for Handling an Unknown Payload , 2017, IEEE Transactions on Industrial Informatics.

[76]  Dimos V. Dimarogonas,et al.  On the Rendezvous Problem for Multiple Nonholonomic Agents , 2007, IEEE Transactions on Automatic Control.

[77]  Magnus Egerstedt,et al.  Distributed Coordination Control of Multiagent Systems While Preserving Connectedness , 2007, IEEE Transactions on Robotics.

[78]  Gang Feng,et al.  Distributed Average Tracking of Networked Euler-Lagrange Systems , 2015, IEEE Transactions on Automatic Control.

[79]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[80]  Ilia G. Polushin,et al.  Leader-Follower Synchronization of Euler-Lagrange Systems With Time-Varying Leader Trajectory and Constrained Discrete-Time Communication , 2017, IEEE Transactions on Automatic Control.

[81]  Chao Zhai,et al.  A General Alignment Repulsion Algorithm for Flocking of Multi-Agent Systems , 2011, IEEE Transactions on Automatic Control.

[82]  Ilia G. Polushin,et al.  Synchronization of Lagrangian Systems With Irregular Communication Delays , 2014, IEEE Transactions on Automatic Control.

[83]  Javier Alonso-Mora,et al.  Multi-robot formation control and object transport in dynamic environments via constrained optimization , 2017, Int. J. Robotics Res..

[84]  Guanghui Wen,et al.  Flocking of multi‐agent dynamical systems with intermittent nonlinear velocity measurements , 2012 .