Dynamic collision avoidance for multiple robotic manipulators based on a non-cooperative multi-agent game

A flexible operation of multiple robotic manipulators in a shared workspace requires an online trajectory planning with static and dynamic collision avoidance. In this work, we propose a real-time capable motion control algorithm, based on non-linear model predictive control, which accounts for static and dynamic collision avoidance. The proposed algorithm is formulated as a non-cooperative game, where each robot is considered as an agent. Each agent optimizes its own motion and accounts for the predicted movement of surrounding agents. We propose a novel approach to formulate the dynamic collision constraints. Additionally, we account for deadlocks that might occur in a setup of multiple robotic manipulators. We validate our algorithm on a pick and place scenario for four collaborative robots operating in a common workspace in the simulation environment Gazebo. The robots are controlled by the Robot Operating System (ROS). We demonstrate, that our approach is real-time capable and, due to the distributed nature of the approach, easily scales to an arbitrary number of robot manipulators in a shared workspace.

[1]  Synchronous Minimum-Time Cooperative Manipulation using Distributed Model Predictive Control , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Panagiotis D. Christofides,et al.  Distributed model predictive control: A tutorial review and future research directions , 2013, Comput. Chem. Eng..

[3]  WächterAndreas,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006 .

[4]  Květoslav Belda,et al.  Predictive control of 5 DOF robot arm of autonomous mobile robotic system motion control employing mathematical model of the robot arm dynamics , 2017, 2017 21st International Conference on Process Control (PC).

[5]  Optimal Scheduling and Model Predictive Control for Trajectory Planning of Cooperative Robot Manipulators , 2020, IFAC-PapersOnLine.

[6]  S. Sathiya Keerthi,et al.  A fast procedure for computing the distance between complex objects in three-dimensional space , 1988, IEEE J. Robotics Autom..

[7]  Martin Ruskowski,et al.  Considering interdependencies for a dynamic generation of process chains for Production as a Service , 2020 .

[8]  Torsten Bertram,et al.  Planning of multiple robot trajectories in distinctive topologies , 2015, 2015 European Conference on Mobile Robots (ECMR).

[9]  René Henrion,et al.  Path planning and collision avoidance for robots , 2012 .

[10]  Paul Bosscher,et al.  Real-time collision avoidance algorithm for robotic manipulators , 2009, 2009 IEEE International Conference on Technologies for Practical Robot Applications.

[11]  Moritz Diehl,et al.  CIAO*: MPC-based Safe Motion Planning in Predictable Dynamic Environments , 2020 .

[12]  Masayoshi Tomizuka,et al.  The Convex Feasible Set Algorithm for Real Time Optimization in Motion Planning , 2017, SIAM J. Control. Optim..

[13]  Jianjun Luo,et al.  A non-linear model predictive controller with obstacle avoidance for a space robot , 2016 .

[14]  B. Faverjon,et al.  A local based approach for path planning of manipulators with a high number of degrees of freedom , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[15]  Frank Hoffmann,et al.  Exploiting Sparse Structures in Nonlinear Model Predictive Control with Hypergraphs , 2018, 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[16]  Moritz Diehl,et al.  CasADi: a software framework for nonlinear optimization and optimal control , 2018, Mathematical Programming Computation.

[17]  Min Wu,et al.  An Optimisation-Based Distributed Cooperative Control for Multi-Robot Manipulation with Obstacle Avoidance , 2020 .

[18]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[19]  Xiaojing Zhang,et al.  Optimization-Based Collision Avoidance , 2017, IEEE Transactions on Control Systems Technology.

[20]  Nikolaos G. Tsagarakis,et al.  Efficient self-collision avoidance based on focus of interest for humanoid robots , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[21]  Chris Manzie,et al.  Multi-axis model predictive contouring control , 2013, Int. J. Control.

[22]  Torsten Bertram,et al.  Model predictive control of a collaborative manipulator considering dynamic obstacles , 2020, Optimal Control Applications and Methods.

[23]  Eiichi Yoshida,et al.  A Local Collision Avoidance Method for Non-strictly Convex Polyhedra , 2008, Robotics: Science and Systems.

[24]  G. Martin,et al.  Nonlinear model predictive control , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[25]  Stephen J. Wright,et al.  Cooperative distributed model predictive control , 2010, Syst. Control. Lett..

[26]  Jochen J. Steil,et al.  Vertical Integration and Service Orchestration for Modular Production Systems Using Business Process Models , 2016 .

[27]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[28]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[29]  Anders Robertsson,et al.  Real-time trajectory generation using model predictive control , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[30]  Qi Gong,et al.  Smooth proximity computation for collision-free optimal control of multiple robotic manipulators , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Stephen P. Boyd,et al.  Obstacle Collision Detection Using Best Ellipsoid Fit , 1997, J. Intell. Robotic Syst..

[32]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[33]  Sören Hohmann,et al.  Cooperative Shared Control Driver Assistance Systems Based on Motion Primitives and Differential Games , 2017, IEEE Transactions on Human-Machine Systems.

[34]  Jan Swevers,et al.  Time-Optimal Path Tracking for Robots: A Convex Optimization Approach , 2009, IEEE Transactions on Automatic Control.

[35]  Vladimir J. Lumelsky,et al.  On Fast Computation of Distance Between Line Segments , 1985, Information Processing Letters.

[36]  Michael J. Black,et al.  Decentralized MPC based Obstacle Avoidance for Multi-Robot Target Tracking Scenarios , 2018, 2018 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[37]  Bernhard Nebel,et al.  Decentralized collision avoidance, deadlock detection, and deadlock resolution for multiple mobile robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[38]  Stefan Schaal,et al.  STOMP: Stochastic trajectory optimization for motion planning , 2011, 2011 IEEE International Conference on Robotics and Automation.