Neural Networks for Robot Arm Cooperation with a Full Distributed Control Topology

This chapter considers cooperative kinematic control of multiple robot arms with a full distributed control topology by using distributed recurrent neural networks. The problem is formulated as a constrained game, where energy consumptions for each robot arm, saturations of control input, and the topological constraints imposed by the communication graph are taken into account. An implicit form of the Nash equilibrium for the game is obtained by converting the problem into its dual space. Then, a distributed dynamic controller based on recurrent neural networks is devised to drive the system towards the desired Nash equilibrium to seek the optimal solution of the cooperative control. Global stability and solution optimality of the neural networks are proved in theory. Simulations demonstrate the effectiveness of the method presented in this chapter.

[1]  Long Jin,et al.  G2-Type SRMPC Scheme for Synchronous Manipulation of Two Redundant Robot Arms , 2015, IEEE Transactions on Cybernetics.

[2]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[3]  Shuai Li,et al.  Dynamic Neural Networks for Kinematic Redundancy Resolution of Parallel Stewart Platforms , 2016, IEEE Transactions on Cybernetics.

[4]  Shuai Li,et al.  Decentralized control of collaborative redundant manipulators with partial command coverage via locally connected recurrent neural networks , 2012, Neural Computing and Applications.

[5]  Oussama Khatib,et al.  The explicit dynamic model and inertial parameters of the PUMA 560 arm , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[6]  Yi Guo,et al.  Distributed consensus filter on directed switching graphs , 2015 .

[7]  Shuai Li,et al.  Nonlinearly Activated Neural Network for Solving Time-Varying Complex Sylvester Equation , 2014, IEEE Transactions on Cybernetics.

[8]  Shuai Li,et al.  Cooperative Distributed Source Seeking by Multiple Robots: Algorithms and Experiments , 2014, IEEE/ASME Transactions on Mechatronics.

[9]  Shuzhi Sam Ge,et al.  A unified quadratic-programming-based dynamical system approach to joint torque optimization of physically constrained redundant manipulators , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  J. Toner,et al.  Flocks, herds, and schools: A quantitative theory of flocking , 1998, cond-mat/9804180.

[11]  Shuai Li,et al.  Selective Positive–Negative Feedback Produces the Winner-Take-All Competition in Recurrent Neural Networks , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Xiaoping Liu,et al.  Direct adaptive neural control of nonlinear strict-feedback systems with unmodeled dynamics using small-gain approach , 2016 .

[13]  Lin Xiao,et al.  Finite-time solution to nonlinear equation using recurrent neural dynamics with a specially-constructed activation function , 2015, Neurocomputing.

[14]  John T. Wen,et al.  Decentralized Collaborative Load Transport by Multiple Robots , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[15]  Shuai Li,et al.  Inverse-Free Extreme Learning Machine With Optimal Information Updating , 2016, IEEE Transactions on Cybernetics.

[16]  Shuai Li,et al.  Integration-Enhanced Zhang Neural Network for Real-Time-Varying Matrix Inversion in the Presence of Various Kinds of Noises , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Yunong Zhang,et al.  Variable Joint-Velocity Limits of Redundant Robot Manipulators Handled by Quadratic Programming , 2013, IEEE/ASME Transactions on Mechatronics.

[18]  Jun Wang,et al.  A recurrent neural network for minimum infinity-norm kinematic control of redundant manipulators with an improved problem formulation and reduced architecture complexity , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Shuai Li,et al.  A dynamic neural network approach for solving nonlinear inequalities defined on a graph and its application to distributed, routing-free, range-free localization of WSNs , 2013, Neurocomputing.

[20]  Jian Li,et al.  Enhanced discrete-time Zhang neural network for time-variant matrix inversion in the presence of bias noises , 2016, Neurocomputing.

[21]  Christiaan J. J. Paredis,et al.  Agent-based planning and control of a multi-manipulator assembly system , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[22]  Shuai Li,et al.  A nonlinear model to generate the winner-take-all competition , 2013, Commun. Nonlinear Sci. Numer. Simul..

[23]  Shuai Li,et al.  Manipulability Optimization of Redundant Manipulators Using Dynamic Neural Networks , 2017, IEEE Transactions on Industrial Electronics.

[24]  Dongsheng Guo,et al.  Acceleration-Level Inequality-Based MAN Scheme for Obstacle Avoidance of Redundant Robot Manipulators , 2014, IEEE Transactions on Industrial Electronics.

[25]  Yi Guo,et al.  Dynamic consensus estimation of weighted average on directed graphs , 2015, Int. J. Syst. Sci..

[26]  Shuai Li,et al.  Distributed Multirobot Formation and Tracking Control in Cluttered Environments , 2016, ACM Trans. Auton. Adapt. Syst..

[27]  Peter Xiaoping Liu,et al.  Robust adaptive fuzzy fault-tolerant control for a class of non-lower-triangular nonlinear systems with actuator failures , 2016, Inf. Sci..

[28]  Shubao Liu,et al.  A Simplified Dual Neural Network for Quadratic Programming With Its KWTA Application , 2006, IEEE Transactions on Neural Networks.

[29]  T. Başar,et al.  Dynamic Noncooperative Game Theory, 2nd Edition , 1998 .

[30]  Frank Harary,et al.  Graph Theory , 2016 .

[31]  Shuai Li,et al.  Noise-Tolerant ZNN Models for Solving Time-Varying Zero-Finding Problems: A Control-Theoretic Approach , 2017, IEEE Transactions on Automatic Control.

[32]  Binghuang Cai,et al.  Different-Level Redundancy-Resolution and Its Equivalent Relationship Analysis for Robot Manipulators Using Gradient-Descent and Zhang 's Neural-Dynamic Methods , 2012, IEEE Transactions on Industrial Electronics.

[33]  G. Mastroeni.  Gap Functions and Descent Methods for Minty Variational Inequality , 2005 .

[34]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[35]  Xiaolin Hu,et al.  An Improved Dual Neural Network for Solving a Class of Quadratic Programming Problems and Its $k$-Winners-Take-All Application , 2008, IEEE Transactions on Neural Networks.

[36]  L. Wu,et al.  Redundancy coordination of multiple robotic devices for welding through genetic algorithm , 2000, Robotica.

[37]  Shuai Li,et al.  Decentralized kinematic control of a class of collaborative redundant manipulators via recurrent neural networks , 2012, Neurocomputing.

[38]  E. Karsenti.  Self-organization in cell biology: a brief history , 2008, Nature Reviews Molecular Cell Biology.

[39]  Jun Wang,et al.  Model Predictive Control of Nonlinear Systems With Unmodeled Dynamics Based on Feedforward and Recurrent Neural Networks , 2012, IEEE Transactions on Industrial Informatics.

[40]  Shuai Li,et al.  CPS Oriented Control Design for Networked Surveillance Robots With Multiple Physical Constraints , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[41]  Xiaolin Hu,et al.  A New Recurrent Neural Network for Solving Convex Quadratic Programming Problems With an Application to the $k$-Winners-Take-All Problem , 2009, IEEE Transactions on Neural Networks.

[42]  Karen Randall,et al.  The Allen Telescope Array: The First Widefield, Panchromatic, Snapshot Radio Camera for Radio Astronomy and SETI , 2009, Proceedings of the IEEE.

[43]  Huanqing Wang,et al.  Backstepping-Based Lyapunov Function Construction Using Approximate Dynamic Programming and Sum of Square Techniques , 2017, IEEE Transactions on Cybernetics.

[44]  Ue-Pyng Wen,et al.  A review of Hopfield neural networks for solving mathematical programming problems , 2009, Eur. J. Oper. Res..

[45]  Shuai Li,et al.  A biologically inspired solution to simultaneous localization and consistent mapping in dynamic environments , 2013, Neurocomputing.

[46]  Shuai Li,et al.  Distributed Recurrent Neural Networks for Cooperative Control of Manipulators: A Game-Theoretic Perspective , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[47]  L. Nifong,et al.  Robotic cardiac surgery. , 2003, Journal of long-term effects of medical implants.

[48]  J. Marescaux,et al.  Transcontinental robot-assisted remote telesurgery: feasibility and potential applications. , 2002 .

[49]  MengChu Zhou,et al.  Distributed Winner-Take-All in Dynamic Networks , 2017, IEEE Transactions on Automatic Control.

[50]  Shuai Li,et al.  Formation Control and Tracking for Co-operative Robots with Non-holonomic Constraints , 2016, J. Intell. Robotic Syst..

[51]  Shuai Li,et al.  Bluetooth aided mobile phone localization , 2014, ACM Trans. Embed. Comput. Syst..

[52]  Yi Guo,et al.  Average consensus with weighting matrix design for quantized communication on directed switching graphs , 2013 .

[53]  Shuai Li,et al.  Kinematic Control of Redundant Manipulators Using Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[54]  Jun Wang,et al.  A recurrent neural network for solving nonlinear convex programs subject to linear constraints , 2005, IEEE Transactions on Neural Networks.

[55]  Shuai Li,et al.  Winner-take-all based on discrete-time dynamic feedback , 2012, Appl. Math. Comput..

[56]  Jun Wang,et al.  A dual neural network for redundancy resolution of kinematically redundant manipulators subject to joint limits and joint velocity limits , 2003, IEEE Trans. Neural Networks.

[57]  Zhuping Wang,et al.  Adaptive recurrent neural network control of uncertain constrained nonholonomic mobile manipulators , 2014, Int. J. Syst. Sci..

[58]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[59]  Jun Wang,et al.  A primal-dual neural network for online resolving constrained kinematic redundancy in robot motion control , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[60]  Shuai Li,et al.  Distributed Task Allocation of Multiple Robots: A Control Perspective , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[61]  Zheng Wang,et al.  Using Laplacian Eigenmap as Heuristic Information to Solve Nonlinear Constraints Defined on a Graph and Its Application in Distributed Range-Free Localization of Wireless Sensor Networks , 2013, Neural Processing Letters.

[62]  Shuai Li,et al.  Modified ZNN for Time-Varying Quadratic Programming With Inherent Tolerance to Noises and Its Application to Kinematic Redundancy Resolution of Robot Manipulators , 2016, IEEE Transactions on Industrial Electronics.

[63]  Jun Ota,et al.  Cooperative transportation by two four-legged robots with implicit communication , 1999, Robotics Auton. Syst..

[64]  Shuai Li,et al.  Model-free control of Lorenz chaos using an approximate optimal control strategy , 2012 .

[65]  Jun Wang,et al.  A One-Layer Recurrent Neural Network for Constrained Nonsmooth Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[66]  Long Jin,et al.  Discrete-Time Zhang Neural Network for Online Time-Varying Nonlinear Optimization With Application to Manipulator Motion Generation , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[67]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[68]  Yunong Zhang,et al.  A New Performance Index for the Repetitive Motion of Mobile Manipulators , 2014, IEEE Transactions on Cybernetics.

[69]  Bo Liu,et al.  Self-Learning Variable Structure Control for a Class of Sensor-Actuator Systems , 2012, Sensors.

[70]  Huaguang Zhang,et al.  A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[71]  Lin Xiao,et al.  A finite-time convergent neural dynamics for online solution of time-varying linear complex matrix equation , 2015, Neurocomputing.

[72]  Nick Chater,et al.  Herding in humans , 2009, Trends in Cognitive Sciences.

[73]  Shuai Li,et al.  Accelerating a Recurrent Neural Network to Finite-Time Convergence for Solving Time-Varying Sylvester Equation by Using a Sign-Bi-power Activation Function , 2012, Neural Processing Letters.

[74]  Shuai Li,et al.  Nonconvex function activated zeroing neural network models for dynamic quadratic programming subject to equality and inequality constraints , 2017, Neurocomputing.

[75]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[76]  Xin Wang,et al.  On quality functions for grasp synthesis, fixture planning, and coordinated manipulation , 2004, IEEE Transactions on Automation Science and Engineering.

[77]  Jun Wang,et al.  Recurrent neural networks for minimum infinity-norm kinematic control of redundant manipulators , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[78]  Yangming Li,et al.  A class of finite-time dual neural networks for solving quadratic programming problems and its k-winners-take-all application , 2013, Neural Networks.

[79]  Shuai Li,et al.  Cooperative Motion Generation in a Distributed Network of Redundant Robot Manipulators With Noises , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.