Cooperative Manipulation for a Mobile Dual-Arm Robot Using Sequences of Dynamic Movement Primitives

In order to extend promising robot applications in human daily lives, robots need to perform dextrous manipulation tasks, particularly for a mobile dual-arm robot. This paper propose a novel control strategy, which consists of a first trial process and a learning phase, to enable a mobile dual-arm robot to complete a grasp-and-place task which can be decomposed into movement sequences, such as reaching, grasping, and cooperative manipulation of a grasped object. Under the guidance of vision system, the robot with physical constraints successfully fulfills the task by tracking trajectories generated by redundancy resolution online using a neural-dynamic optimization. Then a reinforcement learning algorithm called the policy improvement with path integrals for sequences of dynamic movement primitives is applied to learn and adjust the recorded trajectories. Experimental results of the developed mobile dual-arm robot verified that the proposed strategy is able to successfully and optimally complete a grasp-and-place task.

[1]  Angelo Cangelosi,et al.  Novel Hybrid Adaptive Controller for Manipulation in Complex Perturbation Environments , 2015, PloS one.

[2]  ChangHwan Kim,et al.  Human-Like Motion Generation and Control for Humanoid's Dual Arm Object Manipulation , 2015, IEEE Transactions on Industrial Electronics.

[3]  Michael Beetz,et al.  Autonomous Robots: Special Issue on Autonomous Mobile Manipulation Manuscript No. Generality and Legibility in Mobile Manipulation Learning Skills for Routine Tasks , 2022 .

[4]  Yunong Zhang,et al.  Repetitive Motion Planning and Control of Redundant Robot Manipulators , 2013 .

[5]  Huaguang Zhang,et al.  Neural-Network-Based Robust Optimal Tracking Control for MIMO Discrete-Time Systems With Unknown Uncertainty Using Adaptive Critic Design , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[6]  E. A. Al-Gallaf.  Neuro-Kinematics Based Dexterous Robotics Hand Force Optimization , 2007, J. Intell. Robotic Syst..

[7]  Nikolaos G. Tsagarakis,et al.  Online Model Based Estimation of Complete Joint Stiffness of Human Arm , 2018, IEEE Robotics and Automation Letters.

[8]  Bingwei He,et al.  A Simple Rectification Method of Stereo Image Pairs with Calibrated Cameras , 2010, 2010 2nd International Conference on Information Engineering and Computer Science.

[9]  Olivier Lambercy,et al.  Design and Characterization of an Exoskeleton for Perturbing the Knee During Gait , 2017, IEEE Transactions on Biomedical Engineering.

[10]  Huaguang Zhang,et al.  Adaptive Fault-Tolerant Tracking Control for MIMO Discrete-Time Systems via Reinforcement Learning Algorithm With Less Learning Parameters , 2017, IEEE Transactions on Automation Science and Engineering.

[11]  Grzegorz Pajak,et al.  Sub-optimal trajectory planning for mobile manipulators , 2015, Robotica.

[12]  Zhijun Li,et al.  Adaptive robust coordinated control of multiple mobile manipulators interacting with rigid environments , 2010, Autom..

[13]  Gheorghe Leonte Mogan,et al.  Obstacle avoidance of redundant manipulators using neural networks based reinforcement learning , 2012 .

[14]  Oliver Kroemer,et al.  Generalization of human grasping for multi-fingered robot hands , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Stefan Schaal,et al.  Reinforcement Learning With Sequences of Motion Primitives for Robust Manipulation , 2012, IEEE Transactions on Robotics.

[16]  Barbara Savini,et al.  Path Planning for Autonomous Vehicles by Trajectory Smoothing Using Motion Primitives , 2008, IEEE Transactions on Control Systems Technology.

[17]  Stefan Schaal,et al.  A Generalized Path Integral Control Approach to Reinforcement Learning , 2010, J. Mach. Learn. Res..

[18]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[19]  Ales Ude,et al.  Programming full-body movements for humanoid robots by observation , 2004, Robotics Auton. Syst..

[20]  Jun Wang,et al.  Grasping-force optimization for multifingered robotic hands using a recurrent neural network , 2004, IEEE Transactions on Robotics and Automation.

[21]  María Jesús López Boada,et al.  Visual approach skill for a mobile robot using learning and fusion of simple skills , 2002, Robotics Auton. Syst..

[22]  Jonathan Kofman,et al.  Teleoperation of a robot manipulator using a vision-based human-robot interface , 2005, IEEE Transactions on Industrial Electronics.

[23]  Mitsuo Kawato,et al.  A via-point time optimization algorithm for complex sequential trajectory formation , 2004, Neural Networks.

[24]  Senior Member,et al.  Model and analysis of the interaction dynamics in cooperative manipulation tasks , 2016 .

[25]  Oliver Brock,et al.  Elastic roadmaps—motion generation for autonomous mobile manipulation , 2010, Auton. Robots.

[26]  Shuzhi Sam Ge,et al.  A unified quadratic-programming-based dynamical system approach to joint torque optimization of physically constrained redundant manipulators , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Yuanqing Xia,et al.  Adaptive Fuzzy Control of Multilateral Asymmetric Teleoperation for Coordinated Multiple Mobile Manipulators , 2016, IEEE Transactions on Fuzzy Systems.

[28]  Stefan Schaal,et al.  Learning to grasp under uncertainty , 2011, 2011 IEEE International Conference on Robotics and Automation.

[29]  Danica Kragic,et al.  Dual arm manipulation - A survey , 2012, Robotics Auton. Syst..

[30]  Darwin G. Caldwell,et al.  Compliant skills acquisition and multi-optima policy search with EM-based reinforcement learning , 2013, Robotics Auton. Syst..

[31]  Sungchul Kang,et al.  Impedance Learning for Robotic Contact Tasks Using Natural Actor-Critic Algorithm , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Kouhei Ohnishi,et al.  Semiautonomous Wheelchair Based on Quarry of Environmental Information , 2006, IEEE Transactions on Industrial Electronics.

[33]  Pyung Hun Chang,et al.  Relative Impedance Control for Dual-Arm Robots Performing Asymmetric Bimanual Tasks , 2014, IEEE Transactions on Industrial Electronics.

[34]  Michael Beetz,et al.  Generality and legibility in mobile manipulation , 2010, Auton. Robots.

[35]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[36]  Maxim Likhachev,et al.  Learning to plan for constrained manipulation from demonstrations , 2016, Auton. Robots.

[37]  Jun Morimoto,et al.  Learning CPG-based Biped Locomotion with a Policy Gradient Method: Application to a Humanoid Robot , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[38]  Antonio Bicchi,et al.  Asymmetric Bimanual Control of Dual-Arm Exoskeletons for Human-Cooperative Manipulations , 2018, IEEE Transactions on Robotics.