Learning basic unit movements for humanoid arm motion control

Manipulation skill is important for humanoid robots to live and work with humans, and arm motion control is essential for the manipulation accomplishment. In our research, we hope our robot execute a manipulation task by combining basic unit movements (BUMs), thus making the manipulation easier and more robust. So in this paper, we firstly define BUMs which actually can be regarded as basic components of any arm motion. Then we propose a learning approach for the robot to execute BUMs, which means knowing the current state, the robot learns how to move his arm to accomplish the given BUM. Considering the complexity and inaccuracy problems in solving the inverse kinematics, the proposed approach is basically building an internal inverse model and the robot directly learns in the motor space without any inverse kinematics. Taking advantages of the powerful capacity of Deep Neural Networks (DNN) in extracting inherent features, the auto-encoder is employed to formalize our model. Experimental results on MATLAB simulation as well as PKU-HR5II humanoid robot reveal the effectiveness of the proposed approach. The robot can successfully execute almost all the BUMs in the whole workspace of his right arm with the accuracy of 98.49%.

[1]  S. Buss Introduction to Inverse Kinematics with Jacobian Transpose , Pseudoinverse and Damped Least Squares methods , 2004 .

[2]  Sergey Levine,et al.  End-to-End Training of Deep Visuomotor Policies , 2015, J. Mach. Learn. Res..

[3]  Tamim Asfour,et al.  IK-Map: An enhanced workspace representation to support inverse kinematics solvers , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[4]  Rasmus Berg Palm,et al.  Prediction as a candidate for learning deep hierarchical models of data , 2012 .

[5]  E. Torres-Jara,et al.  Challenges for Robot Manipulation in Human Environments , 2006 .

[6]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[7]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[8]  Zoran Miljkovic,et al.  Neural network Reinforcement Learning for visual control of robot manipulators , 2013, Expert Syst. Appl..

[9]  Charles W. Wampler,et al.  Manipulator Inverse Kinematic Solutions Based on Vector Formulations and Damped Least-Squares Methods , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  Tamim Asfour,et al.  An integrated approach to inverse kinematics and path planning for redundant manipulators , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[11]  F.A. Mussa-Ivaldi,et al.  Neural primitives for motion control , 2004, IEEE Journal of Oceanic Engineering.

[12]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[13]  Jean-Jacques E. Slotine,et al.  A general framework for managing multiple tasks in highly redundant robotic systems , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[14]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[15]  Fahmida N. Chowdhury,et al.  A survey of neural networks applications in automatic control , 2001, Proceedings of the 33rd Southeastern Symposium on System Theory (Cat. No.01EX460).

[16]  Yuki Suga,et al.  Multimodal integration learning of object manipulation behaviors using deep neural networks , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Olivier Stasse,et al.  A versatile Generalized Inverted Kinematics implementation for collaborative working humanoid robots: The Stack Of Tasks , 2009, ICAR.

[18]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[19]  Andrea d'Avella,et al.  Modularity in the motor system: decomposition of muscle patterns as combinations of time-varying synergies , 2001, NIPS.

[20]  Pierre-Brice Wieber,et al.  Fast resolution of hierarchized inverse kinematics with inequality constraints , 2010, 2010 IEEE International Conference on Robotics and Automation.

[21]  Martin A. Giese,et al.  Model selection for the extraction of movement primitives , 2013, Front. Comput. Neurosci..