Upper-body kinesthetic teaching of a free-standing humanoid robot

We present an integrated approach allowing a free-standing humanoid robot to acquire new motor skills by kinesthetic teaching. The proposed method controls simultaneously the upper and lower body of the robot with different control strategies. Imitation learning is used for training the upper body of the humanoid robot via kinesthetic teaching, while at the same time Reaction Null Space method is used for keeping the balance of the robot. During demonstration, a force/torque sensor is used to record the exerted forces, and during reproduction, we use a hybrid position/force controller to apply the learned trajectories in terms of positions and forces to the end effector. The proposed method is tested on a 25-DOF Fujitsu HOAP-2 humanoid robot with a surface cleaning task.

[1]  Dragomir N. Nenchev,et al.  Ankle and hip strategies for balance recovery of a biped subjected to an impact , 2008, Robotica.

[2]  Andrej Gams,et al.  On-line periodic movement and force-profile learning for adaptation to new surfaces , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[3]  Yoshihiro Kuroki,et al.  Motion creating system for a small biped entertainment robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[4]  Henk Nijmeijer,et al.  Robot Programming by Demonstration , 2010, SIMPAR.

[5]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[6]  Yoshikazu Kanamiya,et al.  Ankle and hip balance control strategies with transitions , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Takashi Minato,et al.  Physical interaction learning: Behavior adaptation in cooperative human-robot tasks involving physical contact , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[8]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Olivier Stasse,et al.  Fast foot prints re-planning and motion generation during walking in physical human-humanoid interaction , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[10]  Aude Billard,et al.  What is the Teacher"s Role in Robot Programming by Demonstration? - Toward Benchmarks for Improved Learning , 2007 .

[11]  Kazuhito Yokoi,et al.  Real-Time Planning of Humanoid Robot's Gait for Force-Controlled Manipulation , 2004, IEEE/ASME Transactions on Mechatronics.

[12]  Jun Nakanishi,et al.  Trajectory formation for imitation with nonlinear dynamical systems , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[13]  Yoshihiko Nakamura,et al.  Mimetic Communication Model with Compliant Physical Contact in Human—Humanoid Interaction , 2010, Int. J. Robotics Res..

[14]  Shuuji Kajita,et al.  Dynamics and balance of a humanoid robot during manipulation tasks , 2006, IEEE Transactions on Robotics.

[15]  Atsushi Konno,et al.  Whole body cooperative tasks and static stability evaluations for a humanoid robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  K. Dautenhahn,et al.  The correspondence problem , 2002 .

[17]  S. Nakaoka,et al.  Entertainment Robot : Learning from Observation Paradigm for Humanoid Robot Dancing , 2007 .

[18]  Darwin G. Caldwell,et al.  Robot motor skill coordination with EM-based Reinforcement Learning , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Stefan Schaal,et al.  Biologically-inspired dynamical systems for movement generation: Automatic real-time goal adaptation and obstacle avoidance , 2009, 2009 IEEE International Conference on Robotics and Automation.

[20]  Pierre-Yves Oudeyer,et al.  Acroban the humanoid: Compliance for stabilization and human interaction , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Darwin G. Caldwell,et al.  Learning-based control strategy for safe human-robot interaction exploiting task and robot redundancies , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Rajesh P. N. Rao,et al.  Learning to Walk through Imitation , 2007, IJCAI.

[23]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[24]  Alin Albu-Schäffer,et al.  Experimental study on dynamic reactionless motions with DLR's humanoid robot Justin , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Heni Ben Amor,et al.  Kinesthetic Bootstrapping: Teaching Motor Skills to Humanoid Robots through Physical Interaction , 2009, KI.

[26]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[27]  Yoshihiko Nakamura,et al.  Motion capture based human motion recognition and imitation by direct marker control , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[28]  Oussama Khatib,et al.  Compliant Control of Multicontact and Center-of-Mass Behaviors in Humanoid Robots , 2010, IEEE Transactions on Robotics.