Synthesizing object receiving motions of humanoid robots with human motion database

This paper presents a method for synthesizing motions of a humanoid robot that receives an object from a human, with focus on a natural object passing scenario where the human initiates the passing motion by moving an object towards the robot, which continuously adapts its motion to the observed human motion in real time. In this scenario, the robot not only has to recognize and adapt to the human action but also has to synthesize its motion quickly so that the human does not have to wait holding an object. We solve these issues by using a human motion database obtained from two persons performing the object passing task. The rationale behind this approach is that human performance of such a simple task is repeatable, and therefore the receiver (robot) motion can be synthesized by looking up the passer motion in a database. We demonstrate in simulation that the robot can start extending the arm at an appropriate timing and take hand configurations suitable for the object being passed. We also perform hardware experiments of object handing from a human to a robot.

[1]  Jessica K. Hodgins,et al.  Construction and optimal search of interpolated motion graphs , 2007, ACM Trans. Graph..

[2]  Aude Billard,et al.  Coupled Dynamical System Based Hand-Arm Grasp Planning under Real-Time Perturbations , 2011, Robotics: Science and Systems.

[3]  Yoshihiko Nakamura,et al.  Mimetic Communication Model with Compliant Physical Contact in Human—Humanoid Interaction , 2010, Int. J. Robotics Res..

[4]  Weihua Sheng,et al.  Using human motion estimation for human-robot cooperative manipulation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Rachid Alami,et al.  A Human-Aware Manipulation Planner , 2012, IEEE Transactions on Robotics.

[6]  Siddhartha S. Srinivasa,et al.  Perception and Control Challenges for Effec tive Human-Robot Handoff s , 2011 .

[7]  Peter-Pike J. Sloan,et al.  Artist‐Directed Inverse‐Kinematics Using Radial Basis Function Interpolation , 2001, Comput. Graph. Forum.

[8]  Sandra Hirche,et al.  Load sharing in human-robot cooperative manipulation , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[9]  Kazuhito Yokoi,et al.  Real-Time Planning of Humanoid Robot's Gait for Force-Controlled Manipulation , 2007 .

[10]  Michael A. Saunders,et al.  User's Guide for SNOPT Version 7.4: Software for Large-Scale Nonlinear Programming , 2015 .

[11]  Katsu Yamane,et al.  Human motion database with a binary tree and node transition graphs , 2009, Robotics: Science and Systems.

[12]  Lucas Kovar,et al.  Motion graphs , 2002, SIGGRAPH Classes.

[13]  Katsu Yamane,et al.  Primitive communication based on motion recognition and generation with hierarchical mimesis model , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[14]  Yoshihiko Nakamura,et al.  Mimesis Model from Partial Observations for a Humanoid Robot , 2010, Int. J. Robotics Res..

[15]  Charles C. Kemp,et al.  Human-Robot Interaction for Cooperative Manipulation: Handing Objects to One Another , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.