PICs for TECH: Pose Imitation Constraints (PICs) for TEaching Collaborative Heterogeneous robots (TECH)

Achieving human-like motion in robots has been a fundamental goal in many areas of robotics research. Inverse kinematic (IK) solvers have been explored as a solution to provide kinematic structures with anthropomorphic movements. In particular, numeric solvers based on geometry, such as FABRIK, have shown potential for producing human-like motion at a low computational cost. Nevertheless, these methods have shown limitations when solving for robot kinematic constraints. This work proposes a framework inspired by FABRIK for human pose imitation in real-time. The goal is to mitigate the problems of the original algorithm while retaining the resulting human-like fluidity and low cost. We first propose a human constraint model for pose imitation. Then, we present a pose imitation algorithm (PIC), and its soft version (PICs) that can successfully imitate human poses using the proposed constraint system. PIC was tested on two collaborative robots (Baxter and YuMi). Fifty human demonstrations were collected for a bi-manual assembly and an incision task. Then, two performance metrics were obtained for both robots: pose accuracy with respect to the human and the percentage of environment occlusion/obstruction. The performance of PIC and PICs was compared against the numerical solver baseline (FABRIK). The proposed algorithms achieve a higher pose accuracy than FABRIK for both tasks (0.25- FABRIK, 0.53-PICs, 0.58-PICs). In addition, PIC and its soft version achieve a lower percentage of occlusion during incision (0.10-FABRIK, 0.04-PICs, 0.09-PICs) and a lower percentage of obstruction during assembly (0.09-FABRIK, 0.08-PICs, 0.07- PICs). These results show that PIC can both efficiently reproduce human poses and achieve key desired effects of human imitation.

[1]  Gordon Cheng,et al.  Coaching: An Approach to Efficiently and Intuitively Create Humanoid Robot Behaviors , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[2]  Kazuhito Yokoi,et al.  Imitating human dance motions through motion structure analysis , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  ChangHwan Kim,et al.  Stable whole-body motion generation for humanoid robots to imitate human motions , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Mohamed Medhat Gaber,et al.  Imitation Learning , 2017, ACM Comput. Surv..

[5]  Aude Billard,et al.  Active Teaching in Robot Programming by Demonstration , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[6]  Vladimir A. Kulyukin,et al.  Generalized Hamming Distance , 2002, Information Retrieval.

[7]  Max Q.-H. Meng,et al.  Impacts of Robot Head Gaze on Robot-to-Human Handovers , 2015, Int. J. Soc. Robotics.

[8]  Majid Nili Ahmadabadi,et al.  Inverse Kinematics Based Human Mimicking System using Skeletal Tracking Technology , 2017, J. Intell. Robotic Syst..

[9]  Andreas Aristidou,et al.  FABRIK: A fast, iterative solver for the Inverse Kinematics problem , 2011, Graph. Model..

[10]  R. Kulpa,et al.  Fast inverse kinematics and kinetics solver for human-like figures , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[11]  Katsu Yamane,et al.  Simultaneous tracking and balancing of humanoid robots for imitating human motion capture data , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Bruno Arnaldi,et al.  Morphology‐independent representation of motions for interactive human‐like animation , 2005, Comput. Graph. Forum.

[13]  VelosoManuela,et al.  A survey of robot learning from demonstration , 2009 .

[14]  Andreas Aristidou,et al.  Extending FABRIK with model constraints , 2016, Comput. Animat. Virtual Worlds.

[15]  ChangHwan Kim,et al.  Solving an inverse kinematics problem for a humanoid robot\u2019s imitation of human motions using optimization , 2005, ICINCO.

[16]  Dongheui Lee,et al.  Incremental kinesthetic teaching of motion primitives using the motion refinement tube , 2011, Auton. Robots.

[17]  Ariel Shamir,et al.  Inverse Kinematics Techniques in Computer Graphics: A Survey , 2018, Comput. Graph. Forum.

[18]  Lorenzo Cominelli,et al.  Design and Evaluation of a Unique Social Perception System for Human–Robot Interaction , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[19]  Ales Ude,et al.  Enabling real-time full-body imitation: a natural way of transferring human movement to humanoids , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[20]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[21]  Chih-Cheng Chen,et al.  A combined optimization method for solving the inverse kinematics problems of mechanical manipulators , 1991, IEEE Trans. Robotics Autom..

[22]  Ben Kenwright,et al.  Inverse Kinematics - Cyclic Coordinate Descent (CCD) , 2012, J. Graph. Tools.

[23]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[24]  Oliver Kroemer,et al.  Probabilistic movement primitives for coordination of multiple human–robot collaborative tasks , 2017, Auton. Robots.

[25]  Jun Morimoto,et al.  Online approach for altering robot behaviors based on human in the loop coaching gestures , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Wolfram Burgard,et al.  A Survey of Deep Network Solutions for Learning Control in Robotics: From Reinforcement to Imitation , 2016 .

[27]  Kai Xu,et al.  FABRIKc: an Efficient Iterative Inverse Kinematics Solver for Continuum Robots , 2018, 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[28]  Tomomasa Sato,et al.  Quantitative evaluation method for pose and motion similarity based on human perception , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[29]  Tamim Asfour,et al.  Imitation of human motion on a humanoid robot using non-linear optimization , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[30]  Ying Wu,et al.  Hand modeling, analysis and recognition , 2001, IEEE Signal Process. Mag..