The CoDyCo Project Achievements and Beyond: Toward Human Aware Whole-Body Controllers for Physical Human Robot Interaction

The success of robots in real-world environments is largely dependent on their ability to interact with both humans and said environment. The FP7 EU project CoDyCo focused on the latter of these two challenges by exploiting both rigid and compliant contacts dynamics in the robot control problem. Regarding the former, to properly manage interaction dynamics on the robot control side, an estimation of the human behaviors and intentions is necessary. In this letter, we present the building blocks of such a human-in-the-loop controller, and validate them in both simulation and on the iCub humanoid robot using a human–robot interaction scenario. In this scenario, a human assists the robot in standing up from being seated on a bench.

[1]  Stefan Ulbrich,et al.  Master Motor Map (MMM) — Framework and toolkit for capturing, representing, and reproducing human motion on humanoid robots , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[2]  Nikolaos G. Tsagarakis,et al.  Yarp Based Plugins for Gazebo Simulator , 2014, MESAS.

[3]  Giulio Sandini,et al.  The iCub humanoid robot: An open-systems platform for research in cognitive development , 2010, Neural Networks.

[4]  Gabriele Nava,et al.  Stability analysis and design of momentum-based controllers for humanoid robots , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Thomas Serre,et al.  HMDB: A large video database for human motion recognition , 2011, 2011 International Conference on Computer Vision.

[6]  Jerrold E. Marsden,et al.  Introduction to Mechanics and Symmetry: A Basic Exposition of Classical Mechanical Systems , 1999 .

[7]  Claudia Latella,et al.  Whole-Body Human Inverse Dynamics with Distributed Micro-Accelerometers, Gyros and Force Sensing † , 2016, Sensors.

[8]  Vincent Padois,et al.  Whole-body hierarchical motion and force control for humanoid robots , 2016, Auton. Robots.

[9]  Gutemberg Guerra-Filho,et al.  The human motion database: A cognitive and parametric sampling of human motion , 2011, Face and Gesture 2011.

[10]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[11]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[12]  Abderrahmane Kheddar,et al.  Using a multi-objective controller to synthesize simulated humanoid robot motion with changing contact configurations , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Tamim Asfour,et al.  Unifying Representations and Large-Scale Whole-Body Motion Databases for Studying Human Motion , 2016, IEEE Transactions on Robotics.

[14]  Vincent Padois,et al.  Generalized hierarchical control , 2015, Autonomous Robots.

[15]  Michael N. Mistry,et al.  Dynamic manipulability of the center of mass: A tool to study, analyse and measure physical ability of robots , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Daniele Pucci,et al.  A Whole-Body Software Abstraction Layer for Control Design of Free-Floating Mechanical Systems , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[17]  Oskar von Stryk,et al.  HuMoD - A versatile and open database for the investigation, modeling and simulation of human motion dynamics on actuation level , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[18]  Oliver Kroemer,et al.  Interaction primitives for human-robot cooperation tasks , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Vincent Padois,et al.  Synthesis of complex humanoid whole-body behavior: A focus on sequencing and tasks transitions , 2011, 2011 IEEE International Conference on Robotics and Automation.

[20]  Alexander Herzog,et al.  Momentum control with hierarchical inverse dynamics on a torque-controlled humanoid , 2014, Autonomous Robots.

[21]  Sung-Hee Lee,et al.  A momentum-based balance controller for humanoid robots on non-level and non-stationary ground , 2012, Auton. Robots.

[22]  Francesco Nori,et al.  Simultaneous state and dynamics estimation in articulated structures , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Daniele Pucci,et al.  Highly dynamic balancing via force control , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[24]  Alexander Dietrich,et al.  An overview of null space projections for redundant, torque-controlled robots , 2015, Int. J. Robotics Res..

[25]  Olivier Sigaud,et al.  Multiple task optimization using dynamical movement primitives for whole-body reactive control , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[26]  Daniele Pucci,et al.  iCub Whole-Body Control through Force Regulation on Rigid Non-Coplanar Contacts , 2015, Front. Robot. AI.

[27]  Olivier Sigaud,et al.  Efficient reinforcement learning for humanoid whole-body control , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[28]  Pierre-Brice Wieber,et al.  Hierarchical quadratic programming: Fast online humanoid-robot motion generation , 2014, Int. J. Robotics Res..

[29]  Vincent Padois,et al.  Effective Generation of Dynamically Balanced Locomotion with Multiple Non-coplanar Contacts , 2015, ISRR.

[30]  Tamio Arai,et al.  Human-robot cooperative manipulation with motion estimation , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).