A Method for Derivation of Robot Task-Frame Control Authority from Repeated Sensory Observations

In this letter, we propose a novel method that enables the robot to autonomously devise an appropriate control strategy from human demonstrations without a prior knowledge of the demonstrated task. The method is primarily based on observing the patterns and consistency in the observed dataset. This is obtained through a demonstration setting that uses a motion capture system, a force sensor, and muscle activity measurements. The variables (position and force) in the collected dataset are then segmented and analysed for each axis of the observed task frame separately. While checking several conditions based on the consistency, value range, and magnitude of repeated observations, the appropriate controller (i.e., position or force) is delegated to each axis of the task frame. In the final stage, the method also checks for a correlation between variables and muscle activity patterns to determine the desired stiffness behaviour. The robot then uses the derived control strategies in autonomous operation through a hybrid force/impedance controller. To validate the proposed method, we performed experiments on real-life tasks involving physical interaction with the environment, where we considered surface wiping, material sawing, and drilling.

[1]  Andrej Gams,et al.  On-line frequency adaptation and movement imitation for rhythmic robotic tasks , 2011, Int. J. Robotics Res..

[2]  Alin Albu-Schäffer,et al.  Cartesian impedance control of redundant robots: recent results with the DLR-light-weight-arms , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[3]  Arash Ajoudani,et al.  Transferring Human Impedance Regulation Skills to Robots , 2015, Springer Tracts in Advanced Robotics.

[4]  Nikolaos G. Tsagarakis,et al.  A reduced-complexity description of arm endpoint stiffness with applications to teleimpedance control , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  M. Turvey Action and perception at the level of synergies. , 2007, Human movement science.

[6]  Jun Morimoto,et al.  Adaptation and coaching of periodic motion primitives through physical and visual interaction , 2016, Robotics Auton. Syst..

[7]  Tadej Petric,et al.  Human-in-the-loop approach for teaching robot assembly tasks using impedance control interface , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Carme Torras,et al.  Learning Physical Collaborative Robot Behaviors From Human Demonstrations , 2016, IEEE Transactions on Robotics.

[9]  Peternel Luka,et al.  Towards multi-modal intention interfaces for human-robot co-manipulation , 2016 .

[10]  Darwin G. Caldwell,et al.  Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input , 2011, Adv. Robotics.

[11]  Aude Billard,et al.  Dynamical System Modulation for Robot Learning via Kinesthetic Demonstrations , 2008, IEEE Transactions on Robotics.

[12]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  Jochen J. Steil,et al.  Automatic selection of task spaces for imitation learning , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Sami Haddadin,et al.  Unified passivity-based Cartesian force/impedance control for rigid and flexible joint robots via task-energy tanks , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Aude Billard,et al.  Task Parameterization Using Continuous Constraints Extracted From Human Demonstrations , 2015, IEEE Transactions on Robotics.

[16]  Tadej Petric,et al.  Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach , 2014, Auton. Robots.

[17]  Jun Nakanishi,et al.  Learning rhythmic movements by demonstration using nonlinear oscillators , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Darwin G. Caldwell,et al.  Learning optimal controllers in human-robot cooperative transportation tasks with position and force constraints , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Tieniu Tan,et al.  Recent developments in human motion analysis , 2003, Pattern Recognit..

[20]  Aude Billard,et al.  Statistical Learning by Imitation of Competing Constraints in Joint Space and Task Space , 2009, Adv. Robotics.

[21]  Dongheui Lee,et al.  Incremental kinesthetic teaching of motion primitives using the motion refinement tube , 2011, Auton. Robots.

[22]  Paul Evrard,et al.  Teaching physical collaborative tasks: object-lifting case study with a humanoid , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.