A passive robot controller aiding human coaching for kinematic behavior modifications

Abstract Precise programming of robots for industrial tasks is inflexible to variations and time-consuming. Teaching a kinematic behavior by demonstration and encoding it with dynamical systems that are robust with respect to perturbations, is proposed in order to address this issue. Given a kinematic behavior encoded by Dynamic Movement Primitives (DMP), this work proposes a passive control scheme for assisting kinesthetic modifications of the learned behavior in task variations. It employs the utilization of penetrable spherical Virtual Fixtures (VFs) around the DMP’s virtual evolution that follows the teacher’s motion. The controller enables the user to haptically ‘inspect’ the spatial properties of the learned behavior in SE(3) and significantly modify it at any required segment, while facilitating the following of already learned segments. A demonstration within the VFs could signify that the kinematic behavior is taught correctly and could lead to autonomous execution, with the DMP generating the newly learned reference commands. The proposed control scheme is theoretically proved to be passive and experimentally validated with a KUKA LWR4+ robot. Results are compared with the case of using a gravity compensated robot agnostic of the previously learned task. It is shown that the time duration of teaching and the user’s cognitive load are reduced.

[1]  Andrej Gams,et al.  On-line coaching of robots through visual and physical interaction: Analysis of effectiveness of human-robot interaction strategies , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Sotiris Stavridis,et al.  Dynamical System Based Robotic Motion Generation With Obstacle Avoidance , 2017, IEEE Robotics and Automation Letters.

[3]  Andrej Gams,et al.  Human robot cooperation with compliance adaptation along the motion trajectory , 2018, Auton. Robots.

[4]  David Wood,et al.  Vygotsky, Tutoring and Learning. , 1996 .

[5]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[6]  L. Vygotsky.  Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[7]  Dimitrios Papageorgiou,et al.  Robot Control for Task Performance and Enhanced Safety under Impact , 2015, Front. Robot. AI.

[8]  Zoe Doulgeri,et al.  Operational space robot control for motion performance and safe interaction under Unintentional Contacts , 2016, 2016 European Control Conference (ECC).

[9]  Andrej Gams,et al.  Passivity Based Iterative Learning of Admittance-Coupled Dynamic Movement Primitives for Interaction with Changing Environments , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  André Crosnier,et al.  Collaborative manufacturing with physical human–robot interaction , 2016 .

[11]  Cristian Secchi,et al.  A Passivity-Based Strategy for Coaching in Human-Robot Interaction , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Ole Madsen,et al.  Robot skills for manufacturing , 2016 .

[13]  James J. Kuffner,et al.  Effective sampling and distance metrics for 3D rigid body path planning , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[14]  S. Schaal.  Dynamic Movement Primitives -A Framework for Motor Control in Humans and Humanoid Robotics , 2006 .

[15]  Andrej Gams,et al.  Coupling Movement Primitives: Interaction With the Environment and Bimanual Tasks , 2014, IEEE Transactions on Robotics.

[16]  Stefano Caselli,et al.  Toward programming of assembly tasks by demonstration in virtual environments , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[17]  Osama Mazhar,et al.  A real-time human-robot interaction framework with robust background invariant hand gesture detection , 2019, Robotics Comput. Integr. Manuf..

[18]  Maya Cakmak,et al.  Robot Programming by Demonstration with Interactive Action Visualizations , 2014, Robotics: Science and Systems.

[19]  MadsenOle,et al.  Robot skills for manufacturing , 2016 .

[20]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[21]  Andrej Gams,et al.  Learning and adaptation of periodic motion primitives based on force feedback and human coaching interaction , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[22]  Dongheui Lee,et al.  Incremental kinesthetic teaching of motion primitives using the motion refinement tube , 2011, Auton. Robots.

[23]  Jun Morimoto,et al.  Orientation in Cartesian space dynamic movement primitives , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[25]  John M. Lee.  Manifolds and Differential Geometry , 2009 .

[26]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[27]  Andrea Lockerd Thomaz,et al.  Teachable robots: Understanding human teaching behavior to build more effective robot learners , 2008, Artif. Intell..

[28]  Flavio Prieto,et al.  Trajectory generation for robotic assembly operations using learning by demonstration , 2019, Robotics and Computer-Integrated Manufacturing.

[29]  Louis B. Rosenberg,et al.  The Use of Virtual Fixtures as Perceptual Overlays to Enhance Operator Performance in Remote Environments. , 1992 .

[30]  Zoe Doulgeri,et al.  Towards Progressive Automation of Repetitive Tasks Through Physical Human-Robot Interaction , 2017, HFR.

[31]  Aude Billard,et al.  What is the Teacher"s Role in Robot Programming by Demonstration? - Toward Benchmarks for Improved Learning , 2007 .

[32]  Itzhack Y. Bar-Itzhack,et al.  Angular-Rate Estimation Using Delayed Quaternion Measurements , 1999 .

[33]  Aude Billard,et al.  Combined kinesthetic and simulated interface for teaching robot motion models , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[34]  Bruce A. MacDonald,et al.  An intuitive interface for a cognitive programming by demonstration system , 2008, 2008 IEEE International Conference on Robotics and Automation.

[35]  J.C.K. Chou,et al.  Quaternion kinematic and dynamic differential equations , 1992, IEEE Trans. Robotics Autom..

[36]  Andrej Gams,et al.  Adapting to contacts: Energy tanks and task energy for passivity-based dynamic movement primitives , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[37]  Dimitrios Papageorgiou,et al.  A passivity based control signal guaranteeing joint limit avoidance in redundant robots , 2016, 2016 24th Mediterranean Conference on Control and Automation (MED).